-- Logs begin at Fri 2022-05-06 22:49:06 UTC, end at Fri 2022-05-06 23:52:16 UTC. -- May 06 23:18:40.779533 dv-cinder-840996-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 06 23:18:40.787145 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 06 23:18:40.791489 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 6 23:18:40 2022] *** May 06 23:18:40.791489 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 06 23:18:40.791489 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 06 23:18:40.791489 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: nodename: dv-cinder-840996-1-iscsi May 06 23:18:40.791489 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: machine: x86_64 May 06 23:18:40.791489 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: clock source: unix May 06 23:18:40.791489 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: pcre jit disabled May 06 23:18:40.791489 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: detected number of CPU cores: 4 May 06 23:18:40.791489 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: current working directory: / May 06 23:18:40.791489 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: detected binary path: /usr/bin/uwsgi-core May 06 23:18:40.791489 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: your processes number limit is 47680 May 06 23:18:40.791489 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: your memory page size is 4096 bytes May 06 23:18:40.791489 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: detected max file descriptor number: 2048 May 06 23:18:40.791489 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: lock engine: pthread robust mutexes May 06 23:18:40.791489 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: thunder lock: enabled May 06 23:18:40.791489 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 06 23:18:40.791489 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 06 23:18:40.836829 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: Python main interpreter initialized at 0x5578c3a279c0 May 06 23:18:40.836829 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: python threads support enabled May 06 23:18:40.836829 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: your server socket listen backlog is limited to 100 connections May 06 23:18:40.836829 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: your mercy for graceful operations on workers is 90 seconds May 06 23:18:40.837211 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: mapped 403077 bytes (393 KB) for 2 cores May 06 23:18:40.837275 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: *** Operational MODE: preforking *** May 06 23:18:40.837590 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: *** uWSGI is running in multiple interpreter mode *** May 06 23:18:40.837590 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: spawned uWSGI master process (pid: 79794) May 06 23:18:40.837801 dv-cinder-840996-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 06 23:18:40.838861 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: spawned uWSGI worker 1 (pid: 79803, cores: 1) May 06 23:18:40.839018 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: spawned uWSGI worker 2 (pid: 79804, cores: 1) May 06 23:18:40.839158 dv-cinder-840996-1-iscsi devstack@keystone.service[79794]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 06 23:18:46.596186 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 06 23:18:46.596186 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: from cryptography.utils import int_from_bytes May 06 23:18:46.597549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 06 23:18:46.597549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: from cryptography.utils import int_from_bytes May 06 23:18:46.615754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 06 23:18:46.615754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: from cryptography.utils import int_from_bytes May 06 23:18:46.617092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 06 23:18:46.617092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: from cryptography.utils import int_from_bytes May 06 23:18:46.646723 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 06 23:18:46.646937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 06 23:18:46.647089 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] command line args: [] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 06 23:18:46.647358 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 06 23:18:46.647532 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ================================================================================ {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 06 23:18:46.647781 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] admin_token = **** {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.648022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] config_dir = [] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.648208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.648387 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] config_source = [] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.648586 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] debug = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.648785 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.651047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.651047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.651047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.651047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.651047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] list_limit = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.651047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] log_config_append = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.651047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.651047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] log_dir = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.651047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] log_file = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.651517 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.651517 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.651517 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.651517 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.651738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.652078 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.652078 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.652361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.652611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.653344 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.653578 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.653815 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.654053 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.654298 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.654569 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.655056 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.655256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] publish_errors = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.655457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.655658 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.655829 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.656056 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.656289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.656551 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] standard_threads = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.656761 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.656999 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.657187 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.657380 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] use_journal = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.657567 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] use_json = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.657740 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] use_stderr = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.657881 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] use_syslog = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.658050 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.658265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.658502 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.658759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.659020 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.659243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.659479 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.659727 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.659959 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.660204 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.660446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.660730 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.660963 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.661210 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.661444 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.661691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.661937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.662173 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.662425 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.662676 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.662919 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.663153 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.663403 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.663546 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 06 23:18:46.663676 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.663814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 06 23:18:46.663947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] command line args: [] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 06 23:18:46.664072 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.664197 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.664328 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 06 23:18:46.664328 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ================================================================================ {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 06 23:18:46.664686 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.664828 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] admin_token = **** {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.664966 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.665093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] config_dir = [] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.665224 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.665350 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.665481 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.665621 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] config_source = [] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.665756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.665882 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] debug = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.665882 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.666148 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.666276 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.666410 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.666537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.666678 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.666813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.666939 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.667072 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.667220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.667348 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] list_limit = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.667479 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.667605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] log_config_append = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.667729 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.667854 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.667854 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] log_dir = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.668101 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.668232 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] log_file = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.668363 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.668495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.668669 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.668810 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.668948 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.669074 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.669200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.669326 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.669461 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.669662 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.669799 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.669926 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.670054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.670186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.670323 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.670450 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.670587 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.670714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.670838 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.670969 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.671107 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.671235 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.671360 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.671485 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.671610 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.671734 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.671867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.671993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.672124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.672251 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.672388 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.672388 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.672676 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.672812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.672940 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] publish_errors = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.673065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.673199 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.673326 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.673452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.673452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.673696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.673821 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.673955 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.674092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.674224 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.674350 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] standard_threads = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.674476 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.674601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.674742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.674870 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.675069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.675198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.675323 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.675450 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] use_journal = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.675450 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] use_json = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.675700 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.675826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] use_stderr = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.675962 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.676094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] use_syslog = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.676219 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.676356 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 06 23:18:46.676356 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.676356 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.676748 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.676748 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.676986 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.676986 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.677235 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.677361 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.677491 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.677629 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.677755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.677755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.678002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.678127 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.678252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.678252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.678488 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.678626 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.678753 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.678879 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.679004 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.679129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.679254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.680480 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.680711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.680944 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.681110 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.681302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.681493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.681722 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.681926 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.682092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.682286 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.682476 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.682715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.682917 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.683166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.683366 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.683558 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.683756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.684011 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.684178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.684372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.684623 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.684790 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.685023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.685228 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.685393 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.685557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.685719 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.685861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.686027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.686163 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.686332 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.686465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.686607 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.686739 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.686865 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.687027 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.687167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.687306 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.687434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.687560 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.687700 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.687826 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.687952 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.688091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.688219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.688378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.688511 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.688685 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.688814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.688952 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.689082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.689208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] auth.external = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.689335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.689461 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.689605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.689733 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.689860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.689987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.690114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.690240 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] auth.password = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.690375 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.690375 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.690623 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] auth.token = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.690749 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.690881 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.691042 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.691337 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.691488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.691617 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.691743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.691870 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.691997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.692198 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.692337 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.692466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.692646 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.692778 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.692904 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.693045 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] credential.caching = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.693179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.693308 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.693445 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.693572 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.693698 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.693833 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.693961 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.694087 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.694212 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.694339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.694473 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.694613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.694749 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.694885 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.695020 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.695164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.695291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.695426 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.695561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.695696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.695824 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.695824 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.696075 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.696202 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.696328 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.696465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.696615 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.696747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.696874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.697010 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.697137 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.697346 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.697494 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] federation.caching = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.697624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.697751 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.697878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.698013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.698141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.698274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.698401 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.698529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.698655 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.698799 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.698955 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.699096 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.699233 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.699362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.700000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.700129 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.700256 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.700383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.700523 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.700695 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.700823 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.700950 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.701086 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.701234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] identity.caching = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.701369 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.701497 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.701626 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.701753 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.701885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.702023 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.702158 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.702287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.702414 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.702541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.702668 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.702807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.702946 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.703082 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.703210 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.703338 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.703473 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.703610 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.703739 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.703867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.704002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.704130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.704257 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.704396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.704530 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.704684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.704824 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.704952 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.705088 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.705225 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.705353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.705486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.705621 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.705749 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.705878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.706013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.706142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.706269 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.706397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.706524 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.706671 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.706809 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.706939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.707075 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.707203 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.707330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.707458 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] auth.external = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.707663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.707794 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.707922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.708057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.708187 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.708314 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.708460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.708611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] auth.password = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.708743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.708870 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] auth.token = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.708999 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.709126 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.709264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.709394 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.709522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.709649 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.709777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.709944 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.710087 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.710217 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.710412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.710546 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.710674 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.710801 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.710938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.711068 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] credential.caching = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.711196 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.711324 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.711452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.711585 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.711729 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.711859 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.711986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.712113 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.712357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.712523 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.712686 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.712817 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.712944 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.713338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.713467 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.713595 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.713731 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.713860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.713988 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.714116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.714244 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.714244 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.714505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.714632 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.714759 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.714886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.715019 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.715736 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.user = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.715868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.715996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.716129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.716257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.716386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] federation.caching = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.716523 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.716692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.716833 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.716961 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.717088 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.717215 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.717354 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.717484 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.717611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.717738 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.717872 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.718000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.718136 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.718266 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.718393 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.718532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.718660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.718787 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.718923 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.719052 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.719179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.719306 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.719433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.719561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] identity.caching = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.719696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.719825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.719952 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.720084 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.720211 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.720357 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.720496 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.720649 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.720780 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.720918 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.721046 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.721174 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.721310 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.721438 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.721566 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.721693 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.721830 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.721963 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.722110 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.722239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.722366 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.722493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.722493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.722734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.722870 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.722999 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.723125 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.723252 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.723379 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.723505 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.723505 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.723756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.723894 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.724022 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.724149 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.724276 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.724411 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.724557 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.724691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.724820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.724947 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.725074 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.725212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.725341 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.725468 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] resource.caching = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.725595 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.725730 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.725859 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.725995 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.726124 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.726252 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.726379 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.726506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.726639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.726780 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.726909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.727037 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.727164 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.727291 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.727441 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.727571 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.727698 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.727825 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.727953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.728080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] role.caching = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.728221 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.728351 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] role.driver = sql {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.728479 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.728629 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.728759 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.728887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.729026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.729026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.729279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.729408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.729535 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.729662 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.729804 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.729940 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.730073 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.730215 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.730350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.730483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.730624 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.730759 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.730892 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.731036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.731170 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.731303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.731444 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.731579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.731712 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.731845 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.731977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.732112 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.732253 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.732388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.732388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.732695 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.732831 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.user = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.732974 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.733121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.733257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.733391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.733524 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.733657 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.733789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.734101 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.734260 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.734398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.734532 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.734701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.734841 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.734995 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.735130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.735265 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.735397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.735530 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.735663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.735805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.735946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.736081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.736214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.736349 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.736489 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.736662 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.736802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.736946 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.737079 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.737219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.737363 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.737498 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.737631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.737764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.737897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.738030 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.738171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] token.caching = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.738306 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.738440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.738573 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.738717 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.738850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.738991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.739125 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.739259 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.739393 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.739526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.739659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.739801 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.739936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.740069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.740201 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.740335 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.740469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.740690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.740829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.740963 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.741096 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.741229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.741362 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.741506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.741642 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.741775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.741908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.742042 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.742175 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.742317 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.742451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.742597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.742731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.742864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.742997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.743138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] database.connection = **** {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.743282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] resource.caching = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.743429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.743564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.743699 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.743833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.743966 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.744100 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.744242 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.744377 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.744521 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.744678 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.744813 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.744946 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.745090 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.745226 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.745359 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.745491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.745623 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.745763 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.745907 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.746042 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] role.caching = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.746175 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.746810 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] role.driver = sql {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.746948 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.747082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.747224 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.747360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.747493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.747626 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.747761 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.747907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.748044 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.748178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.748312 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.748445 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.748594 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.748594 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 06 23:18:46.748880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.748880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.748880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.748880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.748880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.748880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.748880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.748880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.748880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.749978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.749978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.749978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.749978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.749978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.749978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.749978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.749978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.749978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.751094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.751094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.751094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.751094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.751094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.751094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.751094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.751094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.751094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.752198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] token.caching = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.752198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.752198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.752198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.752198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.752198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.752198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.752198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.752198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.753384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.753384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.753384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.753384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.753384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.753384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.753384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.753384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.753384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.754488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] database.connection = **** {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.754488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.754488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.754488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.754488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.754488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.754488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.754488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.754488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.755702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.755702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.755702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.755702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.755702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.755702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.755702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.755702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.755702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.756832 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 06 23:18:46.756832 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 06 23:18:46.763531 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.763762 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.763988 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.772713 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.773672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.773903 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.774125 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.782743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.801072 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.801299 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.802593 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.802823 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.859218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.864109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.912208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.912432 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.912735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.913073 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.978061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.978286 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.978507 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.978710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.978798 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.978924 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.979136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.979217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.979535 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.979850 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.980169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:46.980486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.003167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.003399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.003625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.003798 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.003883 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.004049 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.004259 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.004350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.004468 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.004774 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.005097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.005418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.005750 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.006070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.016478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.017580 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.031650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.031919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.032102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.032301 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.032386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.032517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.032747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.032902 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.032986 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.033288 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.033606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.033926 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.034243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.034547 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 06 23:18:47.049996 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.050204 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 06 23:18:47.050505 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.050599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.050723 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 06 23:18:47.050985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 06 23:18:47.051067 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.051235 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.051484 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.051645 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.051727 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.052004 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 06 23:18:47.052371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.052753 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.053110 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.053475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.063115 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.063386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.063649 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.063925 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.065510 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.065893 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.066264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.066647 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.071970 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.075077 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.075438 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.075715 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.075990 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.076375 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.076673 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.076931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.077192 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.077457 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.077720 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.078162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.078262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.079587 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.079971 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.080352 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.080867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.081253 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.081618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.081990 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.082374 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.082715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.083058 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.083395 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.105631 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.107796 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.108070 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.111535 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.113212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.113409 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.113630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.113756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.113944 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.119165 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.119519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.119868 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.121260 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.121568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.126183 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.126468 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.126743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.127019 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.127288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.127556 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.127820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.127955 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.128080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.128281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.133082 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.133486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.133876 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.134258 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.134637 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.135017 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.135391 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.135774 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.147217 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.147488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.151974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.156033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.156128 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.156390 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.156557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.161240 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.161322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.164912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.165204 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.165598 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.168640 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.168928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.169201 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.169475 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.169742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.170011 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.171397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.175178 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.179079 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.179484 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.179873 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.180261 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.180666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.181059 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.188889 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.189262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.189524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.189782 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.197632 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.199339 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.200126 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.201577 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.202063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.202435 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.202802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.203169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.203441 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.203713 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.204000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.204269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.211330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.213442 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.213831 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.217577 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.217968 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.218361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.218553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.218828 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.218919 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.219101 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.219382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.219461 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.219655 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.219928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.220196 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.233305 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.233704 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.234082 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.234474 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.234856 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.235245 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.235634 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.238343 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.241611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.244948 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.246555 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.248175 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.248454 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.248755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.254608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.256138 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.257755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.258257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.260987 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.261271 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.261549 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.261819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.262650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.264326 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.265988 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.266267 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.266553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.271850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.272147 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.272422 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.273951 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.275529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.279318 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.279597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.279873 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.280142 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.280844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.281119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.281388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.281652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.281917 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.282194 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.282459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.282724 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.282984 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.283244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.283506 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.283777 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.284033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.284283 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.289344 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.289631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.289902 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.297932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 06 23:18:47.298206 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.298558 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.298833 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.299096 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.299375 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.299642 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.299911 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.300172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.300430 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.300722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.301000 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.301257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.301507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 06 23:18:47.322708 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5578c3a279c0 pid: 79804 (default app) May 06 23:18:47.326577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb379a79-9290-4db0-af39-418d52466f49 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:18:47.326864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb379a79-9290-4db0-af39-418d52466f49 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:18:47.327144 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb379a79-9290-4db0-af39-418d52466f49 None None] PATH_INFO: `/v3` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:18:47.333196 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Fri May 6 23:18:47 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:18:47.341628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5578c3a279c0 pid: 79803 (default app) May 06 23:18:55.257393 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d5dbf-45b1-4581-8be8-5e2e1ee707bb None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:18:55.257912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d5dbf-45b1-4581-8be8-5e2e1ee707bb None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:18:55.257912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d5dbf-45b1-4581-8be8-5e2e1ee707bb None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:18:55.259201 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:18:55.266640 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae71ae-88fc-4722-8b17-ada9421598cd None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:18:55.267055 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae71ae-88fc-4722-8b17-ada9421598cd None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:18:55.267200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae71ae-88fc-4722-8b17-ada9421598cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:18:55.297936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG oslo_db.sqlalchemy.engines [None req-77ae71ae-88fc-4722-8b17-ada9421598cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79803) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 06 23:18:55.478725 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG passlib.handlers.bcrypt [None req-77ae71ae-88fc-4722-8b17-ada9421598cd None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79803) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 06 23:18:55.479141 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG passlib.handlers.bcrypt [None req-77ae71ae-88fc-4722-8b17-ada9421598cd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79803) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 06 23:18:55.534173 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-77ae71ae-88fc-4722-8b17-ada9421598cd None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:18:55.535773 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-77ae71ae-88fc-4722-8b17-ada9421598cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:18:55.660996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1/3] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:18:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 06 23:18:55.694166 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d5dbf-45b1-4581-8be8-5e2e1ee707bb None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:18:55.727376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG oslo_db.sqlalchemy.engines [None req-050d5dbf-45b1-4581-8be8-5e2e1ee707bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79804) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 06 23:18:55.857535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d5dbf-45b1-4581-8be8-5e2e1ee707bb None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:18:55.861839 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fef2e2-f3f0-4233-b8e5-053815473325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:18:55.862497 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fef2e2-f3f0-4233-b8e5-053815473325 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:18:55.862779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fef2e2-f3f0-4233-b8e5-053815473325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:18:55.863054 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fef2e2-f3f0-4233-b8e5-053815473325 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:18:55.871463 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fef2e2-f3f0-4233-b8e5-053815473325 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:18:55.927588 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: WARNING keystone.common.rbac_enforcer.enforcer [None req-61fef2e2-f3f0-4233-b8e5-053815473325 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 06 23:18:55.927928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fef2e2-f3f0-4233-b8e5-053815473325 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:18:55.937761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 3/4] 10.222.0.60 () {58 vars in 1324 bytes} [Fri May 6 23:18:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 06 23:18:55.943862 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae71ae-88fc-4722-8b17-ada9421598cd None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:18:55.957854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae71ae-88fc-4722-8b17-ada9421598cd None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:18:55.962232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ff030-f3b0-45ab-a1f7-cab8be2f755c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:18:55.963582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ff030-f3b0-45ab-a1f7-cab8be2f755c admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:18:55.963861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ff030-f3b0-45ab-a1f7-cab8be2f755c admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:18:55.964133 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ff030-f3b0-45ab-a1f7-cab8be2f755c admin admin] PATH_INFO: `/v3/projects/6afc05c85d9a4c7da004b8027296012b` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:18:55.966271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ff030-f3b0-45ab-a1f7-cab8be2f755c admin admin] RBAC: Authorizing `identity:get_project(project_id=6afc05c85d9a4c7da004b8027296012b)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:18:56.016862 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c49ff030-f3b0-45ab-a1f7-cab8be2f755c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 06 23:18:56.017205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ff030-f3b0-45ab-a1f7-cab8be2f755c admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:18:56.021927 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 2/5] 10.222.0.60 () {56 vars in 1207 bytes} [Fri May 6 23:18:55 2022] GET /identity/v3/projects/6afc05c85d9a4c7da004b8027296012b => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:18:58.217726 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4231a-fb17-4e3d-b55f-4058467099a9 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:18:58.218239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4231a-fb17-4e3d-b55f-4058467099a9 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:18:58.218239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4231a-fb17-4e3d-b55f-4058467099a9 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:18:58.222286 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 4/6] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:18:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:18:58.227789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30951ccb-f222-4092-a14f-89cee045fa10 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:18:58.228194 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30951ccb-f222-4092-a14f-89cee045fa10 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:18:58.228337 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30951ccb-f222-4092-a14f-89cee045fa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:18:58.248430 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-30951ccb-f222-4092-a14f-89cee045fa10 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:18:58.249934 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-30951ccb-f222-4092-a14f-89cee045fa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:18:58.257661 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 3/7] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:18:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 06 23:18:58.279575 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4231a-fb17-4e3d-b55f-4058467099a9 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:18:58.291492 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4231a-fb17-4e3d-b55f-4058467099a9 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:18:58.296270 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0859835-412f-4e5e-83c5-6e19150e98a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:18:58.296915 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0859835-412f-4e5e-83c5-6e19150e98a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:18:58.297197 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0859835-412f-4e5e-83c5-6e19150e98a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:18:58.297471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0859835-412f-4e5e-83c5-6e19150e98a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:18:58.304901 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0859835-412f-4e5e-83c5-6e19150e98a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:18:58.306666 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0859835-412f-4e5e-83c5-6e19150e98a1 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:18:58.315488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 5/8] 10.222.0.60 () {58 vars in 1324 bytes} [Fri May 6 23:18:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 06 23:18:58.320783 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30951ccb-f222-4092-a14f-89cee045fa10 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:18:58.329425 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30951ccb-f222-4092-a14f-89cee045fa10 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:18:58.334912 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73afc2d-ed5e-41a4-ac20-999a9e3fda35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:18:58.334912 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73afc2d-ed5e-41a4-ac20-999a9e3fda35 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:18:58.340311 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73afc2d-ed5e-41a4-ac20-999a9e3fda35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:18:58.340311 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73afc2d-ed5e-41a4-ac20-999a9e3fda35 admin admin] PATH_INFO: `/v3/users/76cc2bb71c0f410d8c0ab888335070a1` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:18:58.340311 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73afc2d-ed5e-41a4-ac20-999a9e3fda35 admin admin] RBAC: Authorizing `identity:get_user(user_id=76cc2bb71c0f410d8c0ab888335070a1)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:18:58.340311 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73afc2d-ed5e-41a4-ac20-999a9e3fda35 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:18:58.341181 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 4/9] 10.222.0.60 () {56 vars in 1198 bytes} [Fri May 6 23:18:58 2022] GET /identity/v3/users/76cc2bb71c0f410d8c0ab888335070a1 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:00.603558 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d09fb-197d-44e5-a54b-a448bc7efa1f None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:00.604094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d09fb-197d-44e5-a54b-a448bc7efa1f None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:00.604094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d09fb-197d-44e5-a54b-a448bc7efa1f None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:00.605670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:00.610884 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9d098-77e6-4c4f-869e-ccfdeb73774a None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:00.611269 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9d098-77e6-4c4f-869e-ccfdeb73774a None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:00.611448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9d098-77e6-4c4f-869e-ccfdeb73774a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:00.624860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a76fb-9a9a-405b-a4e9-3ac1d541346d None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:00.625145 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a76fb-9a9a-405b-a4e9-3ac1d541346d None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:00.625420 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a76fb-9a9a-405b-a4e9-3ac1d541346d None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:00.626794 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 7/11] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:19:00.632645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edfdff-d50c-403e-9e31-800631feada8 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:00.632926 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edfdff-d50c-403e-9e31-800631feada8 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:00.633201 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edfdff-d50c-403e-9e31-800631feada8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:00.675344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG passlib.handlers.bcrypt [None req-b4edfdff-d50c-403e-9e31-800631feada8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79804) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 06 23:19:00.675766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG passlib.handlers.bcrypt [None req-b4edfdff-d50c-403e-9e31-800631feada8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79804) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 06 23:19:00.723761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-b4edfdff-d50c-403e-9e31-800631feada8 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:00.725446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b4edfdff-d50c-403e-9e31-800631feada8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:00.735160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-aea9d098-77e6-4c4f-869e-ccfdeb73774a None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:00.736320 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-aea9d098-77e6-4c4f-869e-ccfdeb73774a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:00.812611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 5/12] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:00.822140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 8/13] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:19:00.835666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9d098-77e6-4c4f-869e-ccfdeb73774a None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:00.844608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edfdff-d50c-403e-9e31-800631feada8 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:00.930064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9d098-77e6-4c4f-869e-ccfdeb73774a None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:00.938318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edfdff-d50c-403e-9e31-800631feada8 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:00.962005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082feb6-e02b-4054-8aae-22089c7fdcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:00.962795 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082feb6-e02b-4054-8aae-22089c7fdcf2 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:00.963344 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082feb6-e02b-4054-8aae-22089c7fdcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:00.963631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082feb6-e02b-4054-8aae-22089c7fdcf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:00.970562 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ec62a-794a-473f-a11a-9f13a6c23627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:00.971453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ec62a-794a-473f-a11a-9f13a6c23627 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:00.971739 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ec62a-794a-473f-a11a-9f13a6c23627 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:00.972017 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ec62a-794a-473f-a11a-9f13a6c23627 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:00.974612 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082feb6-e02b-4054-8aae-22089c7fdcf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:00.986264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-f082feb6-e02b-4054-8aae-22089c7fdcf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:00.986264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:00.986264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:00.986264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:00.986264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:00.986264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:00.986264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:00.986264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:00.986264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:00.986264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:00.986264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:00.986264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:00.986264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:00.986264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:00.986264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:00.986264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:00.987274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:00.987274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:00.987274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:00.987274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:00.987274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:00.987274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:00.987274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:00.987274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:00.987274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:00.987274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:00.987274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:00.987274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:00.987274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:00.987274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:00.987274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:00.987274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:00.988062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:00.988062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:00.988062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:00.988062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:00.988062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:00.988062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:00.988062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:00.988062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:00.988062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:00.988062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:00.988062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:00.988062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:00.988062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 6/14] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:19:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:00.993177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082feb6-e02b-4054-8aae-22089c7fdcf2 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:01.036339 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ec62a-794a-473f-a11a-9f13a6c23627 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:01.037897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ec62a-794a-473f-a11a-9f13a6c23627 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:01.085938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082feb6-e02b-4054-8aae-22089c7fdcf2 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:01.117981 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643dc1d-e967-481f-a627-7a41ff14747e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:01.118640 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643dc1d-e967-481f-a627-7a41ff14747e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:01.118926 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643dc1d-e967-481f-a627-7a41ff14747e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:01.119208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643dc1d-e967-481f-a627-7a41ff14747e None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:01.119953 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643dc1d-e967-481f-a627-7a41ff14747e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:01.120263 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643dc1d-e967-481f-a627-7a41ff14747e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:01.122224 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643dc1d-e967-481f-a627-7a41ff14747e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:01.130745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 9/15] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 06 23:19:01.133498 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 7/16] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:01.139188 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643dc1d-e967-481f-a627-7a41ff14747e None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:01.139300 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ec62a-794a-473f-a11a-9f13a6c23627 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:01.238470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643dc1d-e967-481f-a627-7a41ff14747e None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:01.273243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad979f6b-17df-4371-ae02-815105f5adb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:01.274107 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad979f6b-17df-4371-ae02-815105f5adb0 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:01.274389 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad979f6b-17df-4371-ae02-815105f5adb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:01.274665 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad979f6b-17df-4371-ae02-815105f5adb0 None admin] PATH_INFO: `/v3/users/76cc2bb71c0f410d8c0ab888335070a1` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:01.275870 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad979f6b-17df-4371-ae02-815105f5adb0 None admin] RBAC: Authorizing `identity:get_user(user_id=76cc2bb71c0f410d8c0ab888335070a1)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:01.277388 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad979f6b-17df-4371-ae02-815105f5adb0 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:01.279015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 8/17] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:01 2022] GET /identity/v3/users/76cc2bb71c0f410d8c0ab888335070a1 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:01.284443 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad979f6b-17df-4371-ae02-815105f5adb0 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:01.339864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ec62a-794a-473f-a11a-9f13a6c23627 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:01.372514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab88e97-bcb1-4369-bebb-9c40d43f6671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:01.373322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab88e97-bcb1-4369-bebb-9c40d43f6671 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:01.373597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab88e97-bcb1-4369-bebb-9c40d43f6671 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:01.373865 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab88e97-bcb1-4369-bebb-9c40d43f6671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:01.391508 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab88e97-bcb1-4369-bebb-9c40d43f6671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:01.391642 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad979f6b-17df-4371-ae02-815105f5adb0 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:01.392996 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab88e97-bcb1-4369-bebb-9c40d43f6671 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:01.412451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-2ab88e97-bcb1-4369-bebb-9c40d43f6671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:19:01.412451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:01.412451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:01.412451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:01.412451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:01.412451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:01.412451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:01.412451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:01.412451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:01.412451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:01.412451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:01.412451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:01.412451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:19:01.412451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:19:01.412451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:19:01.413430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:19:01.413430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:01.413430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:01.413430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:01.413430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:01.413430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:01.413430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:01.413430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:01.413430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:01.413430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:01.413430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:01.413430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:01.413430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:01.413430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:01.413430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:01.413430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:01.413430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:01.414243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:19:01.414243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:19:01.414243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:19:01.414243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:01.414243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 10/18] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:19:01.419892 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab88e97-bcb1-4369-bebb-9c40d43f6671 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:01.423864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50172c4-0b67-4f45-96fb-e84a09a2992d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:01.424767 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50172c4-0b67-4f45-96fb-e84a09a2992d None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:01.425054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50172c4-0b67-4f45-96fb-e84a09a2992d None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:01.425329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50172c4-0b67-4f45-96fb-e84a09a2992d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:01.426513 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50172c4-0b67-4f45-96fb-e84a09a2992d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:01.427968 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50172c4-0b67-4f45-96fb-e84a09a2992d None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:01.429603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 9/19] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:19:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:01.435741 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50172c4-0b67-4f45-96fb-e84a09a2992d None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:01.513100 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab88e97-bcb1-4369-bebb-9c40d43f6671 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:01.526800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50172c4-0b67-4f45-96fb-e84a09a2992d None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:01.545280 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680f2ed-a28b-4498-a519-ffa1bbf6cf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:01.545946 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680f2ed-a28b-4498-a519-ffa1bbf6cf12 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:01.546226 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680f2ed-a28b-4498-a519-ffa1bbf6cf12 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:01.546504 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680f2ed-a28b-4498-a519-ffa1bbf6cf12 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:01.547227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680f2ed-a28b-4498-a519-ffa1bbf6cf12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:01.547534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680f2ed-a28b-4498-a519-ffa1bbf6cf12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:01.548966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680f2ed-a28b-4498-a519-ffa1bbf6cf12 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:01.558912 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091f419-1d56-4fcd-affb-7ba90893b19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:01.559556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091f419-1d56-4fcd-affb-7ba90893b19b None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:01.559836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091f419-1d56-4fcd-affb-7ba90893b19b None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:01.560108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091f419-1d56-4fcd-affb-7ba90893b19b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:01.560961 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091f419-1d56-4fcd-affb-7ba90893b19b None admin] RBAC: Adding query filter params (role.id=408ee9a3a38640a48dbcdb2c377efcd8, scope.domain.id=default, user.id=76cc2bb71c0f410d8c0ab888335070a1) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:01.561270 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091f419-1d56-4fcd-affb-7ba90893b19b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:01.562684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091f419-1d56-4fcd-affb-7ba90893b19b None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:01.565893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 11/20] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:01.569243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 10/21] 10.222.0.60 () {56 vars in 1322 bytes} [Fri May 6 23:19:01 2022] GET /identity/v3/role_assignments?user.id=76cc2bb71c0f410d8c0ab888335070a1&scope.domain.id=default&role.id=408ee9a3a38640a48dbcdb2c377efcd8 => generated 233 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:04.318575 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f9007-0c3b-4ba8-9bb5-ac815cd795d1 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:04.319449 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f9007-0c3b-4ba8-9bb5-ac815cd795d1 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:04.319872 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f9007-0c3b-4ba8-9bb5-ac815cd795d1 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:04.321403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 12/22] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:04.326931 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a22578-b153-4275-9fe3-985abf2cae9b None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:04.327774 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a22578-b153-4275-9fe3-985abf2cae9b None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:04.328271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a22578-b153-4275-9fe3-985abf2cae9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:04.353792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-92a22578-b153-4275-9fe3-985abf2cae9b None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:04.355484 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-92a22578-b153-4275-9fe3-985abf2cae9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:04.437891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 11/23] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:04.473194 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f9007-0c3b-4ba8-9bb5-ac815cd795d1 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:04.548210 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c189cc2-fec4-455e-8720-e4bc9175ee68 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:04.548901 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c189cc2-fec4-455e-8720-e4bc9175ee68 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:04.549389 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c189cc2-fec4-455e-8720-e4bc9175ee68 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:04.551471 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 12/24] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:19:04.558056 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d2d4f-db3d-4d57-92d5-d73f36573823 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:04.558706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d2d4f-db3d-4d57-92d5-d73f36573823 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:04.559190 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d2d4f-db3d-4d57-92d5-d73f36573823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:04.587510 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-aa4d2d4f-db3d-4d57-92d5-d73f36573823 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:04.589326 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-aa4d2d4f-db3d-4d57-92d5-d73f36573823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:04.658289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f9007-0c3b-4ba8-9bb5-ac815cd795d1 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:04.690006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 13/25] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:19:04.725617 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d2d4f-db3d-4d57-92d5-d73f36573823 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:04.750778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6bd288-7147-4681-ad72-8c36b6ceff7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:04.751642 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bd288-7147-4681-ad72-8c36b6ceff7a None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:04.751941 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bd288-7147-4681-ad72-8c36b6ceff7a None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:04.752244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bd288-7147-4681-ad72-8c36b6ceff7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:04.803369 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6bd288-7147-4681-ad72-8c36b6ceff7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:04.812269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-4a6bd288-7147-4681-ad72-8c36b6ceff7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:04.812269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:04.812269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:04.812269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:04.812269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:04.812269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:04.812269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:04.812269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:04.812269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:04.812269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:04.812269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:04.812269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:04.812269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:04.812269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:04.812269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:04.812269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:04.813152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:04.813152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:04.813152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:04.813152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:04.813152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:04.813152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:04.813152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:04.813152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:04.813152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:04.813152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:04.813152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:04.813152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:04.813152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:04.813152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:04.813152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:04.813152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:04.813914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:04.813914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:04.813914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:04.813914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:04.813914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:04.813914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:04.813914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:04.813914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:04.813914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:04.813914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:04.813914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:04.813914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:04.813914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 13/26] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:19:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:04.814898 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f02f3a-97d1-4ddf-a022-c9bddf98d973 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:04.815334 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f02f3a-97d1-4ddf-a022-c9bddf98d973 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:04.815745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f02f3a-97d1-4ddf-a022-c9bddf98d973 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:04.817459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 14/27] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:04.822133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f02f3a-97d1-4ddf-a022-c9bddf98d973 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:04.902924 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d2d4f-db3d-4d57-92d5-d73f36573823 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:04.969780 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42957343-34a1-4266-9bc8-6416f00dbfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:04.970585 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42957343-34a1-4266-9bc8-6416f00dbfe0 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:04.970867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42957343-34a1-4266-9bc8-6416f00dbfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:04.971132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42957343-34a1-4266-9bc8-6416f00dbfe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:04.987807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42957343-34a1-4266-9bc8-6416f00dbfe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:04.989394 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42957343-34a1-4266-9bc8-6416f00dbfe0 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:04.998878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f02f3a-97d1-4ddf-a022-c9bddf98d973 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:05.009392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-42957343-34a1-4266-9bc8-6416f00dbfe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:19:05.009392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:05.009392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:05.009392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:05.009392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:05.009392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:05.009392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:05.009392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:05.009392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:05.009392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:05.009392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:05.009392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:05.009392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:19:05.009392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:19:05.009392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:19:05.010378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:19:05.010378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:05.010378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:05.010378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:05.010378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:05.010378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:05.010378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:05.010378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:05.010378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:05.010378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:05.010378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:05.010378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:05.010378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:05.010378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:05.010378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:05.010378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:05.010378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:05.011404 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:19:05.011404 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:19:05.011404 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:19:05.011404 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:05.013082 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 14/28] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:19:05.014429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923f200-f6fb-403d-a38f-5145b421c663 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:05.014868 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923f200-f6fb-403d-a38f-5145b421c663 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:05.015290 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923f200-f6fb-403d-a38f-5145b421c663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:05.035789 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d85e7a-def5-4df0-a9d4-6692ff1f2739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:05.036120 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-e923f200-f6fb-403d-a38f-5145b421c663 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:05.036968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d85e7a-def5-4df0-a9d4-6692ff1f2739 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:05.037332 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e923f200-f6fb-403d-a38f-5145b421c663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:05.037578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d85e7a-def5-4df0-a9d4-6692ff1f2739 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:05.038005 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d85e7a-def5-4df0-a9d4-6692ff1f2739 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:05.038975 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d85e7a-def5-4df0-a9d4-6692ff1f2739 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:05.039424 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d85e7a-def5-4df0-a9d4-6692ff1f2739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:05.041063 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d85e7a-def5-4df0-a9d4-6692ff1f2739 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:05.054014 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 15/29] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:05.055481 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca73f1-1073-40a0-a4a9-86b3ec5cdb19 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:05.055934 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca73f1-1073-40a0-a4a9-86b3ec5cdb19 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:05.056369 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca73f1-1073-40a0-a4a9-86b3ec5cdb19 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:05.058048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:05.062956 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca73f1-1073-40a0-a4a9-86b3ec5cdb19 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:05.107232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 15/31] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:05.108045 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923f200-f6fb-403d-a38f-5145b421c663 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:05.172478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca73f1-1073-40a0-a4a9-86b3ec5cdb19 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:05.207377 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c764c9-9cca-434c-bfea-0271492b9ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:05.208369 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c764c9-9cca-434c-bfea-0271492b9ab2 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:05.208880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c764c9-9cca-434c-bfea-0271492b9ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:05.209352 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c764c9-9cca-434c-bfea-0271492b9ab2 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:05.210314 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c764c9-9cca-434c-bfea-0271492b9ab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:05.210795 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c764c9-9cca-434c-bfea-0271492b9ab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:05.212424 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c764c9-9cca-434c-bfea-0271492b9ab2 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:05.230040 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923f200-f6fb-403d-a38f-5145b421c663 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:05.230568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 17/32] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:05.231936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fd06c-1374-43b7-b2bb-0021e8778df5 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:05.232174 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fd06c-1374-43b7-b2bb-0021e8778df5 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:05.232451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fd06c-1374-43b7-b2bb-0021e8778df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:05.250332 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-5d5fd06c-1374-43b7-b2bb-0021e8778df5 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:05.251596 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-5d5fd06c-1374-43b7-b2bb-0021e8778df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:05.270909 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b18c5-dcae-475e-9fdc-23bddac43d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:05.272144 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b18c5-dcae-475e-9fdc-23bddac43d3d None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:05.272692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b18c5-dcae-475e-9fdc-23bddac43d3d None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:05.273145 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b18c5-dcae-475e-9fdc-23bddac43d3d None admin] PATH_INFO: `/v3/users/76cc2bb71c0f410d8c0ab888335070a1` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:05.274703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b18c5-dcae-475e-9fdc-23bddac43d3d None admin] RBAC: Authorizing `identity:get_user(user_id=76cc2bb71c0f410d8c0ab888335070a1)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:05.276394 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b18c5-dcae-475e-9fdc-23bddac43d3d None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:05.278953 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 16/33] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:05 2022] GET /identity/v3/users/76cc2bb71c0f410d8c0ab888335070a1 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:05.279988 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b18c5-dcae-475e-9fdc-23bddac43d3d None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:05.320524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 18/34] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:05.321362 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fd06c-1374-43b7-b2bb-0021e8778df5 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:05.387108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b18c5-dcae-475e-9fdc-23bddac43d3d None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:05.421231 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184fdef-7e84-4fb4-ac40-8d6009b2e429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:05.421899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184fdef-7e84-4fb4-ac40-8d6009b2e429 None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:05.422179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184fdef-7e84-4fb4-ac40-8d6009b2e429 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:05.422452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184fdef-7e84-4fb4-ac40-8d6009b2e429 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:05.422887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fd06c-1374-43b7-b2bb-0021e8778df5 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:05.423198 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184fdef-7e84-4fb4-ac40-8d6009b2e429 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:05.424604 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184fdef-7e84-4fb4-ac40-8d6009b2e429 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:05.458637 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ea53e-07b4-46af-a022-2234dd4baae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:05.459329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea53e-07b4-46af-a022-2234dd4baae1 None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:05.459618 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea53e-07b4-46af-a022-2234dd4baae1 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:05.459892 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea53e-07b4-46af-a022-2234dd4baae1 None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:05.460854 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ea53e-07b4-46af-a022-2234dd4baae1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:05.462574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ea53e-07b4-46af-a022-2234dd4baae1 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:05.548315 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 17/35] 10.222.0.60 () {60 vars in 1131 bytes} [Fri May 6 23:19:05 2022] POST /identity/v3/roles => generated 225 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:19:05.556764 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184fdef-7e84-4fb4-ac40-8d6009b2e429 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:05.609392 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 19/36] 10.222.0.60 () {60 vars in 1141 bytes} [Fri May 6 23:19:05 2022] POST /identity/v3/projects => generated 301 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:19:05.611729 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91feac-b620-446d-b9ff-64d7c5923ae9 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:05.612231 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91feac-b620-446d-b9ff-64d7c5923ae9 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:05.612521 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91feac-b620-446d-b9ff-64d7c5923ae9 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:05.619659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 20/37] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:05.621931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91feac-b620-446d-b9ff-64d7c5923ae9 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:05.678993 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184fdef-7e84-4fb4-ac40-8d6009b2e429 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:05.720567 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64140fc-d3c4-4ad8-b5fd-294e742ed5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:05.721411 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64140fc-d3c4-4ad8-b5fd-294e742ed5fc None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:05.721854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64140fc-d3c4-4ad8-b5fd-294e742ed5fc None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:05.721956 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64140fc-d3c4-4ad8-b5fd-294e742ed5fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:05.723442 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64140fc-d3c4-4ad8-b5fd-294e742ed5fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:05.725175 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64140fc-d3c4-4ad8-b5fd-294e742ed5fc None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:05.731718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 18/38] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:19:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:05.731718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e2d41-d24e-4fa3-b131-21df6cde346a None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:05.731718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e2d41-d24e-4fa3-b131-21df6cde346a None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:05.731718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e2d41-d24e-4fa3-b131-21df6cde346a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:05.750617 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-f61e2d41-d24e-4fa3-b131-21df6cde346a None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:05.752527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f61e2d41-d24e-4fa3-b131-21df6cde346a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:05.780851 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91feac-b620-446d-b9ff-64d7c5923ae9 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:05.825552 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8cefa-764d-4f21-b810-4b4023fbfcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:05.825552 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8cefa-764d-4f21-b810-4b4023fbfcd4 None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:05.825552 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8cefa-764d-4f21-b810-4b4023fbfcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:05.825552 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8cefa-764d-4f21-b810-4b4023fbfcd4 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:05.825981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8cefa-764d-4f21-b810-4b4023fbfcd4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:05.827750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8cefa-764d-4f21-b810-4b4023fbfcd4 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:05.848592 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 19/39] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:05.848592 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e2d41-d24e-4fa3-b131-21df6cde346a None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:05.853426 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1131 bytes} [Fri May 6 23:19:05 2022] POST /identity/v3/roles => generated 219 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:19:05.854998 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b7dd2-409e-43b0-acc6-489e11cf568b None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:05.856050 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b7dd2-409e-43b0-acc6-489e11cf568b None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:05.856522 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b7dd2-409e-43b0-acc6-489e11cf568b None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:05.858136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 22/41] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:05.863833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ba231-4fb9-4706-aa1b-412398d25759 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:05.864405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ba231-4fb9-4706-aa1b-412398d25759 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:05.865016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ba231-4fb9-4706-aa1b-412398d25759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:05.895762 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-570ba231-4fb9-4706-aa1b-412398d25759 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:05.897755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-570ba231-4fb9-4706-aa1b-412398d25759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:05.999605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 23/42] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:06.001088 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ba231-4fb9-4706-aa1b-412398d25759 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:06.030817 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e2d41-d24e-4fa3-b131-21df6cde346a None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:06.068229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f1fd3-15a8-47cf-86b1-b21aacff397e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:06.069182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f1fd3-15a8-47cf-86b1-b21aacff397e None admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:06.069468 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f1fd3-15a8-47cf-86b1-b21aacff397e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:06.069746 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f1fd3-15a8-47cf-86b1-b21aacff397e None admin] PATH_INFO: `/v3/domains/default/users/76cc2bb71c0f410d8c0ab888335070a1/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:06.071761 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f1fd3-15a8-47cf-86b1-b21aacff397e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=76cc2bb71c0f410d8c0ab888335070a1, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:06.074043 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f1fd3-15a8-47cf-86b1-b21aacff397e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:06.088775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 20/43] 10.222.0.60 () {58 vars in 1361 bytes} [Fri May 6 23:19:05 2022] PUT /identity/v3/domains/default/users/76cc2bb71c0f410d8c0ab888335070a1/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:19:06.089738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f1fd3-15a8-47cf-86b1-b21aacff397e None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:06.139346 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ba231-4fb9-4706-aa1b-412398d25759 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:06.184741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11af853-4fcf-4187-959f-7a687207c793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:06.185803 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11af853-4fcf-4187-959f-7a687207c793 None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:06.185803 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11af853-4fcf-4187-959f-7a687207c793 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:06.185997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11af853-4fcf-4187-959f-7a687207c793 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:06.186791 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11af853-4fcf-4187-959f-7a687207c793 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:06.188244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11af853-4fcf-4187-959f-7a687207c793 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:06.211708 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f1fd3-15a8-47cf-86b1-b21aacff397e None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:06.213073 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 24/44] 10.222.0.60 () {60 vars in 1131 bytes} [Fri May 6 23:19:06 2022] POST /identity/v3/roles => generated 223 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:19:06.254008 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006b6b8-c492-4c9f-bb7d-432c7aae8f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:06.254739 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006b6b8-c492-4c9f-bb7d-432c7aae8f37 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:06.255023 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006b6b8-c492-4c9f-bb7d-432c7aae8f37 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:06.255342 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006b6b8-c492-4c9f-bb7d-432c7aae8f37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:06.256648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006b6b8-c492-4c9f-bb7d-432c7aae8f37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:06.258170 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006b6b8-c492-4c9f-bb7d-432c7aae8f37 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:06.260161 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 21/45] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:19:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:06.265911 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11af853-4fcf-4187-959f-7a687207c793 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:06.373646 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11af853-4fcf-4187-959f-7a687207c793 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:06.409320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda8eba-05f4-4042-88dc-5e7d311b7b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:06.409989 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda8eba-05f4-4042-88dc-5e7d311b7b4b None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:06.410275 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda8eba-05f4-4042-88dc-5e7d311b7b4b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:06.410548 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda8eba-05f4-4042-88dc-5e7d311b7b4b None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:06.411271 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda8eba-05f4-4042-88dc-5e7d311b7b4b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:06.413604 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda8eba-05f4-4042-88dc-5e7d311b7b4b None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:06.440096 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 25/46] 10.222.0.60 () {60 vars in 1141 bytes} [Fri May 6 23:19:06 2022] POST /identity/v3/projects => generated 312 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:19:08.352099 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2369a6d-80d1-47d1-bc68-be58a94484f9 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:08.352634 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2369a6d-80d1-47d1-bc68-be58a94484f9 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:08.352743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2369a6d-80d1-47d1-bc68-be58a94484f9 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:08.354057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 22/47] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:08.359384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f861c1-f637-4c3e-9fa1-02672a7aa48a None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:08.359790 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f861c1-f637-4c3e-9fa1-02672a7aa48a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:08.359933 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f861c1-f637-4c3e-9fa1-02672a7aa48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:08.380831 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-b0f861c1-f637-4c3e-9fa1-02672a7aa48a None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:08.382025 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b0f861c1-f637-4c3e-9fa1-02672a7aa48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:08.445208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 26/48] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:08.469706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2369a6d-80d1-47d1-bc68-be58a94484f9 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:08.568728 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2369a6d-80d1-47d1-bc68-be58a94484f9 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:08.600466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80d1be-b0d2-445a-88b3-285a06d2ed47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:08.601319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80d1be-b0d2-445a-88b3-285a06d2ed47 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:08.601605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80d1be-b0d2-445a-88b3-285a06d2ed47 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:08.601876 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80d1be-b0d2-445a-88b3-285a06d2ed47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:08.611983 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80d1be-b0d2-445a-88b3-285a06d2ed47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:08.619405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-0b80d1be-b0d2-445a-88b3-285a06d2ed47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:08.619405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:08.619405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:08.619405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:08.619405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:08.619405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:08.619405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:08.619405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:08.619405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:08.619405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:08.619405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:08.619405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:08.619405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:08.619405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:08.619405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:08.619405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:08.620357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:08.620357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:08.620357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:08.620357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:08.620357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:08.620357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:08.620357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:08.620357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:08.620357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:08.620357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:08.620357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:08.620357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:08.620357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:08.620357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:08.620357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:08.620357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:08.621158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:08.621158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:08.621158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:08.621158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:08.621158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:08.621158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:08.621158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:08.621158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:08.621158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:08.621158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:08.621158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:08.621158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:08.621158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 23/49] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:19:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:08.627661 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f861c1-f637-4c3e-9fa1-02672a7aa48a None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:08.656372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90114573-0d59-4258-a24d-864900d8ca44 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:08.656705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90114573-0d59-4258-a24d-864900d8ca44 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:08.657567 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90114573-0d59-4258-a24d-864900d8ca44 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:08.658937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 24/50] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:19:08.663728 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e5f2c-f3fa-466d-afb2-21df4a06a178 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:08.664017 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e5f2c-f3fa-466d-afb2-21df4a06a178 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:08.664299 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e5f2c-f3fa-466d-afb2-21df4a06a178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:08.680415 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-e35e5f2c-f3fa-466d-afb2-21df4a06a178 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:08.681632 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e35e5f2c-f3fa-466d-afb2-21df4a06a178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:08.721800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f861c1-f637-4c3e-9fa1-02672a7aa48a None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:08.743671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 25/51] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:19:08.753914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10500c85-6d4e-48a8-be0e-987683e30fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:08.754579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10500c85-6d4e-48a8-be0e-987683e30fc9 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:08.754863 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10500c85-6d4e-48a8-be0e-987683e30fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:08.755141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10500c85-6d4e-48a8-be0e-987683e30fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:08.755898 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10500c85-6d4e-48a8-be0e-987683e30fc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:08.756209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10500c85-6d4e-48a8-be0e-987683e30fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:08.757635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10500c85-6d4e-48a8-be0e-987683e30fc9 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:08.769941 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 27/52] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:08.770081 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e5f2c-f3fa-466d-afb2-21df4a06a178 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:08.770891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10500c85-6d4e-48a8-be0e-987683e30fc9 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:08.859600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e5f2c-f3fa-466d-afb2-21df4a06a178 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:08.864468 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10500c85-6d4e-48a8-be0e-987683e30fc9 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:08.891190 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a358b5f-a437-4750-a476-ff8ad607cdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:08.891972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a358b5f-a437-4750-a476-ff8ad607cdfb None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:08.892252 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a358b5f-a437-4750-a476-ff8ad607cdfb None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:08.892523 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a358b5f-a437-4750-a476-ff8ad607cdfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:08.893715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a358b5f-a437-4750-a476-ff8ad607cdfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:08.895169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a358b5f-a437-4750-a476-ff8ad607cdfb None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:08.896458 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1aa850-07a0-46de-a536-56e671fac25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:08.896813 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:19:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:08.897359 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1aa850-07a0-46de-a536-56e671fac25f None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:08.897643 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1aa850-07a0-46de-a536-56e671fac25f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:08.897912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1aa850-07a0-46de-a536-56e671fac25f None admin] PATH_INFO: `/v3/users/76cc2bb71c0f410d8c0ab888335070a1` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:08.899353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1aa850-07a0-46de-a536-56e671fac25f None admin] RBAC: Authorizing `identity:get_user(user_id=76cc2bb71c0f410d8c0ab888335070a1)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:08.900818 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1aa850-07a0-46de-a536-56e671fac25f None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:08.902302 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a358b5f-a437-4750-a476-ff8ad607cdfb None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:08.902485 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 28/54] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:08 2022] GET /identity/v3/users/76cc2bb71c0f410d8c0ab888335070a1 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:08.907601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1aa850-07a0-46de-a536-56e671fac25f None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:08.993621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a358b5f-a437-4750-a476-ff8ad607cdfb None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:08.999829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1aa850-07a0-46de-a536-56e671fac25f None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:09.025028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c06a4b-8eba-4523-be63-5399f430e124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:09.025673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c06a4b-8eba-4523-be63-5399f430e124 None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:09.025957 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c06a4b-8eba-4523-be63-5399f430e124 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:09.026230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c06a4b-8eba-4523-be63-5399f430e124 None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:09.026952 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c06a4b-8eba-4523-be63-5399f430e124 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:09.028378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c06a4b-8eba-4523-be63-5399f430e124 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:09.030458 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6e4df-42a3-4ac8-8076-70e16c7ea743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:09.031237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6e4df-42a3-4ac8-8076-70e16c7ea743 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:09.031518 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6e4df-42a3-4ac8-8076-70e16c7ea743 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:09.031821 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6e4df-42a3-4ac8-8076-70e16c7ea743 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:09.033015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6e4df-42a3-4ac8-8076-70e16c7ea743 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:09.034429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6e4df-42a3-4ac8-8076-70e16c7ea743 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:09.036245 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 29/55] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:19:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:09.041546 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6e4df-42a3-4ac8-8076-70e16c7ea743 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:09.054274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 27/56] 10.222.0.60 () {60 vars in 1140 bytes} [Fri May 6 23:19:08 2022] POST /identity/v3/projects => generated 298 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:19:09.143679 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6e4df-42a3-4ac8-8076-70e16c7ea743 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:09.177491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f96342-6711-4ad7-961c-cc673dab0215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:09.178205 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f96342-6711-4ad7-961c-cc673dab0215 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:09.178491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f96342-6711-4ad7-961c-cc673dab0215 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:09.178770 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f96342-6711-4ad7-961c-cc673dab0215 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:09.179623 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f96342-6711-4ad7-961c-cc673dab0215 None admin] RBAC: Adding query filter params (role.id=408ee9a3a38640a48dbcdb2c377efcd8, scope.domain.id=default, user.id=76cc2bb71c0f410d8c0ab888335070a1) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:09.179940 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f96342-6711-4ad7-961c-cc673dab0215 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:09.181452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f96342-6711-4ad7-961c-cc673dab0215 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:09.192017 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 30/57] 10.222.0.60 () {56 vars in 1322 bytes} [Fri May 6 23:19:09 2022] GET /identity/v3/role_assignments?user.id=76cc2bb71c0f410d8c0ab888335070a1&scope.domain.id=default&role.id=408ee9a3a38640a48dbcdb2c377efcd8 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:11.286143 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1849de8-6380-4d9f-83e4-45afd5a3b549 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:11.286630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1849de8-6380-4d9f-83e4-45afd5a3b549 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:11.286711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1849de8-6380-4d9f-83e4-45afd5a3b549 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:11.288053 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 28/58] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:11.293821 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1de3f4-ecb4-4f16-92eb-2e82a9f9db50 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:11.294219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1de3f4-ecb4-4f16-92eb-2e82a9f9db50 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:11.294374 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1de3f4-ecb4-4f16-92eb-2e82a9f9db50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:11.310875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-ad1de3f4-ecb4-4f16-92eb-2e82a9f9db50 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:11.312056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-ad1de3f4-ecb4-4f16-92eb-2e82a9f9db50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:11.374156 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 31/59] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:11.397483 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1849de8-6380-4d9f-83e4-45afd5a3b549 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:11.492295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1849de8-6380-4d9f-83e4-45afd5a3b549 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:11.523395 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dab40e-35c9-4c5a-8204-e9721d278da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:11.524157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dab40e-35c9-4c5a-8204-e9721d278da6 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:11.524437 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dab40e-35c9-4c5a-8204-e9721d278da6 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:11.524735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dab40e-35c9-4c5a-8204-e9721d278da6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:11.525888 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dab40e-35c9-4c5a-8204-e9721d278da6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:11.527854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dab40e-35c9-4c5a-8204-e9721d278da6 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:11.529451 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 29/60] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:19:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:11.534748 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1de3f4-ecb4-4f16-92eb-2e82a9f9db50 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:11.625663 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1de3f4-ecb4-4f16-92eb-2e82a9f9db50 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:11.656515 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ef996-57c2-4eb2-8902-8983432b7186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:11.657191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ef996-57c2-4eb2-8902-8983432b7186 None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:11.657471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ef996-57c2-4eb2-8902-8983432b7186 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:11.657744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ef996-57c2-4eb2-8902-8983432b7186 None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:11.658481 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ef996-57c2-4eb2-8902-8983432b7186 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:11.659913 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ef996-57c2-4eb2-8902-8983432b7186 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:11.684022 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 32/61] 10.222.0.60 () {60 vars in 1132 bytes} [Fri May 6 23:19:11 2022] POST /identity/v3/users => generated 275 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:19:15.014106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8e594-6a81-4fa9-9715-8e61313f0f61 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:15.014106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8e594-6a81-4fa9-9715-8e61313f0f61 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:15.014106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8e594-6a81-4fa9-9715-8e61313f0f61 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:15.014106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 30/62] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:15.019471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3373cc-7674-4ac2-afb8-92632dcf4d09 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:15.019845 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3373cc-7674-4ac2-afb8-92632dcf4d09 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:15.020029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3373cc-7674-4ac2-afb8-92632dcf4d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:15.044915 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-bf3373cc-7674-4ac2-afb8-92632dcf4d09 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:15.046108 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-bf3373cc-7674-4ac2-afb8-92632dcf4d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:15.135223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 33/63] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:15.156964 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c242dc3-674f-4ec9-bd13-560c9d7724af None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:15.157580 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c242dc3-674f-4ec9-bd13-560c9d7724af None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:15.158083 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c242dc3-674f-4ec9-bd13-560c9d7724af None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:15.159720 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 31/64] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:15.165221 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefe925-b356-4860-adde-db06eda363a2 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:15.165519 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefe925-b356-4860-adde-db06eda363a2 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:15.165801 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefe925-b356-4860-adde-db06eda363a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:15.167780 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c242dc3-674f-4ec9-bd13-560c9d7724af None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:15.193931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-eaefe925-b356-4860-adde-db06eda363a2 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:15.195138 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-eaefe925-b356-4860-adde-db06eda363a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:15.292245 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c242dc3-674f-4ec9-bd13-560c9d7724af None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:15.308501 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 34/65] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:19:15.335510 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefe925-b356-4860-adde-db06eda363a2 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:15.335945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ea286-10db-4a62-b2ef-881c1e08023b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:15.336790 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ea286-10db-4a62-b2ef-881c1e08023b None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:15.337075 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ea286-10db-4a62-b2ef-881c1e08023b None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:15.337350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ea286-10db-4a62-b2ef-881c1e08023b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:15.361933 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ea286-10db-4a62-b2ef-881c1e08023b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:15.369504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-ae6ea286-10db-4a62-b2ef-881c1e08023b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:15.369504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:15.369504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:15.369504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:15.369504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:15.369504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:15.369504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:15.369504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:15.369504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:15.369504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:15.369504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:15.369504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:15.369504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:15.369504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:15.369504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:15.369504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:15.370330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:15.370330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:15.370330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:15.370330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:15.370330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:15.370330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:15.370330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:15.370330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:15.370330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:15.370330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:15.370330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:15.370330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:15.370330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:15.370330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:15.370330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:15.370330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:15.371694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:15.371694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:15.371694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:15.371694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:15.371694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:15.371694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:15.371694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:15.371694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:15.371694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:15.371694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:15.371694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:15.371694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:15.372356 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 32/66] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:19:15.381503 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ea286-10db-4a62-b2ef-881c1e08023b None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:15.490718 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefe925-b356-4860-adde-db06eda363a2 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:15.517171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ea286-10db-4a62-b2ef-881c1e08023b None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:15.535327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b148d7-2e39-4497-bebb-00dbc29b682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:15.536422 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b148d7-2e39-4497-bebb-00dbc29b682a None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:15.536940 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b148d7-2e39-4497-bebb-00dbc29b682a None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:15.537404 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b148d7-2e39-4497-bebb-00dbc29b682a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:15.549136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b148d7-2e39-4497-bebb-00dbc29b682a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:15.552743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74060586-883a-4db6-98ce-a42fd8093d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:15.553409 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74060586-883a-4db6-98ce-a42fd8093d92 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:15.553692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74060586-883a-4db6-98ce-a42fd8093d92 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:15.553964 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74060586-883a-4db6-98ce-a42fd8093d92 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:15.554943 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74060586-883a-4db6-98ce-a42fd8093d92 None admin] RBAC: Adding query filter params (name=member) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:15.555251 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74060586-883a-4db6-98ce-a42fd8093d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:15.556662 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74060586-883a-4db6-98ce-a42fd8093d92 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:15.558979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-78b148d7-2e39-4497-bebb-00dbc29b682a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:15.558979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:15.558979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:15.558979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:15.558979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:15.558979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:15.558979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:15.558979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:15.558979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:15.558979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:15.558979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:15.558979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:15.558979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:15.558979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:15.558979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:15.558979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:15.559813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:15.559813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:15.559813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:15.559813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:15.559813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:15.559813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:15.559813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:15.559813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:15.559813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:15.559813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:15.559813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:15.559813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:15.559813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:15.559813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:15.559813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:15.559813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:15.560947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:15.560947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:15.560947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:15.560947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:15.560947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:15.560947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:15.560947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:15.560947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:15.560947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:15.560947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:15.560947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:15.560947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:15.563005 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 35/67] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:19:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:15.564485 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893103c-10fb-4f61-8bf8-15db325ae7b5 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:15.565005 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893103c-10fb-4f61-8bf8-15db325ae7b5 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:15.565105 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 33/68] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:15.565778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893103c-10fb-4f61-8bf8-15db325ae7b5 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:15.567257 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 36/69] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:15.568914 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74060586-883a-4db6-98ce-a42fd8093d92 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:15.570515 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893103c-10fb-4f61-8bf8-15db325ae7b5 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:15.697438 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893103c-10fb-4f61-8bf8-15db325ae7b5 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:15.704252 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74060586-883a-4db6-98ce-a42fd8093d92 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:15.737634 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fd68c-3d31-4ccd-8253-6d3e93c7f447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:15.738312 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fd68c-3d31-4ccd-8253-6d3e93c7f447 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:15.738613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fd68c-3d31-4ccd-8253-6d3e93c7f447 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:15.738874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fd68c-3d31-4ccd-8253-6d3e93c7f447 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:15.739615 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fd68c-3d31-4ccd-8253-6d3e93c7f447 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:15.739925 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fd68c-3d31-4ccd-8253-6d3e93c7f447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:15.741399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fd68c-3d31-4ccd-8253-6d3e93c7f447 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:15.742098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e26f3f-658e-4162-9832-9b12ca255e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:15.743656 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e26f3f-658e-4162-9832-9b12ca255e89 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:15.744133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e26f3f-658e-4162-9832-9b12ca255e89 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:15.744619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e26f3f-658e-4162-9832-9b12ca255e89 None admin] PATH_INFO: `/v3/users/7653c14067224481aa0bb76e61dcb69e` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:15.749459 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 34/70] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:15.750791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efa0c0-93b0-42fc-a1c9-b436c73be76b None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:15.751082 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efa0c0-93b0-42fc-a1c9-b436c73be76b None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:15.751360 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efa0c0-93b0-42fc-a1c9-b436c73be76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:15.764834 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e26f3f-658e-4162-9832-9b12ca255e89 None admin] RBAC: Authorizing `identity:get_user(user_id=7653c14067224481aa0bb76e61dcb69e)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:15.766654 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e26f3f-658e-4162-9832-9b12ca255e89 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:15.768458 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-99efa0c0-93b0-42fc-a1c9-b436c73be76b None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:15.768944 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 37/71] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:15 2022] GET /identity/v3/users/7653c14067224481aa0bb76e61dcb69e => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:15.769810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-99efa0c0-93b0-42fc-a1c9-b436c73be76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:15.770127 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e26f3f-658e-4162-9832-9b12ca255e89 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:15.839788 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 35/72] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:15.841578 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efa0c0-93b0-42fc-a1c9-b436c73be76b None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:15.882565 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e26f3f-658e-4162-9832-9b12ca255e89 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:15.914970 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de4cb3-ab78-4fa0-809f-585252fbdeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:15.915847 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de4cb3-ab78-4fa0-809f-585252fbdeca None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:15.916122 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de4cb3-ab78-4fa0-809f-585252fbdeca None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:15.916401 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de4cb3-ab78-4fa0-809f-585252fbdeca None admin] PATH_INFO: `/v3/users/76cc2bb71c0f410d8c0ab888335070a1` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:15.918172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de4cb3-ab78-4fa0-809f-585252fbdeca None admin] RBAC: Authorizing `identity:get_user(user_id=76cc2bb71c0f410d8c0ab888335070a1)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:15.919633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de4cb3-ab78-4fa0-809f-585252fbdeca None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:15.921309 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 38/73] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:15 2022] GET /identity/v3/users/76cc2bb71c0f410d8c0ab888335070a1 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:15.922620 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a5f75-3e54-4f4c-adad-9b19f087fd41 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:15.922905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a5f75-3e54-4f4c-adad-9b19f087fd41 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:15.923177 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a5f75-3e54-4f4c-adad-9b19f087fd41 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:15.924521 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 39/74] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:15.927685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab6c31-21f5-4f02-9654-c0217e94bc53 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:15.927976 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab6c31-21f5-4f02-9654-c0217e94bc53 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:15.928410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab6c31-21f5-4f02-9654-c0217e94bc53 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:15.930249 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 40/75] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:15.931062 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab6c31-21f5-4f02-9654-c0217e94bc53 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:15.943417 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efa0c0-93b0-42fc-a1c9-b436c73be76b None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:15.977178 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f55ce-2cf9-4667-88dc-54ef21307dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:15.977826 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f55ce-2cf9-4667-88dc-54ef21307dd5 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:15.978112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f55ce-2cf9-4667-88dc-54ef21307dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:15.978394 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f55ce-2cf9-4667-88dc-54ef21307dd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:16.031009 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab6c31-21f5-4f02-9654-c0217e94bc53 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:16.046497 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f55ce-2cf9-4667-88dc-54ef21307dd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:16.048081 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f55ce-2cf9-4667-88dc-54ef21307dd5 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:16.063799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52fa66-2225-4a9d-b879-8738c518dfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:16.064631 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52fa66-2225-4a9d-b879-8738c518dfff None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:16.064912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52fa66-2225-4a9d-b879-8738c518dfff None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:16.065181 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52fa66-2225-4a9d-b879-8738c518dfff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:16.075946 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52fa66-2225-4a9d-b879-8738c518dfff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:16.084139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-0f52fa66-2225-4a9d-b879-8738c518dfff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:19:16.084139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:16.084139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:16.084139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:16.084139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:16.084139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:16.084139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:16.084139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:16.084139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:16.084139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:16.084139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:16.084139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:16.084139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:16.084139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:16.084139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:16.084139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:16.085029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:16.085029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:16.085029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:16.085029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:16.085029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:16.085029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:16.085029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:16.085029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:16.085029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:16.085029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:16.085029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:16.085029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:16.085029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:16.085029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:16.085029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:16.085029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:16.085776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:16.085776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:16.085776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:16.085776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:16.085776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:16.085776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:16.085776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:16.085776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:16.085776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:16.085776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:16.085776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:19:16.085776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:16.085776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 41/76] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:19:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:16.086394 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52fa66-2225-4a9d-b879-8738c518dfff None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:16.149588 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 36/77] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:19:16.150885 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bf1c9-a086-40d6-8c0e-2425cf8c0630 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:16.151176 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bf1c9-a086-40d6-8c0e-2425cf8c0630 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:16.151458 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bf1c9-a086-40d6-8c0e-2425cf8c0630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:16.169750 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-039bf1c9-a086-40d6-8c0e-2425cf8c0630 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:16.171051 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-039bf1c9-a086-40d6-8c0e-2425cf8c0630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:16.184965 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52fa66-2225-4a9d-b879-8738c518dfff None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:16.216848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d0d95-42bb-4263-80a5-473b7875b7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:16.217496 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d0d95-42bb-4263-80a5-473b7875b7a1 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:16.217776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d0d95-42bb-4263-80a5-473b7875b7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:16.218051 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d0d95-42bb-4263-80a5-473b7875b7a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:16.240238 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 37/78] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:16.249437 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e5796-986d-42d8-9f8b-3903f91fa3ee None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:16.249437 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e5796-986d-42d8-9f8b-3903f91fa3ee None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:16.249437 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e5796-986d-42d8-9f8b-3903f91fa3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:16.258690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-6f1e5796-986d-42d8-9f8b-3903f91fa3ee None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:16.259870 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-6f1e5796-986d-42d8-9f8b-3903f91fa3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:16.290464 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d0d95-42bb-4263-80a5-473b7875b7a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:16.291877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d0d95-42bb-4263-80a5-473b7875b7a1 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:16.328071 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 38/79] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:16.328071 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e5796-986d-42d8-9f8b-3903f91fa3ee None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:16.395039 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 42/80] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:19:16.396876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d0d95-42bb-4263-80a5-473b7875b7a1 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:16.422846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e5796-986d-42d8-9f8b-3903f91fa3ee None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:16.455271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2aa78-e8d9-4ab3-998a-e466776378ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:16.455934 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2aa78-e8d9-4ab3-998a-e466776378ed None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:16.456214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2aa78-e8d9-4ab3-998a-e466776378ed None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:16.456567 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2aa78-e8d9-4ab3-998a-e466776378ed None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:16.457309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2aa78-e8d9-4ab3-998a-e466776378ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:16.457621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2aa78-e8d9-4ab3-998a-e466776378ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:16.459063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2aa78-e8d9-4ab3-998a-e466776378ed None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:16.467004 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 39/81] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:19:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:16.467787 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2aa78-e8d9-4ab3-998a-e466776378ed None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:16.489162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d0d95-42bb-4263-80a5-473b7875b7a1 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:16.521904 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294c1f5-d0cb-4ef7-9e16-8f49e6d4052e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:16.522756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294c1f5-d0cb-4ef7-9e16-8f49e6d4052e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:16.523037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294c1f5-d0cb-4ef7-9e16-8f49e6d4052e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:16.523311 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294c1f5-d0cb-4ef7-9e16-8f49e6d4052e None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:16.524485 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294c1f5-d0cb-4ef7-9e16-8f49e6d4052e None admin] RBAC: Authorizing `identity:get_project(project_id=0e884d4d1ec14a62a4ff4500b91183db)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:16.525948 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294c1f5-d0cb-4ef7-9e16-8f49e6d4052e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:16.527666 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 43/82] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:16 2022] GET /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db => generated 298 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:16.528423 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294c1f5-d0cb-4ef7-9e16-8f49e6d4052e None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:16.564553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2aa78-e8d9-4ab3-998a-e466776378ed None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:16.605926 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f7366-4bd8-476f-a1f0-ac52cf262458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:16.606723 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f7366-4bd8-476f-a1f0-ac52cf262458 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:16.607007 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f7366-4bd8-476f-a1f0-ac52cf262458 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:16.607285 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f7366-4bd8-476f-a1f0-ac52cf262458 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:16.608451 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f7366-4bd8-476f-a1f0-ac52cf262458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:16.609928 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f7366-4bd8-476f-a1f0-ac52cf262458 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:16.611714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 40/83] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:19:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:16.612302 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f7366-4bd8-476f-a1f0-ac52cf262458 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:16.626588 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294c1f5-d0cb-4ef7-9e16-8f49e6d4052e None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:16.659981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927480c-bfd8-4800-89ed-061130a23ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:16.660807 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927480c-bfd8-4800-89ed-061130a23ddb None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:16.661091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927480c-bfd8-4800-89ed-061130a23ddb None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:16.661365 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927480c-bfd8-4800-89ed-061130a23ddb None admin] PATH_INFO: `/v3/roles/member` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:16.671041 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927480c-bfd8-4800-89ed-061130a23ddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:16.679612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-3927480c-bfd8-4800-89ed-061130a23ddb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:16.679612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:16.679612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:16.679612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:16.679612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:16.679612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:16.679612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:16.679612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:16.679612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:16.679612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:16.679612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:16.679612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:16.679612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:16.679612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:16.679612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:16.679612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:16.680421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:16.680421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:16.680421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:16.680421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:16.680421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:16.680421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:16.680421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:16.680421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:16.680421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:16.680421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:16.680421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:16.680421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:16.680421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:16.680421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:16.680421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:16.680421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:16.681209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:16.681209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:16.681209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:16.681209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:16.681209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:16.681209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:16.681209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:16.681209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:16.681209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:16.681209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:16.681209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:16.681209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:16.681209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 44/84] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:16.682402 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927480c-bfd8-4800-89ed-061130a23ddb None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:16.709644 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f7366-4bd8-476f-a1f0-ac52cf262458 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:16.742108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687cee78-34c5-435c-8b44-ddb2b7443991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:16.742965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687cee78-34c5-435c-8b44-ddb2b7443991 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:16.743340 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687cee78-34c5-435c-8b44-ddb2b7443991 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:16.743616 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687cee78-34c5-435c-8b44-ddb2b7443991 None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:16.744836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687cee78-34c5-435c-8b44-ddb2b7443991 None admin] RBAC: Authorizing `identity:get_project(project_id=0e884d4d1ec14a62a4ff4500b91183db)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:16.746862 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687cee78-34c5-435c-8b44-ddb2b7443991 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:16.748547 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 41/85] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:16 2022] GET /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:16.749373 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687cee78-34c5-435c-8b44-ddb2b7443991 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:16.778564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927480c-bfd8-4800-89ed-061130a23ddb None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:16.812825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d8a9b-ffa0-4cd0-a23a-b5064263ddd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:16.813691 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d8a9b-ffa0-4cd0-a23a-b5064263ddd8 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:16.813970 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d8a9b-ffa0-4cd0-a23a-b5064263ddd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:16.814246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d8a9b-ffa0-4cd0-a23a-b5064263ddd8 None admin] PATH_INFO: `/v3/users/7653c14067224481aa0bb76e61dcb69e` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:16.815494 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d8a9b-ffa0-4cd0-a23a-b5064263ddd8 None admin] RBAC: Authorizing `identity:get_user(user_id=7653c14067224481aa0bb76e61dcb69e)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:16.817048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d8a9b-ffa0-4cd0-a23a-b5064263ddd8 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:16.818889 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 45/86] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:16 2022] GET /identity/v3/users/7653c14067224481aa0bb76e61dcb69e => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:16.819547 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d8a9b-ffa0-4cd0-a23a-b5064263ddd8 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:16.858383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687cee78-34c5-435c-8b44-ddb2b7443991 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:16.895097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c9c0f-22e8-4599-9023-9049ee198284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:16.895759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9c0f-22e8-4599-9023-9049ee198284 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:16.896048 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9c0f-22e8-4599-9023-9049ee198284 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:16.896329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9c0f-22e8-4599-9023-9049ee198284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:16.897221 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c9c0f-22e8-4599-9023-9049ee198284 None admin] RBAC: Adding query filter params (role.id=4bc18e5c60c043ae8d42db9c4e9cd438, scope.project.id=0e884d4d1ec14a62a4ff4500b91183db, user.id=7653c14067224481aa0bb76e61dcb69e) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:16.897539 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c9c0f-22e8-4599-9023-9049ee198284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:16.899020 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c9c0f-22e8-4599-9023-9049ee198284 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:16.904288 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 42/87] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:19:16 2022] GET /identity/v3/role_assignments?user.id=7653c14067224481aa0bb76e61dcb69e&scope.project.id=0e884d4d1ec14a62a4ff4500b91183db&role.id=4bc18e5c60c043ae8d42db9c4e9cd438 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:16.905092 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c9c0f-22e8-4599-9023-9049ee198284 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:16.933950 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d8a9b-ffa0-4cd0-a23a-b5064263ddd8 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:16.970832 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba1086-9e09-4daf-9961-da0e94636e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:16.971791 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba1086-9e09-4daf-9961-da0e94636e6d None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:16.972082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba1086-9e09-4daf-9961-da0e94636e6d None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:16.972365 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba1086-9e09-4daf-9961-da0e94636e6d None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:16.973149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba1086-9e09-4daf-9961-da0e94636e6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:16.974660 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba1086-9e09-4daf-9961-da0e94636e6d None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:16.996204 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 46/88] 10.222.0.60 () {60 vars in 1132 bytes} [Fri May 6 23:19:16 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:19:17.002015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba1086-9e09-4daf-9961-da0e94636e6d None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:17.014882 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c9c0f-22e8-4599-9023-9049ee198284 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:17.055703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a70e4a-a31a-4530-acae-1ac89c13b955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:17.056432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a70e4a-a31a-4530-acae-1ac89c13b955 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:17.056916 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a70e4a-a31a-4530-acae-1ac89c13b955 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:17.057276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a70e4a-a31a-4530-acae-1ac89c13b955 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:17.058248 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a70e4a-a31a-4530-acae-1ac89c13b955 None admin] RBAC: Adding query filter params (name=member) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:17.058646 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a70e4a-a31a-4530-acae-1ac89c13b955 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:17.060295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a70e4a-a31a-4530-acae-1ac89c13b955 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:17.070499 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 43/89] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:17.071481 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a70e4a-a31a-4530-acae-1ac89c13b955 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:17.130453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba1086-9e09-4daf-9961-da0e94636e6d None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:17.175575 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e8071-14e9-4b53-ba96-36983efe4009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:17.177219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e8071-14e9-4b53-ba96-36983efe4009 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:17.178014 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e8071-14e9-4b53-ba96-36983efe4009 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:17.178559 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e8071-14e9-4b53-ba96-36983efe4009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:17.179715 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e8071-14e9-4b53-ba96-36983efe4009 None admin] RBAC: Adding query filter params (role.id=408ee9a3a38640a48dbcdb2c377efcd8, scope.project.id=0e884d4d1ec14a62a4ff4500b91183db, user.id=76cc2bb71c0f410d8c0ab888335070a1) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:17.180237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e8071-14e9-4b53-ba96-36983efe4009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:17.181974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e8071-14e9-4b53-ba96-36983efe4009 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:17.187192 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a70e4a-a31a-4530-acae-1ac89c13b955 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:17.190213 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 47/90] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:19:16 2022] GET /identity/v3/role_assignments?user.id=76cc2bb71c0f410d8c0ab888335070a1&scope.project.id=0e884d4d1ec14a62a4ff4500b91183db&role.id=408ee9a3a38640a48dbcdb2c377efcd8 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:17.191541 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e8071-14e9-4b53-ba96-36983efe4009 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:17.241992 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7249081-dc47-4fcb-b70f-ae0bf3f0269e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:17.243082 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7249081-dc47-4fcb-b70f-ae0bf3f0269e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:17.243702 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7249081-dc47-4fcb-b70f-ae0bf3f0269e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:17.243941 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7249081-dc47-4fcb-b70f-ae0bf3f0269e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:17.327283 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e8071-14e9-4b53-ba96-36983efe4009 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:17.335477 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7249081-dc47-4fcb-b70f-ae0bf3f0269e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:17.337482 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7249081-dc47-4fcb-b70f-ae0bf3f0269e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:17.368858 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc067e35-9fb3-4ebe-8210-fdfe37b594c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:17.369920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc067e35-9fb3-4ebe-8210-fdfe37b594c6 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:17.370211 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc067e35-9fb3-4ebe-8210-fdfe37b594c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:17.370937 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc067e35-9fb3-4ebe-8210-fdfe37b594c6 None admin] PATH_INFO: `/v3/users/7653c14067224481aa0bb76e61dcb69e` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:17.372242 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc067e35-9fb3-4ebe-8210-fdfe37b594c6 None admin] RBAC: Authorizing `identity:get_user(user_id=7653c14067224481aa0bb76e61dcb69e)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:17.373973 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc067e35-9fb3-4ebe-8210-fdfe37b594c6 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:17.376046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 48/91] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:17 2022] GET /identity/v3/users/7653c14067224481aa0bb76e61dcb69e => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:17.383522 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc067e35-9fb3-4ebe-8210-fdfe37b594c6 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:17.469077 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 44/92] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:19:17.474976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7249081-dc47-4fcb-b70f-ae0bf3f0269e None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:17.538543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc067e35-9fb3-4ebe-8210-fdfe37b594c6 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:17.588062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7249081-dc47-4fcb-b70f-ae0bf3f0269e None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:17.594601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d1dec-9762-4ce1-9ec0-5b566314579f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:17.595576 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d1dec-9762-4ce1-9ec0-5b566314579f None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:17.596091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d1dec-9762-4ce1-9ec0-5b566314579f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:17.597059 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d1dec-9762-4ce1-9ec0-5b566314579f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:17.630555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840b2b8-e8d1-4b35-b2f9-e8a0864d4c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:17.631428 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840b2b8-e8d1-4b35-b2f9-e8a0864d4c0e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:17.631702 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840b2b8-e8d1-4b35-b2f9-e8a0864d4c0e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:17.631983 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840b2b8-e8d1-4b35-b2f9-e8a0864d4c0e None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:17.633230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840b2b8-e8d1-4b35-b2f9-e8a0864d4c0e None admin] RBAC: Authorizing `identity:get_project(project_id=0e884d4d1ec14a62a4ff4500b91183db)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:17.634702 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840b2b8-e8d1-4b35-b2f9-e8a0864d4c0e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:17.636583 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 45/93] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:17 2022] GET /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:17.642404 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840b2b8-e8d1-4b35-b2f9-e8a0864d4c0e None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:17.682554 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d1dec-9762-4ce1-9ec0-5b566314579f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:17.685941 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d1dec-9762-4ce1-9ec0-5b566314579f None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:17.800244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 49/94] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:19:17.807087 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d1dec-9762-4ce1-9ec0-5b566314579f None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:17.831486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840b2b8-e8d1-4b35-b2f9-e8a0864d4c0e None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:17.875674 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad48d9b-e43b-432f-b520-2450d5c6075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:17.876342 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad48d9b-e43b-432f-b520-2450d5c6075d None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:17.876651 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad48d9b-e43b-432f-b520-2450d5c6075d None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:17.876938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad48d9b-e43b-432f-b520-2450d5c6075d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:17.877794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad48d9b-e43b-432f-b520-2450d5c6075d None admin] RBAC: Adding query filter params (role.id=2cfb5ae0e4244117845519425cb9235e, scope.project.id=0e884d4d1ec14a62a4ff4500b91183db, user.id=7653c14067224481aa0bb76e61dcb69e) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:17.878098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad48d9b-e43b-432f-b520-2450d5c6075d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:17.879561 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad48d9b-e43b-432f-b520-2450d5c6075d None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:17.890434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 46/95] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:19:17 2022] GET /identity/v3/role_assignments?user.id=7653c14067224481aa0bb76e61dcb69e&scope.project.id=0e884d4d1ec14a62a4ff4500b91183db&role.id=2cfb5ae0e4244117845519425cb9235e => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:17.942183 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d1dec-9762-4ce1-9ec0-5b566314579f None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:17.984130 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc343e7-2ebc-4149-b11a-3310281b4956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:17.985392 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc343e7-2ebc-4149-b11a-3310281b4956 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:17.985947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc343e7-2ebc-4149-b11a-3310281b4956 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:17.986445 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc343e7-2ebc-4149-b11a-3310281b4956 None admin] PATH_INFO: `/v3/projects/ec12804eeabc449e9fec185b192176cd` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:17.991997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc343e7-2ebc-4149-b11a-3310281b4956 None admin] RBAC: Authorizing `identity:get_project(project_id=ec12804eeabc449e9fec185b192176cd)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:17.994140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc343e7-2ebc-4149-b11a-3310281b4956 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:17.996334 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 50/96] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:17 2022] GET /identity/v3/projects/ec12804eeabc449e9fec185b192176cd => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:18.002369 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad48d9b-e43b-432f-b520-2450d5c6075d None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:18.142905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad48d9b-e43b-432f-b520-2450d5c6075d None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:18.185695 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e726ee-de44-4115-9352-03a269a24b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:18.186394 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e726ee-de44-4115-9352-03a269a24b17 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:18.186683 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e726ee-de44-4115-9352-03a269a24b17 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:18.186968 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e726ee-de44-4115-9352-03a269a24b17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:18.187843 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e726ee-de44-4115-9352-03a269a24b17 None admin] RBAC: Adding query filter params (role.id=4bc18e5c60c043ae8d42db9c4e9cd438, scope.project.id=ec12804eeabc449e9fec185b192176cd, user.id=7653c14067224481aa0bb76e61dcb69e) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:18.188164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e726ee-de44-4115-9352-03a269a24b17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:18.189709 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e726ee-de44-4115-9352-03a269a24b17 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:18.201916 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 47/97] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:19:18 2022] GET /identity/v3/role_assignments?user.id=7653c14067224481aa0bb76e61dcb69e&scope.project.id=ec12804eeabc449e9fec185b192176cd&role.id=4bc18e5c60c043ae8d42db9c4e9cd438 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:19.508570 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028334e7-b8b3-4656-8c67-f4dd42c4cdb9 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:19.509080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028334e7-b8b3-4656-8c67-f4dd42c4cdb9 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:19.509153 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028334e7-b8b3-4656-8c67-f4dd42c4cdb9 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:19.510652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 51/98] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:19.518426 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66568a3-fb6d-4bbd-a182-2080b9ea23fb None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:19.518864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66568a3-fb6d-4bbd-a182-2080b9ea23fb None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:19.519041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66568a3-fb6d-4bbd-a182-2080b9ea23fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:19.541581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-b66568a3-fb6d-4bbd-a182-2080b9ea23fb None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:19.543329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-b66568a3-fb6d-4bbd-a182-2080b9ea23fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:19.631210 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 48/99] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:19.661822 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028334e7-b8b3-4656-8c67-f4dd42c4cdb9 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:19.774179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028334e7-b8b3-4656-8c67-f4dd42c4cdb9 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:19.816179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2183d1-01fe-4106-8417-7423fffa7772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:19.817017 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2183d1-01fe-4106-8417-7423fffa7772 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:19.817305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2183d1-01fe-4106-8417-7423fffa7772 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:19.817583 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2183d1-01fe-4106-8417-7423fffa7772 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:19.837730 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2183d1-01fe-4106-8417-7423fffa7772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:19.846219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-ff2183d1-01fe-4106-8417-7423fffa7772 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:19.846219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:19.846219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:19.846219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:19.846219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:19.846219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:19.846219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:19.846219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:19.846219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:19.846219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:19.846219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:19.846219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:19.846219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:19.846219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:19.846219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:19.846219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:19.847061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:19.847061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:19.847061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:19.847061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:19.847061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:19.847061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:19.847061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:19.847061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:19.847061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:19.847061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:19.847061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:19.847061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:19.847061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:19.847061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:19.847061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:19.847061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:19.847819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:19.847819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:19.847819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:19.847819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:19.847819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:19.847819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:19.847819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:19.847819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:19.847819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:19.847819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:19.847819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:19.847819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:19.847819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 52/100] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:19.853464 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66568a3-fb6d-4bbd-a182-2080b9ea23fb None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:19.961938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66568a3-fb6d-4bbd-a182-2080b9ea23fb None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:20.000043 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19d89e-4244-479a-b3c3-515574df6bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:20.000741 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19d89e-4244-479a-b3c3-515574df6bf8 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:20.001026 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19d89e-4244-479a-b3c3-515574df6bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:20.001303 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19d89e-4244-479a-b3c3-515574df6bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:20.002055 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19d89e-4244-479a-b3c3-515574df6bf8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:20.002361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19d89e-4244-479a-b3c3-515574df6bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:20.003761 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19d89e-4244-479a-b3c3-515574df6bf8 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:20.012428 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 49/101] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:20.018042 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2183d1-01fe-4106-8417-7423fffa7772 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:20.126504 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2183d1-01fe-4106-8417-7423fffa7772 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:20.163989 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885c608-7068-4296-b705-40b6eaa3e7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:20.164896 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885c608-7068-4296-b705-40b6eaa3e7ef None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:20.165181 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885c608-7068-4296-b705-40b6eaa3e7ef None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:20.165455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885c608-7068-4296-b705-40b6eaa3e7ef None admin] PATH_INFO: `/v3/users/7653c14067224481aa0bb76e61dcb69e` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:20.166766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885c608-7068-4296-b705-40b6eaa3e7ef None admin] RBAC: Authorizing `identity:get_user(user_id=7653c14067224481aa0bb76e61dcb69e)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:20.168790 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885c608-7068-4296-b705-40b6eaa3e7ef None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:20.170434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 53/102] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:20 2022] GET /identity/v3/users/7653c14067224481aa0bb76e61dcb69e => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:20.176407 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19d89e-4244-479a-b3c3-515574df6bf8 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:20.296455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19d89e-4244-479a-b3c3-515574df6bf8 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:20.340811 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf20228-2c85-45e7-9b60-d03ef00bcd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:20.341709 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf20228-2c85-45e7-9b60-d03ef00bcd5c None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:20.341992 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf20228-2c85-45e7-9b60-d03ef00bcd5c None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:20.342274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf20228-2c85-45e7-9b60-d03ef00bcd5c None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:20.343599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf20228-2c85-45e7-9b60-d03ef00bcd5c None admin] RBAC: Authorizing `identity:get_project(project_id=0e884d4d1ec14a62a4ff4500b91183db)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:20.345134 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf20228-2c85-45e7-9b60-d03ef00bcd5c None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:20.347306 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 50/103] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:20 2022] GET /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:20.352849 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885c608-7068-4296-b705-40b6eaa3e7ef None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:20.462611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885c608-7068-4296-b705-40b6eaa3e7ef None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:20.500016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4304d0d-c94b-4b0a-bf47-ee169a522788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:20.500940 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4304d0d-c94b-4b0a-bf47-ee169a522788 None admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:20.501224 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4304d0d-c94b-4b0a-bf47-ee169a522788 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:20.501493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4304d0d-c94b-4b0a-bf47-ee169a522788 None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db/users/7653c14067224481aa0bb76e61dcb69e/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:20.505825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4304d0d-c94b-4b0a-bf47-ee169a522788 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e884d4d1ec14a62a4ff4500b91183db, user_id=7653c14067224481aa0bb76e61dcb69e, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:20.507283 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4304d0d-c94b-4b0a-bf47-ee169a522788 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:20.539468 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 54/104] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:19:20 2022] PUT /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db/users/7653c14067224481aa0bb76e61dcb69e/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:19:20.694229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9c66b-0861-477b-8294-d00a779e9b96 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:20.694866 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9c66b-0861-477b-8294-d00a779e9b96 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:20.694866 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9c66b-0861-477b-8294-d00a779e9b96 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:20.696366 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 51/105] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:20.701938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f2c03-c3fa-4fc8-a8a3-bdc1ca9e5476 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:20.702258 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f2c03-c3fa-4fc8-a8a3-bdc1ca9e5476 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:20.702496 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f2c03-c3fa-4fc8-a8a3-bdc1ca9e5476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:20.730155 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-7d5f2c03-c3fa-4fc8-a8a3-bdc1ca9e5476 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:20.731300 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-7d5f2c03-c3fa-4fc8-a8a3-bdc1ca9e5476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:20.818391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 55/106] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:20.851200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9c66b-0861-477b-8294-d00a779e9b96 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:20.992807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9c66b-0861-477b-8294-d00a779e9b96 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:21.031675 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a87df-6876-47d3-8918-d1df1b04e088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:21.032481 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a87df-6876-47d3-8918-d1df1b04e088 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:21.032876 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a87df-6876-47d3-8918-d1df1b04e088 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:21.033163 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a87df-6876-47d3-8918-d1df1b04e088 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:21.044739 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a87df-6876-47d3-8918-d1df1b04e088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:21.052506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-db6a87df-6876-47d3-8918-d1df1b04e088 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:21.052506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:21.052506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:21.052506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:21.052506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:21.052506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:21.052506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:21.052506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:21.052506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:21.052506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:21.052506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:21.052506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:21.052506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:21.052506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:21.052506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:21.052506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:21.054486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:21.054486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:21.054486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:21.054486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:21.054486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:21.054486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:21.054486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:21.054486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:21.054486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:21.054486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:21.054486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:21.054486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:21.054486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:21.054486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:21.054486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:21.054486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:21.056414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:21.056414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:21.056414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:21.056414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:21.056414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:21.056414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:21.056414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:21.056414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:21.056414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:21.056414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:21.056414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:21.056414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:21.056414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 52/107] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:19:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:21.060900 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f2c03-c3fa-4fc8-a8a3-bdc1ca9e5476 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:21.132567 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be4e78-d4b0-40ee-9c70-799ee61b9952 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:21.132567 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be4e78-d4b0-40ee-9c70-799ee61b9952 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:21.132567 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be4e78-d4b0-40ee-9c70-799ee61b9952 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:21.132567 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 53/108] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:21.132567 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366527aa-eaa7-472c-8b17-e6c14e8a032e None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:21.133504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366527aa-eaa7-472c-8b17-e6c14e8a032e None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:21.134005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366527aa-eaa7-472c-8b17-e6c14e8a032e None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:21.135612 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 54/109] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:21.142583 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a2ccb-2ce6-42dd-b1a0-c312358fda9f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:21.143205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a2ccb-2ce6-42dd-b1a0-c312358fda9f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:21.143703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a2ccb-2ce6-42dd-b1a0-c312358fda9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:21.172188 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-d36a2ccb-2ce6-42dd-b1a0-c312358fda9f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:21.173774 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-d36a2ccb-2ce6-42dd-b1a0-c312358fda9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:21.197615 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f2c03-c3fa-4fc8-a8a3-bdc1ca9e5476 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:21.238444 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b7441-223a-494a-b91f-6fcd992519cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:21.239126 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b7441-223a-494a-b91f-6fcd992519cc None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:21.239412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b7441-223a-494a-b91f-6fcd992519cc None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:21.239688 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b7441-223a-494a-b91f-6fcd992519cc None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:21.240448 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b7441-223a-494a-b91f-6fcd992519cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:21.240781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b7441-223a-494a-b91f-6fcd992519cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:21.242192 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b7441-223a-494a-b91f-6fcd992519cc None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:21.251769 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 56/110] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:21.257481 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1956870-9c8a-425c-ba66-f5a4246f9df1 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:21.257938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1956870-9c8a-425c-ba66-f5a4246f9df1 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:21.258234 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1956870-9c8a-425c-ba66-f5a4246f9df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:21.290104 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-c1956870-9c8a-425c-ba66-f5a4246f9df1 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:21.291313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c1956870-9c8a-425c-ba66-f5a4246f9df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:21.323099 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 55/111] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:19:21.324406 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a2ccb-2ce6-42dd-b1a0-c312358fda9f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:21.368677 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 57/112] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:21.369993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af29b4-c1c2-4b0b-8d14-fdf09d9a0d89 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:21.370322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af29b4-c1c2-4b0b-8d14-fdf09d9a0d89 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:21.370605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af29b4-c1c2-4b0b-8d14-fdf09d9a0d89 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:21.372080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 58/113] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:21.372726 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af29b4-c1c2-4b0b-8d14-fdf09d9a0d89 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:21.440291 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a2ccb-2ce6-42dd-b1a0-c312358fda9f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:21.474646 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f973e9-b15e-4fdf-8067-ea3a39e760d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:21.475515 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f973e9-b15e-4fdf-8067-ea3a39e760d6 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:21.475800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f973e9-b15e-4fdf-8067-ea3a39e760d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:21.476075 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f973e9-b15e-4fdf-8067-ea3a39e760d6 None admin] PATH_INFO: `/v3/users/76cc2bb71c0f410d8c0ab888335070a1` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:21.477304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f973e9-b15e-4fdf-8067-ea3a39e760d6 None admin] RBAC: Authorizing `identity:get_user(user_id=76cc2bb71c0f410d8c0ab888335070a1)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:21.478817 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f973e9-b15e-4fdf-8067-ea3a39e760d6 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:21.480590 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 56/114] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:21 2022] GET /identity/v3/users/76cc2bb71c0f410d8c0ab888335070a1 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:21.481738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84077c-6a51-46ec-a5dc-1b40657d54fa None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:21.482023 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84077c-6a51-46ec-a5dc-1b40657d54fa None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:21.482299 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84077c-6a51-46ec-a5dc-1b40657d54fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:21.500883 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af29b4-c1c2-4b0b-8d14-fdf09d9a0d89 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:21.503719 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-aa84077c-6a51-46ec-a5dc-1b40657d54fa None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:21.504957 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-aa84077c-6a51-46ec-a5dc-1b40657d54fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:21.542773 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6d54-507c-4720-b17b-718b1931d088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:21.543574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6d54-507c-4720-b17b-718b1931d088 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:21.543912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6d54-507c-4720-b17b-718b1931d088 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:21.544194 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6d54-507c-4720-b17b-718b1931d088 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:21.545431 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e6d54-507c-4720-b17b-718b1931d088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:21.546968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e6d54-507c-4720-b17b-718b1931d088 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:21.549085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 59/115] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:19:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:21.549928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6d54-507c-4720-b17b-718b1931d088 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:21.583699 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 57/116] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:21.585530 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84077c-6a51-46ec-a5dc-1b40657d54fa None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:21.647647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6d54-507c-4720-b17b-718b1931d088 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:21.682096 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374a520-e2b5-4759-a849-4e62eb00b72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:21.683712 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374a520-e2b5-4759-a849-4e62eb00b72f None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:21.684000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374a520-e2b5-4759-a849-4e62eb00b72f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:21.684264 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374a520-e2b5-4759-a849-4e62eb00b72f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:21.694176 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374a520-e2b5-4759-a849-4e62eb00b72f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:21.694585 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84077c-6a51-46ec-a5dc-1b40657d54fa None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:21.702206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-5374a520-e2b5-4759-a849-4e62eb00b72f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:19:21.702206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:21.702206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:21.702206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:21.702206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:21.702206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:21.702206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:21.702206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:21.702206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:21.702206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:21.702206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:21.702206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:21.702206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:21.702206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:21.702206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:21.702206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:21.703080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:21.703080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:21.703080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:21.703080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:21.703080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:21.703080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:21.703080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:21.703080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:21.703080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:21.703080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:21.703080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:21.703080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:21.703080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:21.703080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:21.703080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:21.703080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:21.703827 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:21.703827 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:21.703827 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:21.703827 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:21.703827 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:21.703827 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:21.703827 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:21.703827 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:21.703827 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:21.703827 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:21.703827 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:19:21.703827 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:21.703827 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 60/117] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:19:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:21.704489 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374a520-e2b5-4759-a849-4e62eb00b72f None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:21.730213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910e341-0bf3-4a89-b915-d5fc4838f8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:21.731079 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910e341-0bf3-4a89-b915-d5fc4838f8c9 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:21.731362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910e341-0bf3-4a89-b915-d5fc4838f8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:21.731638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910e341-0bf3-4a89-b915-d5fc4838f8c9 None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:21.732848 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910e341-0bf3-4a89-b915-d5fc4838f8c9 None admin] RBAC: Authorizing `identity:get_project(project_id=0e884d4d1ec14a62a4ff4500b91183db)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:21.734322 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910e341-0bf3-4a89-b915-d5fc4838f8c9 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:21.740883 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 58/118] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:21 2022] GET /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:21.740883 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47a697-fcf4-4f6b-af97-40870253814f None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:21.740883 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47a697-fcf4-4f6b-af97-40870253814f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:21.740883 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47a697-fcf4-4f6b-af97-40870253814f None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:21.740883 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 59/119] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:21.740883 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47a697-fcf4-4f6b-af97-40870253814f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:21.816259 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374a520-e2b5-4759-a849-4e62eb00b72f None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:21.849068 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47a697-fcf4-4f6b-af97-40870253814f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:21.851341 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9bb10-b9cf-4ebd-8ba0-6721f8a2591b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:21.852109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9bb10-b9cf-4ebd-8ba0-6721f8a2591b None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:21.852466 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9bb10-b9cf-4ebd-8ba0-6721f8a2591b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:21.852773 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9bb10-b9cf-4ebd-8ba0-6721f8a2591b None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:21.853496 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9bb10-b9cf-4ebd-8ba0-6721f8a2591b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:21.855467 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9bb10-b9cf-4ebd-8ba0-6721f8a2591b None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:21.881266 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 61/120] 10.222.0.60 () {60 vars in 1141 bytes} [Fri May 6 23:19:21 2022] POST /identity/v3/projects => generated 302 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:19:21.882094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9bb10-b9cf-4ebd-8ba0-6721f8a2591b None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:21.889957 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407ec53-4708-40df-8200-fd228c8a29a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:21.891073 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407ec53-4708-40df-8200-fd228c8a29a4 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:21.891507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407ec53-4708-40df-8200-fd228c8a29a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:21.891926 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407ec53-4708-40df-8200-fd228c8a29a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:21.915645 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407ec53-4708-40df-8200-fd228c8a29a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:21.924441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-9407ec53-4708-40df-8200-fd228c8a29a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 06 23:19:21.924441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:21.924441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:21.924441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:21.924441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:21.924441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:21.924441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:21.924441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:21.924441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:21.924441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:21.924441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:21.924441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:21.924441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:21.924441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:21.924441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:21.924441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:21.925582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:21.925582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:21.925582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:21.925582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:21.925582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:21.925582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:21.925582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:21.925582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:21.925582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:21.925582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:21.925582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:21.925582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:21.925582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:21.925582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:21.925582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:21.925582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:21.926559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:21.926559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:21.926559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:21.926559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:21.926559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:21.926559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:21.926559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:21.926559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:21.926559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:21.926559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:21.926559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 06 23:19:21.926559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:21.928777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 60/121] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:21.929855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407ec53-4708-40df-8200-fd228c8a29a4 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:22.029474 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9bb10-b9cf-4ebd-8ba0-6721f8a2591b None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:22.049399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407ec53-4708-40df-8200-fd228c8a29a4 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:22.077251 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6539ba-77ad-4413-89b9-3c55db974f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:22.078229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6539ba-77ad-4413-89b9-3c55db974f39 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:22.078585 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6539ba-77ad-4413-89b9-3c55db974f39 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:22.078932 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6539ba-77ad-4413-89b9-3c55db974f39 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:22.079932 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6539ba-77ad-4413-89b9-3c55db974f39 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:22.080311 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6539ba-77ad-4413-89b9-3c55db974f39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:22.082093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6539ba-77ad-4413-89b9-3c55db974f39 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:22.094271 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 62/122] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:19:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:22.095697 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75a2b2-ed95-4848-b1a8-bfde40ae3f03 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:22.095999 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75a2b2-ed95-4848-b1a8-bfde40ae3f03 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:22.096280 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75a2b2-ed95-4848-b1a8-bfde40ae3f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:22.099854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc69441-d4b5-4577-b9d0-f0206cabd1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:22.100821 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc69441-d4b5-4577-b9d0-f0206cabd1b7 None admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:22.101102 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc69441-d4b5-4577-b9d0-f0206cabd1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:22.101377 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc69441-d4b5-4577-b9d0-f0206cabd1b7 None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db/users/76cc2bb71c0f410d8c0ab888335070a1/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:22.104386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc69441-d4b5-4577-b9d0-f0206cabd1b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e884d4d1ec14a62a4ff4500b91183db, user_id=76cc2bb71c0f410d8c0ab888335070a1, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:22.105919 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc69441-d4b5-4577-b9d0-f0206cabd1b7 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:22.115544 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-0a75a2b2-ed95-4848-b1a8-bfde40ae3f03 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:22.116912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-0a75a2b2-ed95-4848-b1a8-bfde40ae3f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:22.121706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 61/123] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:19:21 2022] PUT /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db/users/76cc2bb71c0f410d8c0ab888335070a1/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:19:22.123687 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc69441-d4b5-4577-b9d0-f0206cabd1b7 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:22.201685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 63/124] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:22.202576 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75a2b2-ed95-4848-b1a8-bfde40ae3f03 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:22.271789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc69441-d4b5-4577-b9d0-f0206cabd1b7 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:22.329439 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bb562-4883-44ba-9879-035a0adb381d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:22.330059 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb562-4883-44ba-9879-035a0adb381d None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:22.330349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb562-4883-44ba-9879-035a0adb381d None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:22.330630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb562-4883-44ba-9879-035a0adb381d None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:22.331406 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bb562-4883-44ba-9879-035a0adb381d None admin] RBAC: Adding query filter params (name=reader) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:22.331719 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bb562-4883-44ba-9879-035a0adb381d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:22.333221 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bb562-4883-44ba-9879-035a0adb381d None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:22.343757 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 62/125] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:22.344818 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bb562-4883-44ba-9879-035a0adb381d None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:22.366760 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75a2b2-ed95-4848-b1a8-bfde40ae3f03 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:22.410508 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaafa8-bcbd-41bc-b70b-2820b5466df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:22.412230 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaafa8-bcbd-41bc-b70b-2820b5466df9 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:22.412885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaafa8-bcbd-41bc-b70b-2820b5466df9 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:22.413168 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaafa8-bcbd-41bc-b70b-2820b5466df9 None admin] PATH_INFO: `/v3/users/7653c14067224481aa0bb76e61dcb69e` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:22.416619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaafa8-bcbd-41bc-b70b-2820b5466df9 None admin] RBAC: Authorizing `identity:get_user(user_id=7653c14067224481aa0bb76e61dcb69e)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:22.419234 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaafa8-bcbd-41bc-b70b-2820b5466df9 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:22.421671 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 64/126] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:22 2022] GET /identity/v3/users/7653c14067224481aa0bb76e61dcb69e => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:22.422445 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaafa8-bcbd-41bc-b70b-2820b5466df9 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:22.469976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bb562-4883-44ba-9879-035a0adb381d None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:22.510726 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cc523-8ef8-404a-aa2d-fd19c1fe3672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:22.512520 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cc523-8ef8-404a-aa2d-fd19c1fe3672 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:22.512830 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cc523-8ef8-404a-aa2d-fd19c1fe3672 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:22.513110 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cc523-8ef8-404a-aa2d-fd19c1fe3672 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:22.536591 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaafa8-bcbd-41bc-b70b-2820b5466df9 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:22.537866 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886cc523-8ef8-404a-aa2d-fd19c1fe3672 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:22.546234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-886cc523-8ef8-404a-aa2d-fd19c1fe3672 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:22.546234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:22.546234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:22.546234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:22.546234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:22.546234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:22.546234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:22.546234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:22.546234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:22.546234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:22.546234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:22.546234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:22.546234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:22.546234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:22.546234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:22.546234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:22.547069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:22.547069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:22.547069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:22.547069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:22.547069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:22.547069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:22.547069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:22.547069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:22.547069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:22.547069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:22.547069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:22.547069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:22.547069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:22.547069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:22.547069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:22.547069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:22.547845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:22.547845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:22.547845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:22.547845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:22.547845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:22.547845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:22.547845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:22.547845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:22.547845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:22.547845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:22.547845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:22.547845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:22.553026 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 63/127] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:22.553872 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cc523-8ef8-404a-aa2d-fd19c1fe3672 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:22.583096 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0c219-4e4d-4151-843c-d49fe5f2ed9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:22.583900 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0c219-4e4d-4151-843c-d49fe5f2ed9b None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:22.584565 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0c219-4e4d-4151-843c-d49fe5f2ed9b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:22.584565 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0c219-4e4d-4151-843c-d49fe5f2ed9b None admin] PATH_INFO: `/v3/users/e3a15610079349aa9e2bb258e0237060` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:22.610524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0c219-4e4d-4151-843c-d49fe5f2ed9b None admin] RBAC: Authorizing `identity:get_user(user_id=e3a15610079349aa9e2bb258e0237060)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:22.612009 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0c219-4e4d-4151-843c-d49fe5f2ed9b None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:22.622774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 65/128] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:22 2022] GET /identity/v3/users/e3a15610079349aa9e2bb258e0237060 => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:22.623567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0c219-4e4d-4151-843c-d49fe5f2ed9b None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:22.754146 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cc523-8ef8-404a-aa2d-fd19c1fe3672 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:22.770634 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0c219-4e4d-4151-843c-d49fe5f2ed9b None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:22.821570 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31045c-a330-44a2-ab55-86bb61a63b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:22.822437 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31045c-a330-44a2-ab55-86bb61a63b8f None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:22.822720 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31045c-a330-44a2-ab55-86bb61a63b8f None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:22.825842 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31045c-a330-44a2-ab55-86bb61a63b8f None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:22.829382 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31045c-a330-44a2-ab55-86bb61a63b8f None admin] RBAC: Authorizing `identity:get_project(project_id=0e884d4d1ec14a62a4ff4500b91183db)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:22.831120 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31045c-a330-44a2-ab55-86bb61a63b8f None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:22.833209 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 64/129] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:22 2022] GET /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:22.834371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31045c-a330-44a2-ab55-86bb61a63b8f None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:22.849581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e1256-c23a-4a5c-8a77-8d4c95e9e4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:22.849967 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e1256-c23a-4a5c-8a77-8d4c95e9e4d1 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:22.850258 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e1256-c23a-4a5c-8a77-8d4c95e9e4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:22.850547 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e1256-c23a-4a5c-8a77-8d4c95e9e4d1 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:22.851318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e1256-c23a-4a5c-8a77-8d4c95e9e4d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:22.851633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e1256-c23a-4a5c-8a77-8d4c95e9e4d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:22.853060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e1256-c23a-4a5c-8a77-8d4c95e9e4d1 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:22.875083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 66/130] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:22.875083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e1256-c23a-4a5c-8a77-8d4c95e9e4d1 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:22.949860 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31045c-a330-44a2-ab55-86bb61a63b8f None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:22.984861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abf62e-5570-4ced-9169-642df7e3b49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:22.985879 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abf62e-5570-4ced-9169-642df7e3b49d None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:22.986378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abf62e-5570-4ced-9169-642df7e3b49d None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:22.986869 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abf62e-5570-4ced-9169-642df7e3b49d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:23.013093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e1256-c23a-4a5c-8a77-8d4c95e9e4d1 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:23.056111 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abf62e-5570-4ced-9169-642df7e3b49d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:23.058546 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abf62e-5570-4ced-9169-642df7e3b49d None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:23.062821 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfda07f-bde5-46be-ba74-73d3fc370fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:23.063725 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfda07f-bde5-46be-ba74-73d3fc370fca None admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:23.064012 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfda07f-bde5-46be-ba74-73d3fc370fca None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:23.064288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfda07f-bde5-46be-ba74-73d3fc370fca None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db/users/7653c14067224481aa0bb76e61dcb69e/roles/2cfb5ae0e4244117845519425cb9235e` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:23.070427 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfda07f-bde5-46be-ba74-73d3fc370fca None admin] RBAC: Authorizing `identity:create_grant(project_id=0e884d4d1ec14a62a4ff4500b91183db, user_id=7653c14067224481aa0bb76e61dcb69e, role_id=2cfb5ae0e4244117845519425cb9235e)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:23.071888 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfda07f-bde5-46be-ba74-73d3fc370fca None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:23.102824 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 67/131] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:19:22 2022] PUT /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db/users/7653c14067224481aa0bb76e61dcb69e/roles/2cfb5ae0e4244117845519425cb9235e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:19:23.103781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfda07f-bde5-46be-ba74-73d3fc370fca None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:23.167658 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 65/132] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:19:23.173061 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abf62e-5570-4ced-9169-642df7e3b49d None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:23.294601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfda07f-bde5-46be-ba74-73d3fc370fca None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:23.363062 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449267b3-e0b2-44b6-9d84-baedace61db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:23.364446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449267b3-e0b2-44b6-9d84-baedace61db5 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:23.364961 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449267b3-e0b2-44b6-9d84-baedace61db5 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:23.365451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449267b3-e0b2-44b6-9d84-baedace61db5 None admin] PATH_INFO: `/v3/users/7653c14067224481aa0bb76e61dcb69e` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:23.366945 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449267b3-e0b2-44b6-9d84-baedace61db5 None admin] RBAC: Authorizing `identity:get_user(user_id=7653c14067224481aa0bb76e61dcb69e)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:23.368686 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449267b3-e0b2-44b6-9d84-baedace61db5 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:23.372791 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 68/133] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:23 2022] GET /identity/v3/users/7653c14067224481aa0bb76e61dcb69e => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:23.376269 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abf62e-5570-4ced-9169-642df7e3b49d None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:23.377705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449267b3-e0b2-44b6-9d84-baedace61db5 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:23.456137 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247f73-56e4-448a-adef-68e7b4247674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:23.458956 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247f73-56e4-448a-adef-68e7b4247674 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:23.459586 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247f73-56e4-448a-adef-68e7b4247674 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:23.460071 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247f73-56e4-448a-adef-68e7b4247674 None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:23.462786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f247f73-56e4-448a-adef-68e7b4247674 None admin] RBAC: Authorizing `identity:get_project(project_id=0e884d4d1ec14a62a4ff4500b91183db)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:23.466524 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f247f73-56e4-448a-adef-68e7b4247674 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:23.469495 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 66/134] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:23 2022] GET /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:23.475254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247f73-56e4-448a-adef-68e7b4247674 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:23.561656 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449267b3-e0b2-44b6-9d84-baedace61db5 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:23.634309 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b6a35-61a5-43b9-9c5f-e9ff1e3e3d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:23.636003 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b6a35-61a5-43b9-9c5f-e9ff1e3e3d21 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:23.639326 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b6a35-61a5-43b9-9c5f-e9ff1e3e3d21 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:23.639841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b6a35-61a5-43b9-9c5f-e9ff1e3e3d21 None admin] PATH_INFO: `/v3/projects/ec12804eeabc449e9fec185b192176cd` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:23.641390 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b6a35-61a5-43b9-9c5f-e9ff1e3e3d21 None admin] RBAC: Authorizing `identity:get_project(project_id=ec12804eeabc449e9fec185b192176cd)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:23.644079 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b6a35-61a5-43b9-9c5f-e9ff1e3e3d21 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:23.653344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 69/135] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:23 2022] GET /identity/v3/projects/ec12804eeabc449e9fec185b192176cd => generated 312 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:23.655621 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b6a35-61a5-43b9-9c5f-e9ff1e3e3d21 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:23.671427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247f73-56e4-448a-adef-68e7b4247674 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:23.738339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4b392-8c29-4a65-8a56-928928101c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:23.740153 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4b392-8c29-4a65-8a56-928928101c6b None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:23.740915 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4b392-8c29-4a65-8a56-928928101c6b None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:23.742220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4b392-8c29-4a65-8a56-928928101c6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:23.743272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4b392-8c29-4a65-8a56-928928101c6b None admin] RBAC: Adding query filter params (role.id=4258c5283ef14edba6c29f6e63fa1839, scope.project.id=0e884d4d1ec14a62a4ff4500b91183db, user.id=e3a15610079349aa9e2bb258e0237060) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:23.746220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4b392-8c29-4a65-8a56-928928101c6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:23.749872 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4b392-8c29-4a65-8a56-928928101c6b None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:23.763350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 67/136] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:19:23 2022] GET /identity/v3/role_assignments?user.id=e3a15610079349aa9e2bb258e0237060&scope.project.id=0e884d4d1ec14a62a4ff4500b91183db&role.id=4258c5283ef14edba6c29f6e63fa1839 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:23.774343 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42903540-d66d-425c-b593-b80377e58975 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:23.774948 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42903540-d66d-425c-b593-b80377e58975 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:23.775443 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42903540-d66d-425c-b593-b80377e58975 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:23.777631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 68/137] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:23.794633 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69903db0-aa81-49ab-bde5-dd87cb80a676 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:23.795266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69903db0-aa81-49ab-bde5-dd87cb80a676 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:23.795742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69903db0-aa81-49ab-bde5-dd87cb80a676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:23.829295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-69903db0-aa81-49ab-bde5-dd87cb80a676 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:23.830861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-69903db0-aa81-49ab-bde5-dd87cb80a676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:23.856850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b6a35-61a5-43b9-9c5f-e9ff1e3e3d21 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:23.935339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 69/138] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:19:23.953901 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f2e2a-315c-430e-8b36-765436eb57cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:23.955450 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f2e2a-315c-430e-8b36-765436eb57cd None admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:23.955984 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f2e2a-315c-430e-8b36-765436eb57cd None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:23.956466 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f2e2a-315c-430e-8b36-765436eb57cd None admin] PATH_INFO: `/v3/projects/ec12804eeabc449e9fec185b192176cd/users/7653c14067224481aa0bb76e61dcb69e/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:23.960781 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69903db0-aa81-49ab-bde5-dd87cb80a676 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:23.965499 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f2e2a-315c-430e-8b36-765436eb57cd None admin] RBAC: Authorizing `identity:create_grant(project_id=ec12804eeabc449e9fec185b192176cd, user_id=7653c14067224481aa0bb76e61dcb69e, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:23.967339 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f2e2a-315c-430e-8b36-765436eb57cd None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:24.003747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 70/139] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:19:23 2022] PUT /identity/v3/projects/ec12804eeabc449e9fec185b192176cd/users/7653c14067224481aa0bb76e61dcb69e/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:19:24.092968 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69903db0-aa81-49ab-bde5-dd87cb80a676 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:24.138918 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf5e78-2ed5-44f2-8952-909e940ba02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:24.139737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf5e78-2ed5-44f2-8952-909e940ba02c None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:24.140025 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf5e78-2ed5-44f2-8952-909e940ba02c None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:24.140300 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf5e78-2ed5-44f2-8952-909e940ba02c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:24.156906 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf5e78-2ed5-44f2-8952-909e940ba02c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:24.164782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-bfbf5e78-2ed5-44f2-8952-909e940ba02c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:24.164782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:24.164782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:24.164782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:24.164782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:24.164782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:24.164782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:24.164782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:24.164782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:24.164782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:24.164782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:24.164782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:24.164782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:24.164782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:24.164782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:24.164782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:24.165692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:24.165692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:24.165692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:24.165692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:24.165692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:24.165692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:24.165692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:24.165692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:24.165692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:24.165692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:24.165692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:24.165692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:24.165692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:24.165692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:24.165692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:24.165692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:24.166891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:24.166891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:24.166891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:24.166891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:24.166891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:24.166891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:24.166891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:24.166891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:24.166891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:24.166891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:24.166891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:24.166891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:24.166891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 70/140] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:19:24.172845 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f2e2a-315c-430e-8b36-765436eb57cd None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:24.322632 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f2e2a-315c-430e-8b36-765436eb57cd None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:24.369258 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69cf3d8-900c-4803-ae63-93ea11a2460e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:24.372206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cf3d8-900c-4803-ae63-93ea11a2460e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:24.372735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cf3d8-900c-4803-ae63-93ea11a2460e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:24.373232 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cf3d8-900c-4803-ae63-93ea11a2460e None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:24.374207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69cf3d8-900c-4803-ae63-93ea11a2460e None admin] RBAC: Adding query filter params (name=member) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:24.374714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69cf3d8-900c-4803-ae63-93ea11a2460e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:24.376338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69cf3d8-900c-4803-ae63-93ea11a2460e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:24.386059 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 71/141] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:24.391759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf5e78-2ed5-44f2-8952-909e940ba02c None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:24.530878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf5e78-2ed5-44f2-8952-909e940ba02c None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:24.566988 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16157d77-7205-4e3e-8c84-adc60c0e23ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:24.567873 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16157d77-7205-4e3e-8c84-adc60c0e23ae None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:24.568160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16157d77-7205-4e3e-8c84-adc60c0e23ae None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:24.568439 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16157d77-7205-4e3e-8c84-adc60c0e23ae None admin] PATH_INFO: `/v3/users/7653c14067224481aa0bb76e61dcb69e` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:24.569689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16157d77-7205-4e3e-8c84-adc60c0e23ae None admin] RBAC: Authorizing `identity:get_user(user_id=7653c14067224481aa0bb76e61dcb69e)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:24.571170 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16157d77-7205-4e3e-8c84-adc60c0e23ae None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:24.576695 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 71/142] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:24 2022] GET /identity/v3/users/7653c14067224481aa0bb76e61dcb69e => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:24.581639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69cf3d8-900c-4803-ae63-93ea11a2460e None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:24.695984 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69cf3d8-900c-4803-ae63-93ea11a2460e None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:24.740132 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12a9a6-0e8d-4b4e-a548-3f9093f879db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:24.740904 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12a9a6-0e8d-4b4e-a548-3f9093f879db None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:24.741200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12a9a6-0e8d-4b4e-a548-3f9093f879db None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:24.741488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12a9a6-0e8d-4b4e-a548-3f9093f879db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:24.809980 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12a9a6-0e8d-4b4e-a548-3f9093f879db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:24.811528 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12a9a6-0e8d-4b4e-a548-3f9093f879db None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:24.862615 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d39805-517a-46b2-88c0-031492d61c15 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:24.863430 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d39805-517a-46b2-88c0-031492d61c15 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:24.863888 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d39805-517a-46b2-88c0-031492d61c15 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:24.865513 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 72/143] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:19:24.870720 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546e59a-d53b-4bbc-b45b-cc3f433bb00b None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:24.871172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546e59a-d53b-4bbc-b45b-cc3f433bb00b None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:24.871588 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546e59a-d53b-4bbc-b45b-cc3f433bb00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:24.895507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-b546e59a-d53b-4bbc-b45b-cc3f433bb00b None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:24.897100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-b546e59a-d53b-4bbc-b45b-cc3f433bb00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:24.993233 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 72/144] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:19:25.007921 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12a9a6-0e8d-4b4e-a548-3f9093f879db None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:25.038159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 73/145] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:19:25.078709 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546e59a-d53b-4bbc-b45b-cc3f433bb00b None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:25.195414 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12a9a6-0e8d-4b4e-a548-3f9093f879db None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:25.248626 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25449e-5a57-47a1-8f7e-4492fcb50328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:25.250494 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25449e-5a57-47a1-8f7e-4492fcb50328 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:25.252624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25449e-5a57-47a1-8f7e-4492fcb50328 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:25.253079 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25449e-5a57-47a1-8f7e-4492fcb50328 None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:25.255531 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25449e-5a57-47a1-8f7e-4492fcb50328 None admin] RBAC: Authorizing `identity:get_project(project_id=0e884d4d1ec14a62a4ff4500b91183db)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:25.259133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25449e-5a57-47a1-8f7e-4492fcb50328 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:25.261802 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 73/146] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:25 2022] GET /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:25.263211 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834f557-6787-4629-b952-4b4aa69a7151 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:25.263657 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834f557-6787-4629-b952-4b4aa69a7151 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:25.264075 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834f557-6787-4629-b952-4b4aa69a7151 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:25.266073 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 74/147] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:25.273229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834f557-6787-4629-b952-4b4aa69a7151 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:25.282756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546e59a-d53b-4bbc-b45b-cc3f433bb00b None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:25.325788 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080f2cf-1e4b-41a2-838a-3078987c25f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:25.326583 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080f2cf-1e4b-41a2-838a-3078987c25f7 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:25.326864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080f2cf-1e4b-41a2-838a-3078987c25f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:25.327139 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080f2cf-1e4b-41a2-838a-3078987c25f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:25.328980 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080f2cf-1e4b-41a2-838a-3078987c25f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:25.330434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080f2cf-1e4b-41a2-838a-3078987c25f7 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:25.335264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 74/148] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:19:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:25.337824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c8012-5f2b-4804-9111-54e5cdea70c8 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:25.338108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c8012-5f2b-4804-9111-54e5cdea70c8 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:25.338639 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c8012-5f2b-4804-9111-54e5cdea70c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:25.373325 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-5e5c8012-5f2b-4804-9111-54e5cdea70c8 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:25.374496 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-5e5c8012-5f2b-4804-9111-54e5cdea70c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:25.444009 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834f557-6787-4629-b952-4b4aa69a7151 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:25.512327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b8840-5c46-4fa5-89f8-12a2806511f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:25.512939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b8840-5c46-4fa5-89f8-12a2806511f3 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:25.513224 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b8840-5c46-4fa5-89f8-12a2806511f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:25.513497 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b8840-5c46-4fa5-89f8-12a2806511f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:25.514337 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b8840-5c46-4fa5-89f8-12a2806511f3 None admin] RBAC: Adding query filter params (role.id=4bc18e5c60c043ae8d42db9c4e9cd438, scope.project.id=0e884d4d1ec14a62a4ff4500b91183db, user.id=7653c14067224481aa0bb76e61dcb69e) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:25.514653 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b8840-5c46-4fa5-89f8-12a2806511f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:25.516113 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b8840-5c46-4fa5-89f8-12a2806511f3 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:25.527502 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 75/149] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:25.528353 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c8012-5f2b-4804-9111-54e5cdea70c8 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:25.541171 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 75/150] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:19:25 2022] GET /identity/v3/role_assignments?user.id=7653c14067224481aa0bb76e61dcb69e&scope.project.id=0e884d4d1ec14a62a4ff4500b91183db&role.id=4bc18e5c60c043ae8d42db9c4e9cd438 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:25.574383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b8840-5c46-4fa5-89f8-12a2806511f3 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:25.774559 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b8840-5c46-4fa5-89f8-12a2806511f3 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:25.788097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c8012-5f2b-4804-9111-54e5cdea70c8 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:25.842574 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f02dc8-7d4c-44c3-a700-d5947cce71fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:25.843262 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f02dc8-7d4c-44c3-a700-d5947cce71fe None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:25.843547 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f02dc8-7d4c-44c3-a700-d5947cce71fe None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:25.844273 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f02dc8-7d4c-44c3-a700-d5947cce71fe None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:25.848555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f02dc8-7d4c-44c3-a700-d5947cce71fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:25.848555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f02dc8-7d4c-44c3-a700-d5947cce71fe None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:25.877168 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57c7b8-bd62-499d-aa09-665be5eb5d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:25.878158 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57c7b8-bd62-499d-aa09-665be5eb5d00 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:25.878531 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57c7b8-bd62-499d-aa09-665be5eb5d00 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:25.879046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57c7b8-bd62-499d-aa09-665be5eb5d00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:25.895595 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 76/151] 10.222.0.60 () {60 vars in 1132 bytes} [Fri May 6 23:19:25 2022] POST /identity/v3/users => generated 283 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:19:25.901767 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57c7b8-bd62-499d-aa09-665be5eb5d00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:25.909766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-8a57c7b8-bd62-499d-aa09-665be5eb5d00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:25.909766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:25.909766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:25.909766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:25.909766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:25.909766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:25.909766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:25.909766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:25.909766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:25.909766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:25.909766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:25.909766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:25.909766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:25.909766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:25.909766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:25.909766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:25.910887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:25.910887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:25.910887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:25.910887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:25.910887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:25.910887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:25.910887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:25.910887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:25.910887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:25.910887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:25.910887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:25.910887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:25.910887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:25.910887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:25.910887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:25.910887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:25.911740 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:25.911740 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:25.911740 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:25.911740 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:25.911740 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:25.911740 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:25.911740 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:25.911740 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:25.911740 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:25.911740 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:25.911740 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:25.911740 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:25.911740 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 76/152] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:19:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:19:25.918426 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f02dc8-7d4c-44c3-a700-d5947cce71fe None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:26.038727 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f02dc8-7d4c-44c3-a700-d5947cce71fe None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:26.080976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3528796-9ede-45ef-a983-cf471551fbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:26.082063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3528796-9ede-45ef-a983-cf471551fbcb None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:26.082565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3528796-9ede-45ef-a983-cf471551fbcb None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:26.083041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3528796-9ede-45ef-a983-cf471551fbcb None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:26.084020 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3528796-9ede-45ef-a983-cf471551fbcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:26.084585 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3528796-9ede-45ef-a983-cf471551fbcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:26.086296 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3528796-9ede-45ef-a983-cf471551fbcb None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:26.102713 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 77/153] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:26.109186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57c7b8-bd62-499d-aa09-665be5eb5d00 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:26.238719 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57c7b8-bd62-499d-aa09-665be5eb5d00 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:26.276819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c279b65-8d28-41fb-a40b-ada6ef9fac74 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:26.278386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbb15d-6c06-4eb7-9778-d78bb587803b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:26.279279 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbb15d-6c06-4eb7-9778-d78bb587803b None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:26.279564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbb15d-6c06-4eb7-9778-d78bb587803b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:26.279843 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbb15d-6c06-4eb7-9778-d78bb587803b None admin] PATH_INFO: `/v3/users/76cc2bb71c0f410d8c0ab888335070a1` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:26.281010 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c279b65-8d28-41fb-a40b-ada6ef9fac74 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:26.281117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cbb15d-6c06-4eb7-9778-d78bb587803b None admin] RBAC: Authorizing `identity:get_user(user_id=76cc2bb71c0f410d8c0ab888335070a1)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:26.281310 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c279b65-8d28-41fb-a40b-ada6ef9fac74 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:26.282550 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cbb15d-6c06-4eb7-9778-d78bb587803b None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:26.282708 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 78/154] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:19:26.284183 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 77/155] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:26 2022] GET /identity/v3/users/76cc2bb71c0f410d8c0ab888335070a1 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:26.288811 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834150d7-9100-45eb-8c67-4b49bf6445b2 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:26.289345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834150d7-9100-45eb-8c67-4b49bf6445b2 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:26.289627 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbb15d-6c06-4eb7-9778-d78bb587803b None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:26.290152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834150d7-9100-45eb-8c67-4b49bf6445b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:26.311765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-834150d7-9100-45eb-8c67-4b49bf6445b2 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:26.313329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-834150d7-9100-45eb-8c67-4b49bf6445b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:26.402080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 79/156] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:26.414133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbb15d-6c06-4eb7-9778-d78bb587803b None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:26.433949 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834150d7-9100-45eb-8c67-4b49bf6445b2 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:26.450638 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdac5a-fbef-41ce-a82a-ae1c5f56c0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:26.451391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdac5a-fbef-41ce-a82a-ae1c5f56c0f7 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:26.451586 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdac5a-fbef-41ce-a82a-ae1c5f56c0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:26.451849 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdac5a-fbef-41ce-a82a-ae1c5f56c0f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:26.534251 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdac5a-fbef-41ce-a82a-ae1c5f56c0f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:26.536509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdac5a-fbef-41ce-a82a-ae1c5f56c0f7 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:26.549579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834150d7-9100-45eb-8c67-4b49bf6445b2 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:26.592836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476246d-9db9-4f84-af36-61d7c8d1da62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:26.593729 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476246d-9db9-4f84-af36-61d7c8d1da62 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:26.594011 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476246d-9db9-4f84-af36-61d7c8d1da62 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:26.594342 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476246d-9db9-4f84-af36-61d7c8d1da62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:26.609603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476246d-9db9-4f84-af36-61d7c8d1da62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:26.620506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-b476246d-9db9-4f84-af36-61d7c8d1da62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:19:26.620506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:26.620506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:26.620506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:26.620506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:26.620506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:26.620506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:26.620506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:26.620506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:26.620506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:26.620506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:26.620506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:26.620506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:26.620506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:26.620506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:26.620506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:26.621434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:26.621434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:26.621434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:26.621434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:26.621434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:26.621434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:26.621434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:26.621434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:26.621434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:26.621434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:26.621434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:26.621434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:26.621434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:26.621434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:26.621434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:26.621434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:26.622195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:26.622195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:26.622195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:26.622195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:26.622195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:26.622195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:26.622195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:26.622195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:26.622195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:26.622195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:26.622195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:19:26.622195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:26.625371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 80/157] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:19:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:19:26.636645 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476246d-9db9-4f84-af36-61d7c8d1da62 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:26.669766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 78/158] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 06 23:19:26.676014 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdac5a-fbef-41ce-a82a-ae1c5f56c0f7 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:26.771455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476246d-9db9-4f84-af36-61d7c8d1da62 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:26.812770 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdac5a-fbef-41ce-a82a-ae1c5f56c0f7 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:26.817976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05eef3a-7d93-4bf7-adf3-c73c8d4e5349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:26.818842 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eef3a-7d93-4bf7-adf3-c73c8d4e5349 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:26.819293 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eef3a-7d93-4bf7-adf3-c73c8d4e5349 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:26.819712 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eef3a-7d93-4bf7-adf3-c73c8d4e5349 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:26.821367 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05eef3a-7d93-4bf7-adf3-c73c8d4e5349 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:26.821827 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05eef3a-7d93-4bf7-adf3-c73c8d4e5349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:26.823975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05eef3a-7d93-4bf7-adf3-c73c8d4e5349 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:26.834973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 81/159] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:19:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:26.837896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a878e5-831d-4f0b-a4fa-ce97f5586166 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:26.838604 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a878e5-831d-4f0b-a4fa-ce97f5586166 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:26.839563 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a878e5-831d-4f0b-a4fa-ce97f5586166 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:26.841934 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 82/160] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:26.852560 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c66855-49ee-4f32-953e-e0a1c7da8161 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:26.852560 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c66855-49ee-4f32-953e-e0a1c7da8161 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:26.852560 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c66855-49ee-4f32-953e-e0a1c7da8161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:26.863675 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83219a70-25d2-432b-9e1d-268b700b2ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:26.864549 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83219a70-25d2-432b-9e1d-268b700b2ab9 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:26.864836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83219a70-25d2-432b-9e1d-268b700b2ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:26.865103 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83219a70-25d2-432b-9e1d-268b700b2ab9 None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:26.866958 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83219a70-25d2-432b-9e1d-268b700b2ab9 None admin] RBAC: Authorizing `identity:get_project(project_id=0e884d4d1ec14a62a4ff4500b91183db)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:26.867194 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-e1c66855-49ee-4f32-953e-e0a1c7da8161 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:26.868337 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e1c66855-49ee-4f32-953e-e0a1c7da8161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:26.868435 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83219a70-25d2-432b-9e1d-268b700b2ab9 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:26.870251 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 79/161] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:26 2022] GET /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:26.871055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83219a70-25d2-432b-9e1d-268b700b2ab9 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:26.953257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 83/162] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:26.954279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c66855-49ee-4f32-953e-e0a1c7da8161 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:27.000415 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83219a70-25d2-432b-9e1d-268b700b2ab9 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:27.053136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37466189-3c53-4182-963f-8725d46a39f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:27.054837 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37466189-3c53-4182-963f-8725d46a39f7 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:27.055326 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37466189-3c53-4182-963f-8725d46a39f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:27.055798 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37466189-3c53-4182-963f-8725d46a39f7 None admin] PATH_INFO: `/v3/users/7653c14067224481aa0bb76e61dcb69e` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:27.057767 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37466189-3c53-4182-963f-8725d46a39f7 None admin] RBAC: Authorizing `identity:get_user(user_id=7653c14067224481aa0bb76e61dcb69e)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:27.059767 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37466189-3c53-4182-963f-8725d46a39f7 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:27.062222 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 80/163] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:26 2022] GET /identity/v3/users/7653c14067224481aa0bb76e61dcb69e => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:27.063566 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37466189-3c53-4182-963f-8725d46a39f7 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:27.077057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c66855-49ee-4f32-953e-e0a1c7da8161 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:27.121524 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623f54b-f27e-4ac5-b3f5-f469ae07f838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:27.122281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623f54b-f27e-4ac5-b3f5-f469ae07f838 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:27.122571 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623f54b-f27e-4ac5-b3f5-f469ae07f838 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:27.122848 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623f54b-f27e-4ac5-b3f5-f469ae07f838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:27.124694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623f54b-f27e-4ac5-b3f5-f469ae07f838 None admin] RBAC: Adding query filter params (role.id=408ee9a3a38640a48dbcdb2c377efcd8, scope.project.id=0e884d4d1ec14a62a4ff4500b91183db, user.id=76cc2bb71c0f410d8c0ab888335070a1) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:27.124898 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623f54b-f27e-4ac5-b3f5-f469ae07f838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:27.126336 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623f54b-f27e-4ac5-b3f5-f469ae07f838 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:27.133145 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 84/164] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:19:26 2022] GET /identity/v3/role_assignments?user.id=76cc2bb71c0f410d8c0ab888335070a1&scope.project.id=0e884d4d1ec14a62a4ff4500b91183db&role.id=408ee9a3a38640a48dbcdb2c377efcd8 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:27.134084 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623f54b-f27e-4ac5-b3f5-f469ae07f838 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:27.184262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37466189-3c53-4182-963f-8725d46a39f7 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:27.226171 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034858f7-a3b0-4159-af90-8a2e20e5e7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:27.226973 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034858f7-a3b0-4159-af90-8a2e20e5e7b3 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:27.227250 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034858f7-a3b0-4159-af90-8a2e20e5e7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:27.227521 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034858f7-a3b0-4159-af90-8a2e20e5e7b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:27.242489 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034858f7-a3b0-4159-af90-8a2e20e5e7b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:27.252486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-034858f7-a3b0-4159-af90-8a2e20e5e7b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 06 23:19:27.252486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:27.252486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:27.252486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:27.252486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:27.252486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:27.252486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:27.252486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:27.252486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:27.252486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:27.252486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:27.252486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:27.252486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:27.252486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:27.252486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:27.252486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:27.253437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:27.253437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:27.253437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:27.253437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:27.253437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:27.253437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:27.253437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:27.253437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:27.253437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:27.253437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:27.253437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:27.253437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:27.253437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:27.253437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:27.253437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:27.253437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:27.254378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:27.254378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:27.254378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:27.254378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:27.254378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:27.254378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:27.254378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:27.254378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:27.254378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:27.254378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:27.254378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 06 23:19:27.254378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:27.254378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 81/165] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:27.260004 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034858f7-a3b0-4159-af90-8a2e20e5e7b3 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:27.268766 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623f54b-f27e-4ac5-b3f5-f469ae07f838 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:27.314633 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91565eac-4f61-45ca-95d2-c47db2ca741d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:27.315672 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91565eac-4f61-45ca-95d2-c47db2ca741d None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:27.316422 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91565eac-4f61-45ca-95d2-c47db2ca741d None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:27.316936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91565eac-4f61-45ca-95d2-c47db2ca741d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:27.380414 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034858f7-a3b0-4159-af90-8a2e20e5e7b3 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:27.413252 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91565eac-4f61-45ca-95d2-c47db2ca741d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:27.415648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91565eac-4f61-45ca-95d2-c47db2ca741d None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:27.416125 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d542ee-2248-491c-81cb-0d752fd14085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:27.417160 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d542ee-2248-491c-81cb-0d752fd14085 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:27.417664 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d542ee-2248-491c-81cb-0d752fd14085 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:27.418138 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d542ee-2248-491c-81cb-0d752fd14085 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:27.419471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d542ee-2248-491c-81cb-0d752fd14085 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:27.420681 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d542ee-2248-491c-81cb-0d752fd14085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:27.421767 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d542ee-2248-491c-81cb-0d752fd14085 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:27.433226 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 82/166] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:27.437671 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d542ee-2248-491c-81cb-0d752fd14085 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:27.580842 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d542ee-2248-491c-81cb-0d752fd14085 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:27.601132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 85/167] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:19:27.607795 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91565eac-4f61-45ca-95d2-c47db2ca741d None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:27.644424 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb3952-a7d4-4e49-955a-105a258e7d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:27.645439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb3952-a7d4-4e49-955a-105a258e7d01 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:27.645726 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb3952-a7d4-4e49-955a-105a258e7d01 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:27.646002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb3952-a7d4-4e49-955a-105a258e7d01 None admin] PATH_INFO: `/v3/users/e3a15610079349aa9e2bb258e0237060` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:27.647317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb3952-a7d4-4e49-955a-105a258e7d01 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a15610079349aa9e2bb258e0237060)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:27.648823 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb3952-a7d4-4e49-955a-105a258e7d01 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:27.650487 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 83/168] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:27 2022] GET /identity/v3/users/e3a15610079349aa9e2bb258e0237060 => generated 289 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:27.659536 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb3952-a7d4-4e49-955a-105a258e7d01 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:27.783540 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91565eac-4f61-45ca-95d2-c47db2ca741d None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:27.837346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c046187-f80e-453f-a09b-a2e04e86ca6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:27.838135 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c046187-f80e-453f-a09b-a2e04e86ca6b None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:27.838674 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c046187-f80e-453f-a09b-a2e04e86ca6b None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:27.839513 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c046187-f80e-453f-a09b-a2e04e86ca6b None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:27.841667 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb3952-a7d4-4e49-955a-105a258e7d01 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:27.842401 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c046187-f80e-453f-a09b-a2e04e86ca6b None admin] RBAC: Authorizing `identity:get_project(project_id=0e884d4d1ec14a62a4ff4500b91183db)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:27.843910 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c046187-f80e-453f-a09b-a2e04e86ca6b None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:27.845944 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 86/169] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:27 2022] GET /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:27.848401 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe4427-c773-4ece-b2af-b25d2451cdcb None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:27.848717 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe4427-c773-4ece-b2af-b25d2451cdcb None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:27.848994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe4427-c773-4ece-b2af-b25d2451cdcb None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:27.850254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 87/170] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:27.857881 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe4427-c773-4ece-b2af-b25d2451cdcb None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:27.938320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e97975-58bb-4b78-a067-b3c24674efbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:27.939639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e97975-58bb-4b78-a067-b3c24674efbb None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:27.940131 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e97975-58bb-4b78-a067-b3c24674efbb None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:27.940627 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e97975-58bb-4b78-a067-b3c24674efbb None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:27.942045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e97975-58bb-4b78-a067-b3c24674efbb None admin] RBAC: Authorizing `identity:get_project(project_id=0e884d4d1ec14a62a4ff4500b91183db)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:27.944580 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e97975-58bb-4b78-a067-b3c24674efbb None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:27.951627 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 84/171] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:27 2022] GET /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:27.953775 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb648c6-3691-4c7f-a2de-caa3b6cdf544 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:27.955583 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb648c6-3691-4c7f-a2de-caa3b6cdf544 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:27.956712 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb648c6-3691-4c7f-a2de-caa3b6cdf544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:27.989807 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-feb648c6-3691-4c7f-a2de-caa3b6cdf544 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:27.993350 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-feb648c6-3691-4c7f-a2de-caa3b6cdf544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:28.013077 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe4427-c773-4ece-b2af-b25d2451cdcb None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:28.084549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c68a55-b159-49a3-80b4-4e00c74b4322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:28.085482 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c68a55-b159-49a3-80b4-4e00c74b4322 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:28.086807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c68a55-b159-49a3-80b4-4e00c74b4322 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:28.087506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c68a55-b159-49a3-80b4-4e00c74b4322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:28.091757 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c68a55-b159-49a3-80b4-4e00c74b4322 None admin] RBAC: Adding query filter params (role.id=2cfb5ae0e4244117845519425cb9235e, scope.project.id=0e884d4d1ec14a62a4ff4500b91183db, user.id=7653c14067224481aa0bb76e61dcb69e) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:28.093198 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c68a55-b159-49a3-80b4-4e00c74b4322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:28.094824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c68a55-b159-49a3-80b4-4e00c74b4322 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:28.108979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 88/172] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:19:27 2022] GET /identity/v3/role_assignments?user.id=7653c14067224481aa0bb76e61dcb69e&scope.project.id=0e884d4d1ec14a62a4ff4500b91183db&role.id=2cfb5ae0e4244117845519425cb9235e => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:28.111636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c68a55-b159-49a3-80b4-4e00c74b4322 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:28.127139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 85/173] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:28.237976 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb648c6-3691-4c7f-a2de-caa3b6cdf544 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:28.269959 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c68a55-b159-49a3-80b4-4e00c74b4322 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:28.354118 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523140f5-e72c-47b0-bf35-2e4164cae0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:28.354806 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523140f5-e72c-47b0-bf35-2e4164cae0eb None admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:28.355087 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523140f5-e72c-47b0-bf35-2e4164cae0eb None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:28.355361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523140f5-e72c-47b0-bf35-2e4164cae0eb None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db/users/e3a15610079349aa9e2bb258e0237060/roles/4258c5283ef14edba6c29f6e63fa1839` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:28.357877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb648c6-3691-4c7f-a2de-caa3b6cdf544 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:28.362084 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523140f5-e72c-47b0-bf35-2e4164cae0eb None admin] RBAC: Authorizing `identity:create_grant(project_id=0e884d4d1ec14a62a4ff4500b91183db, user_id=e3a15610079349aa9e2bb258e0237060, role_id=4258c5283ef14edba6c29f6e63fa1839)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:28.363602 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523140f5-e72c-47b0-bf35-2e4164cae0eb None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:28.394191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 89/174] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:19:28 2022] PUT /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db/users/e3a15610079349aa9e2bb258e0237060/roles/4258c5283ef14edba6c29f6e63fa1839 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:19:28.395501 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8130f7-1519-4cdc-ace5-c7c3e45ff4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:28.396584 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8130f7-1519-4cdc-ace5-c7c3e45ff4b1 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:28.397083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8130f7-1519-4cdc-ace5-c7c3e45ff4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:28.397553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8130f7-1519-4cdc-ace5-c7c3e45ff4b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:28.410299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8130f7-1519-4cdc-ace5-c7c3e45ff4b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:28.419323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-ef8130f7-1519-4cdc-ace5-c7c3e45ff4b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:28.419323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:28.419323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:28.419323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:28.419323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:28.419323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:28.419323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:28.419323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:28.419323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:28.419323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:28.419323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:28.419323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:28.419323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:28.419323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:28.419323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:28.419323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:28.420272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:28.420272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:28.420272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:28.420272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:28.420272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:28.420272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:28.420272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:28.420272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:28.420272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:28.420272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:28.420272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:28.420272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:28.420272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:28.420272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:28.420272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:28.420272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:28.421077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:28.421077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:28.421077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:28.421077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:28.421077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:28.421077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:28.421077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:28.421077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:28.421077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:28.421077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:28.421077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:28.421077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:28.423885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 86/175] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:19:28.429606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523140f5-e72c-47b0-bf35-2e4164cae0eb None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:28.554698 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523140f5-e72c-47b0-bf35-2e4164cae0eb None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:28.596456 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ecc5e-906c-4df7-ad79-19d4252d8a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:28.597179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ecc5e-906c-4df7-ad79-19d4252d8a2d None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:28.597462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ecc5e-906c-4df7-ad79-19d4252d8a2d None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:28.597739 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ecc5e-906c-4df7-ad79-19d4252d8a2d None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:28.598508 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ecc5e-906c-4df7-ad79-19d4252d8a2d None admin] RBAC: Adding query filter params (name=member) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:28.598817 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ecc5e-906c-4df7-ad79-19d4252d8a2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:28.600237 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ecc5e-906c-4df7-ad79-19d4252d8a2d None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:28.613383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 90/176] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:28.619103 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8130f7-1519-4cdc-ace5-c7c3e45ff4b1 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:28.742878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8130f7-1519-4cdc-ace5-c7c3e45ff4b1 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:28.779714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a9747-5a57-48a7-a4ec-d5290ae1f21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:28.781021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a9747-5a57-48a7-a4ec-d5290ae1f21f None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:28.781496 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a9747-5a57-48a7-a4ec-d5290ae1f21f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:28.781955 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a9747-5a57-48a7-a4ec-d5290ae1f21f None admin] PATH_INFO: `/v3/users/7653c14067224481aa0bb76e61dcb69e` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:28.783451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a9747-5a57-48a7-a4ec-d5290ae1f21f None admin] RBAC: Authorizing `identity:get_user(user_id=7653c14067224481aa0bb76e61dcb69e)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:28.785114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a9747-5a57-48a7-a4ec-d5290ae1f21f None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:28.787332 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 87/177] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:28 2022] GET /identity/v3/users/7653c14067224481aa0bb76e61dcb69e => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:28.792830 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ecc5e-906c-4df7-ad79-19d4252d8a2d None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:28.918406 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ecc5e-906c-4df7-ad79-19d4252d8a2d None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:28.958225 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ae160-7fca-4e13-8d80-8dcdf5151a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:28.958932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ae160-7fca-4e13-8d80-8dcdf5151a2c None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:28.959213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ae160-7fca-4e13-8d80-8dcdf5151a2c None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:28.959485 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ae160-7fca-4e13-8d80-8dcdf5151a2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:29.036897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ae160-7fca-4e13-8d80-8dcdf5151a2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:29.038422 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ae160-7fca-4e13-8d80-8dcdf5151a2c None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:29.161055 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 91/178] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 06 23:19:29.166678 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a9747-5a57-48a7-a4ec-d5290ae1f21f None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:29.360200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a9747-5a57-48a7-a4ec-d5290ae1f21f None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:29.404155 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f313f-81b5-4ccb-91e5-3cf5bc42ba27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:29.405065 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f313f-81b5-4ccb-91e5-3cf5bc42ba27 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:29.405347 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f313f-81b5-4ccb-91e5-3cf5bc42ba27 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:29.405624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f313f-81b5-4ccb-91e5-3cf5bc42ba27 None admin] PATH_INFO: `/v3/projects/ec12804eeabc449e9fec185b192176cd` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:29.406830 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f313f-81b5-4ccb-91e5-3cf5bc42ba27 None admin] RBAC: Authorizing `identity:get_project(project_id=ec12804eeabc449e9fec185b192176cd)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:29.408306 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f313f-81b5-4ccb-91e5-3cf5bc42ba27 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:29.410359 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 88/179] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:29 2022] GET /identity/v3/projects/ec12804eeabc449e9fec185b192176cd => generated 312 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:29.418178 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ae160-7fca-4e13-8d80-8dcdf5151a2c None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:29.502720 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c9d10-7c78-48f0-bc96-4eaff01b4dc7 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:29.503037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c9d10-7c78-48f0-bc96-4eaff01b4dc7 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:29.503278 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c9d10-7c78-48f0-bc96-4eaff01b4dc7 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:29.504932 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 89/180] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:19:29.509742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985801fd-cd9d-40dd-a08e-8f137676d60b None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:29.510032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985801fd-cd9d-40dd-a08e-8f137676d60b None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:29.510309 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985801fd-cd9d-40dd-a08e-8f137676d60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:29.530248 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-985801fd-cd9d-40dd-a08e-8f137676d60b None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:29.531440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-985801fd-cd9d-40dd-a08e-8f137676d60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:29.596395 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ae160-7fca-4e13-8d80-8dcdf5151a2c None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:29.600484 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 90/181] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:19:29.623819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985801fd-cd9d-40dd-a08e-8f137676d60b None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:29.643409 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cccd8-cc1e-42e3-a1a4-9156493f0013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:29.644407 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cccd8-cc1e-42e3-a1a4-9156493f0013 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:29.644914 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cccd8-cc1e-42e3-a1a4-9156493f0013 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:29.645388 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cccd8-cc1e-42e3-a1a4-9156493f0013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:29.646422 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cccd8-cc1e-42e3-a1a4-9156493f0013 None admin] RBAC: Adding query filter params (role.id=4bc18e5c60c043ae8d42db9c4e9cd438, scope.project.id=ec12804eeabc449e9fec185b192176cd, user.id=7653c14067224481aa0bb76e61dcb69e) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:29.648180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cccd8-cc1e-42e3-a1a4-9156493f0013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:29.649890 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cccd8-cc1e-42e3-a1a4-9156493f0013 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:29.660647 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 92/182] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:19:29 2022] GET /identity/v3/role_assignments?user.id=7653c14067224481aa0bb76e61dcb69e&scope.project.id=ec12804eeabc449e9fec185b192176cd&role.id=4bc18e5c60c043ae8d42db9c4e9cd438 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:29.793666 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985801fd-cd9d-40dd-a08e-8f137676d60b None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:29.831496 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28de61-7de1-4627-a765-c77db16489d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:29.832311 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28de61-7de1-4627-a765-c77db16489d5 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:29.832615 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28de61-7de1-4627-a765-c77db16489d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:29.832889 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28de61-7de1-4627-a765-c77db16489d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:29.846978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28de61-7de1-4627-a765-c77db16489d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:29.855057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-8a28de61-7de1-4627-a765-c77db16489d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:29.855057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:29.855057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:29.855057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:29.855057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:29.855057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:29.855057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:29.855057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:29.855057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:29.855057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:29.855057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:29.855057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:29.855057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:29.855057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:29.855057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:29.855057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:29.855997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:29.855997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:29.855997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:29.855997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:29.855997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:29.855997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:29.855997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:29.855997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:29.855997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:29.855997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:29.855997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:29.855997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:29.855997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:29.855997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:29.855997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:29.855997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:29.857091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:29.857091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:29.857091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:29.857091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:29.857091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:29.857091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:29.857091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:29.857091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:29.857091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:29.857091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:29.857091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:29.857091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:29.857091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 91/183] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:19:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:29.864390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cccd8-cc1e-42e3-a1a4-9156493f0013 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:30.008185 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cccd8-cc1e-42e3-a1a4-9156493f0013 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:30.050375 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d83fb3-dd21-4874-ae89-9bb044373bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:30.051123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d83fb3-dd21-4874-ae89-9bb044373bb6 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:30.051323 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d83fb3-dd21-4874-ae89-9bb044373bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:30.051591 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d83fb3-dd21-4874-ae89-9bb044373bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:30.052345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d83fb3-dd21-4874-ae89-9bb044373bb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:30.052676 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d83fb3-dd21-4874-ae89-9bb044373bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:30.054071 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d83fb3-dd21-4874-ae89-9bb044373bb6 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:30.056629 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092a9f2-abc2-4035-b43f-5533ff3db706 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:30.056914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092a9f2-abc2-4035-b43f-5533ff3db706 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:30.057185 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092a9f2-abc2-4035-b43f-5533ff3db706 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:30.058891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 92/184] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:30.064737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 93/185] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:30.069935 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d70db-5f99-4544-924e-d6745289c190 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:30.070217 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d70db-5f99-4544-924e-d6745289c190 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:30.070400 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d83fb3-dd21-4874-ae89-9bb044373bb6 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:30.070498 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d70db-5f99-4544-924e-d6745289c190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:30.089125 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-1b8d70db-5f99-4544-924e-d6745289c190 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:30.090334 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-1b8d70db-5f99-4544-924e-d6745289c190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:30.157130 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 93/186] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:30.166109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d83887-fbfc-4c20-842a-bb83e4507496 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:30.166424 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d83887-fbfc-4c20-842a-bb83e4507496 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:30.166682 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d83887-fbfc-4c20-842a-bb83e4507496 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:30.168770 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 94/187] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:30 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:30.175018 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b8176-fdce-4ee1-b892-20f66b41d024 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:30.175320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b8176-fdce-4ee1-b892-20f66b41d024 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:30.175582 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b8176-fdce-4ee1-b892-20f66b41d024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:30.181065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d83fb3-dd21-4874-ae89-9bb044373bb6 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:30.192374 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-2e4b8176-fdce-4ee1-b892-20f66b41d024 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:30.193594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-2e4b8176-fdce-4ee1-b892-20f66b41d024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:30.216402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010be0e-b008-44c2-8825-8a8fa31378d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:30.217566 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010be0e-b008-44c2-8825-8a8fa31378d6 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:30.218266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010be0e-b008-44c2-8825-8a8fa31378d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:30.218725 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010be0e-b008-44c2-8825-8a8fa31378d6 None admin] PATH_INFO: `/v3/users/78d21464f78c41fdb76ec23daf7d77e5` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:30.233170 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6010be0e-b008-44c2-8825-8a8fa31378d6 None admin] RBAC: Authorizing `identity:get_user(user_id=78d21464f78c41fdb76ec23daf7d77e5)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:30.234871 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6010be0e-b008-44c2-8825-8a8fa31378d6 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:30.236795 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 94/188] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:30 2022] GET /identity/v3/users/78d21464f78c41fdb76ec23daf7d77e5 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:30.237700 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010be0e-b008-44c2-8825-8a8fa31378d6 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:30.280562 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 95/189] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:30.280562 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b8176-fdce-4ee1-b892-20f66b41d024 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:30.352530 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010be0e-b008-44c2-8825-8a8fa31378d6 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:30.382773 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b8176-fdce-4ee1-b892-20f66b41d024 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:30.385995 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cb9a1-2c3c-4466-8145-90e978d0e318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:30.386788 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cb9a1-2c3c-4466-8145-90e978d0e318 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:30.387070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cb9a1-2c3c-4466-8145-90e978d0e318 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:30.387344 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cb9a1-2c3c-4466-8145-90e978d0e318 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:30.388517 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cb9a1-2c3c-4466-8145-90e978d0e318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:30.389995 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cb9a1-2c3c-4466-8145-90e978d0e318 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:30.391628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 95/190] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:19:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:30.393410 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cb9a1-2c3c-4466-8145-90e978d0e318 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:30.418972 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ad0f0-e0ca-4d1d-914d-45699b1192d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:30.419916 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ad0f0-e0ca-4d1d-914d-45699b1192d3 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:30.420198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ad0f0-e0ca-4d1d-914d-45699b1192d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:30.420476 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ad0f0-e0ca-4d1d-914d-45699b1192d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:30.486849 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ad0f0-e0ca-4d1d-914d-45699b1192d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:30.488334 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ad0f0-e0ca-4d1d-914d-45699b1192d3 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:30.492714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cb9a1-2c3c-4466-8145-90e978d0e318 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:30.531801 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810172d1-c213-49d6-9d00-fb3869d66ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:30.532548 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810172d1-c213-49d6-9d00-fb3869d66ef2 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:30.532838 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810172d1-c213-49d6-9d00-fb3869d66ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:30.533115 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810172d1-c213-49d6-9d00-fb3869d66ef2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:30.542771 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810172d1-c213-49d6-9d00-fb3869d66ef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:30.550689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-810172d1-c213-49d6-9d00-fb3869d66ef2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:19:30.550689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:30.550689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:30.550689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:30.550689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:30.550689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:30.550689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:30.550689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:30.550689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:30.550689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:30.550689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:30.550689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:30.550689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:30.550689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:30.550689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:30.550689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:30.551550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:30.551550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:30.551550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:30.551550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:30.551550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:30.551550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:30.551550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:30.551550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:30.551550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:30.551550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:30.551550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:30.551550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:30.551550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:30.551550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:30.551550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:30.551550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:30.552339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:30.552339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:30.552339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:30.552339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:30.552339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:30.552339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:30.552339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:30.552339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:30.552339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:30.552339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:30.552339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:19:30.552339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:30.552339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 96/191] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:19:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:30.553590 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810172d1-c213-49d6-9d00-fb3869d66ef2 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:30.595038 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 96/192] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:19:30.595038 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ad0f0-e0ca-4d1d-914d-45699b1192d3 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:30.657083 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810172d1-c213-49d6-9d00-fb3869d66ef2 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:30.689259 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ad0f0-e0ca-4d1d-914d-45699b1192d3 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:30.694998 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdca5c-cb91-43d3-8570-3aecbab2083c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:30.695890 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdca5c-cb91-43d3-8570-3aecbab2083c None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:30.696325 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdca5c-cb91-43d3-8570-3aecbab2083c None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:30.696790 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdca5c-cb91-43d3-8570-3aecbab2083c None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:30.697501 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdca5c-cb91-43d3-8570-3aecbab2083c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:30.699491 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdca5c-cb91-43d3-8570-3aecbab2083c None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:30.721409 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 97/193] 10.222.0.60 () {60 vars in 1132 bytes} [Fri May 6 23:19:30 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:19:30.722219 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdca5c-cb91-43d3-8570-3aecbab2083c None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:30.726847 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3bd50-358d-4e7b-b32e-23b42cf88651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:30.727868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3bd50-358d-4e7b-b32e-23b42cf88651 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:30.728349 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3bd50-358d-4e7b-b32e-23b42cf88651 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:30.728868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3bd50-358d-4e7b-b32e-23b42cf88651 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:30.729995 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3bd50-358d-4e7b-b32e-23b42cf88651 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:30.730535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3bd50-358d-4e7b-b32e-23b42cf88651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:30.732910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3bd50-358d-4e7b-b32e-23b42cf88651 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:30.744687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 97/194] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:19:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:30.750693 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3bd50-358d-4e7b-b32e-23b42cf88651 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:30.852769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdca5c-cb91-43d3-8570-3aecbab2083c None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:30.881849 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3bd50-358d-4e7b-b32e-23b42cf88651 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:30.898772 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d7434-591f-411f-b6a6-4d24e9fa15cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:30.899665 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d7434-591f-411f-b6a6-4d24e9fa15cc None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:30.899943 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d7434-591f-411f-b6a6-4d24e9fa15cc None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:30.900219 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d7434-591f-411f-b6a6-4d24e9fa15cc None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:30.901759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d7434-591f-411f-b6a6-4d24e9fa15cc None admin] RBAC: Authorizing `identity:get_project(project_id=d63a9207a2804d7193433ab0ec5687eb)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:30.903613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d7434-591f-411f-b6a6-4d24e9fa15cc None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:30.906389 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 98/195] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:30 2022] GET /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:30.912255 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d7434-591f-411f-b6a6-4d24e9fa15cc None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:30.921997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092852d2-0bee-42f9-b0c2-04575f4eac37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:30.922995 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092852d2-0bee-42f9-b0c2-04575f4eac37 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:30.923361 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092852d2-0bee-42f9-b0c2-04575f4eac37 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:30.923717 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092852d2-0bee-42f9-b0c2-04575f4eac37 None admin] PATH_INFO: `/v3/users/78d21464f78c41fdb76ec23daf7d77e5` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:30.925351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092852d2-0bee-42f9-b0c2-04575f4eac37 None admin] RBAC: Authorizing `identity:get_user(user_id=78d21464f78c41fdb76ec23daf7d77e5)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:30.926509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092852d2-0bee-42f9-b0c2-04575f4eac37 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:30.930843 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 98/196] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:30 2022] GET /identity/v3/users/78d21464f78c41fdb76ec23daf7d77e5 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:30.934605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092852d2-0bee-42f9-b0c2-04575f4eac37 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:31.027204 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d7434-591f-411f-b6a6-4d24e9fa15cc None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:31.051844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092852d2-0bee-42f9-b0c2-04575f4eac37 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:31.061068 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b02e45-f12f-4630-a342-80e7b3147842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:31.061742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b02e45-f12f-4630-a342-80e7b3147842 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:31.062028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b02e45-f12f-4630-a342-80e7b3147842 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:31.062307 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b02e45-f12f-4630-a342-80e7b3147842 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:31.063147 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b02e45-f12f-4630-a342-80e7b3147842 None admin] RBAC: Adding query filter params (role.id=408ee9a3a38640a48dbcdb2c377efcd8, scope.project.id=d63a9207a2804d7193433ab0ec5687eb, user.id=78d21464f78c41fdb76ec23daf7d77e5) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:31.063461 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b02e45-f12f-4630-a342-80e7b3147842 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:31.066770 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b02e45-f12f-4630-a342-80e7b3147842 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:31.074069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 99/197] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:19:30 2022] GET /identity/v3/role_assignments?user.id=78d21464f78c41fdb76ec23daf7d77e5&scope.project.id=d63a9207a2804d7193433ab0ec5687eb&role.id=408ee9a3a38640a48dbcdb2c377efcd8 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:31.096143 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e7bc8-9fe1-46b4-9681-6bc87379f1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:31.096795 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e7bc8-9fe1-46b4-9681-6bc87379f1c8 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:31.097078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e7bc8-9fe1-46b4-9681-6bc87379f1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:31.097348 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e7bc8-9fe1-46b4-9681-6bc87379f1c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:31.180603 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e7bc8-9fe1-46b4-9681-6bc87379f1c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:31.182113 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e7bc8-9fe1-46b4-9681-6bc87379f1c8 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:31.293963 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 99/198] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:19:31.300110 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b02e45-f12f-4630-a342-80e7b3147842 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:31.351359 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3d264-adcb-4c0e-9c85-50d273ec7767 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:31.351643 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3d264-adcb-4c0e-9c85-50d273ec7767 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:31.351829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3d264-adcb-4c0e-9c85-50d273ec7767 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:31.353457 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 100/199] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:19:31.358772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81eba58-d694-43f7-96af-2eb7e9453660 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:31.359059 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81eba58-d694-43f7-96af-2eb7e9453660 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:31.359405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81eba58-d694-43f7-96af-2eb7e9453660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:31.376109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-f81eba58-d694-43f7-96af-2eb7e9453660 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:31.377332 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-f81eba58-d694-43f7-96af-2eb7e9453660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:31.436457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b02e45-f12f-4630-a342-80e7b3147842 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:31.484893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 101/200] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:19:31.492495 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652517f-1fae-4f83-9895-793f6466472d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:31.500622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652517f-1fae-4f83-9895-793f6466472d None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:31.501195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652517f-1fae-4f83-9895-793f6466472d None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:31.501666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652517f-1fae-4f83-9895-793f6466472d None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:31.503176 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652517f-1fae-4f83-9895-793f6466472d None admin] RBAC: Authorizing `identity:get_project(project_id=d63a9207a2804d7193433ab0ec5687eb)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:31.504860 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652517f-1fae-4f83-9895-793f6466472d None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:31.506808 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 100/201] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:31 2022] GET /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:31.513424 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81eba58-d694-43f7-96af-2eb7e9453660 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:31.517944 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652517f-1fae-4f83-9895-793f6466472d None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:31.622920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652517f-1fae-4f83-9895-793f6466472d None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:31.672152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae34012-3080-4210-ba41-62303e4c1210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:31.672982 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae34012-3080-4210-ba41-62303e4c1210 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:31.673268 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae34012-3080-4210-ba41-62303e4c1210 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:31.673546 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae34012-3080-4210-ba41-62303e4c1210 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:31.684171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae34012-3080-4210-ba41-62303e4c1210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:31.688660 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81eba58-d694-43f7-96af-2eb7e9453660 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:31.691896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-1ae34012-3080-4210-ba41-62303e4c1210 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 06 23:19:31.691896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:31.691896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:31.691896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:31.691896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:31.691896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:31.691896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:31.691896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:31.691896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:31.691896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:31.691896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:31.691896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:31.691896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:31.691896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:31.691896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:31.691896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:31.692786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:31.692786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:31.692786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:31.692786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:31.692786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:31.692786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:31.692786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:31.692786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:31.692786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:31.692786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:31.692786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:31.692786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:31.692786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:31.692786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:31.692786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:31.692786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:31.693792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:31.693792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:31.693792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:31.693792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:31.693792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:31.693792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:31.693792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:31.693792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:31.693792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:31.693792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:31.693792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 06 23:19:31.693792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:31.693792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 101/202] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:19:31.700301 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae34012-3080-4210-ba41-62303e4c1210 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:31.768320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61984ce1-9061-4090-b172-cd1718e4f826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:31.769385 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984ce1-9061-4090-b172-cd1718e4f826 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:31.769857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984ce1-9061-4090-b172-cd1718e4f826 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:31.770315 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984ce1-9061-4090-b172-cd1718e4f826 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:31.771339 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61984ce1-9061-4090-b172-cd1718e4f826 None admin] RBAC: Adding query filter params (role.id=2cfb5ae0e4244117845519425cb9235e, scope.project.id=d63a9207a2804d7193433ab0ec5687eb, user.id=78d21464f78c41fdb76ec23daf7d77e5) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:31.771856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61984ce1-9061-4090-b172-cd1718e4f826 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:31.773533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61984ce1-9061-4090-b172-cd1718e4f826 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:31.784838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 102/203] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:19:31 2022] GET /identity/v3/role_assignments?user.id=78d21464f78c41fdb76ec23daf7d77e5&scope.project.id=d63a9207a2804d7193433ab0ec5687eb&role.id=2cfb5ae0e4244117845519425cb9235e => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:31.817258 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae34012-3080-4210-ba41-62303e4c1210 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:31.855442 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98078ce7-2bdd-4777-add9-ce70086b2abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:31.856132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98078ce7-2bdd-4777-add9-ce70086b2abc None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:31.856417 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98078ce7-2bdd-4777-add9-ce70086b2abc None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:31.856757 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98078ce7-2bdd-4777-add9-ce70086b2abc None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:31.857519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98078ce7-2bdd-4777-add9-ce70086b2abc None admin] RBAC: Adding query filter params (name=reader) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:31.857831 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98078ce7-2bdd-4777-add9-ce70086b2abc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:31.859283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98078ce7-2bdd-4777-add9-ce70086b2abc None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:31.868415 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 102/204] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:31.874679 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61984ce1-9061-4090-b172-cd1718e4f826 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:32.011480 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61984ce1-9061-4090-b172-cd1718e4f826 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:32.050018 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a63304-45d7-4798-9405-59831ebe8411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:32.050896 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a63304-45d7-4798-9405-59831ebe8411 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:32.051175 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a63304-45d7-4798-9405-59831ebe8411 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:32.051446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a63304-45d7-4798-9405-59831ebe8411 None admin] PATH_INFO: `/v3/users/e3a15610079349aa9e2bb258e0237060` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:32.053706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a63304-45d7-4798-9405-59831ebe8411 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a15610079349aa9e2bb258e0237060)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:32.055151 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a63304-45d7-4798-9405-59831ebe8411 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:32.057113 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 103/205] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:31 2022] GET /identity/v3/users/e3a15610079349aa9e2bb258e0237060 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:32.062919 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98078ce7-2bdd-4777-add9-ce70086b2abc None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:32.172070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98078ce7-2bdd-4777-add9-ce70086b2abc None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:32.216502 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154a471-8f8a-49f1-965b-43a8291efb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:32.217189 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154a471-8f8a-49f1-965b-43a8291efb5a None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:32.217519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154a471-8f8a-49f1-965b-43a8291efb5a None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:32.217800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154a471-8f8a-49f1-965b-43a8291efb5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:32.299878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154a471-8f8a-49f1-965b-43a8291efb5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:32.301394 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154a471-8f8a-49f1-965b-43a8291efb5a None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:32.407428 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 103/206] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:19:32.412673 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a63304-45d7-4798-9405-59831ebe8411 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:32.517229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a63304-45d7-4798-9405-59831ebe8411 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:32.556259 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a2632-0fe5-4b0b-bc18-fc1d5ca38ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:32.557152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a2632-0fe5-4b0b-bc18-fc1d5ca38ffd None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:32.557953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a2632-0fe5-4b0b-bc18-fc1d5ca38ffd None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:32.558233 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a2632-0fe5-4b0b-bc18-fc1d5ca38ffd None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:32.559435 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a2632-0fe5-4b0b-bc18-fc1d5ca38ffd None admin] RBAC: Authorizing `identity:get_project(project_id=0e884d4d1ec14a62a4ff4500b91183db)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:32.560915 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a2632-0fe5-4b0b-bc18-fc1d5ca38ffd None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:32.562821 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 104/207] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:32 2022] GET /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:32.568460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154a471-8f8a-49f1-965b-43a8291efb5a None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:32.707721 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154a471-8f8a-49f1-965b-43a8291efb5a None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:32.753268 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f6662-aad4-4ea1-a293-bba9faadb013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:32.753945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f6662-aad4-4ea1-a293-bba9faadb013 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:32.754233 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f6662-aad4-4ea1-a293-bba9faadb013 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:32.754510 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f6662-aad4-4ea1-a293-bba9faadb013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:32.755350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f6662-aad4-4ea1-a293-bba9faadb013 None admin] RBAC: Adding query filter params (role.id=4258c5283ef14edba6c29f6e63fa1839, scope.project.id=0e884d4d1ec14a62a4ff4500b91183db, user.id=e3a15610079349aa9e2bb258e0237060) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:32.755660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f6662-aad4-4ea1-a293-bba9faadb013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:32.757159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f6662-aad4-4ea1-a293-bba9faadb013 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:32.763809 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 104/208] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:19:32 2022] GET /identity/v3/role_assignments?user.id=e3a15610079349aa9e2bb258e0237060&scope.project.id=0e884d4d1ec14a62a4ff4500b91183db&role.id=4258c5283ef14edba6c29f6e63fa1839 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:33.511769 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e2ad5-c044-42fb-90cb-e498cc313824 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:33.512461 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e2ad5-c044-42fb-90cb-e498cc313824 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:33.512461 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e2ad5-c044-42fb-90cb-e498cc313824 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:33.513714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 105/209] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:33.519057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffb029-360a-4567-b8d0-ec0700095647 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:33.519554 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffb029-360a-4567-b8d0-ec0700095647 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:33.519719 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffb029-360a-4567-b8d0-ec0700095647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:33.540689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-36ffb029-360a-4567-b8d0-ec0700095647 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:33.541947 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-36ffb029-360a-4567-b8d0-ec0700095647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:33.620184 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 105/210] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:33.643269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e2ad5-c044-42fb-90cb-e498cc313824 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:33.749977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084375b9-b45a-430c-9ef4-97ead6899d90 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:33.750308 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e2ad5-c044-42fb-90cb-e498cc313824 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:33.750808 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084375b9-b45a-430c-9ef4-97ead6899d90 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:33.751292 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084375b9-b45a-430c-9ef4-97ead6899d90 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:33.756679 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 106/211] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:33.759559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfbecb-f7df-4fa1-814f-4df57f736068 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:33.760117 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfbecb-f7df-4fa1-814f-4df57f736068 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:33.761177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfbecb-f7df-4fa1-814f-4df57f736068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:33.778240 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-c3bfbecb-f7df-4fa1-814f-4df57f736068 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:33.779729 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c3bfbecb-f7df-4fa1-814f-4df57f736068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:33.790699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b09586-d264-4db9-84a2-f4b07a0874e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:33.792424 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b09586-d264-4db9-84a2-f4b07a0874e3 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:33.792745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b09586-d264-4db9-84a2-f4b07a0874e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:33.793021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b09586-d264-4db9-84a2-f4b07a0874e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:33.806449 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b09586-d264-4db9-84a2-f4b07a0874e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:33.816524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-b2b09586-d264-4db9-84a2-f4b07a0874e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:33.816524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:33.816524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:33.816524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:33.816524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:33.816524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:33.816524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:33.816524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:33.816524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:33.816524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:33.816524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:33.816524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:33.816524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:33.816524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:33.816524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:33.816524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:33.817505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:33.817505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:33.817505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:33.817505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:33.817505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:33.817505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:33.817505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:33.817505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:33.817505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:33.817505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:33.817505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:33.817505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:33.817505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:33.817505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:33.817505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:33.817505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:33.818672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:33.818672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:33.818672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:33.818672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:33.818672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:33.818672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:33.818672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:33.818672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:33.818672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:33.818672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:33.818672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:33.818672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:33.818672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 106/212] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:33.823465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b09586-d264-4db9-84a2-f4b07a0874e3 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:33.864669 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 107/213] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:33.881648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfbecb-f7df-4fa1-814f-4df57f736068 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:33.923822 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b09586-d264-4db9-84a2-f4b07a0874e3 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:33.957009 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe710ac-15f8-43cf-a6c0-844ab9312d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:33.957684 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe710ac-15f8-43cf-a6c0-844ab9312d19 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:33.957967 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe710ac-15f8-43cf-a6c0-844ab9312d19 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:33.958245 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe710ac-15f8-43cf-a6c0-844ab9312d19 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:33.958998 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe710ac-15f8-43cf-a6c0-844ab9312d19 None admin] RBAC: Adding query filter params (name=member) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:33.959308 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe710ac-15f8-43cf-a6c0-844ab9312d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:33.960719 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe710ac-15f8-43cf-a6c0-844ab9312d19 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:33.969589 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 107/214] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:33.974141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70b09e-6911-4175-b737-6a140355ffd7 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:33.974426 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70b09e-6911-4175-b737-6a140355ffd7 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:33.974703 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70b09e-6911-4175-b737-6a140355ffd7 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:33.975984 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 108/215] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:33.980602 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70b09e-6911-4175-b737-6a140355ffd7 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:33.987056 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfbecb-f7df-4fa1-814f-4df57f736068 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:34.019946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07599d-19ac-4418-a58b-0e46e666a507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:34.020766 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07599d-19ac-4418-a58b-0e46e666a507 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:34.021041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07599d-19ac-4418-a58b-0e46e666a507 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:34.021308 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07599d-19ac-4418-a58b-0e46e666a507 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:34.022461 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07599d-19ac-4418-a58b-0e46e666a507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:34.023907 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07599d-19ac-4418-a58b-0e46e666a507 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:34.030251 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 108/216] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:19:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:34.031415 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a937a2-d2bd-4d26-9738-d64eb7a7a9f9 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:34.031699 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a937a2-d2bd-4d26-9738-d64eb7a7a9f9 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:34.031972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a937a2-d2bd-4d26-9738-d64eb7a7a9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:34.047246 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-c8a937a2-d2bd-4d26-9738-d64eb7a7a9f9 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:34.048388 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c8a937a2-d2bd-4d26-9738-d64eb7a7a9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:34.079111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70b09e-6911-4175-b737-6a140355ffd7 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:34.112468 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 109/217] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:34.113787 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94b193-9cbd-4022-9766-d128f877d058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:34.114660 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94b193-9cbd-4022-9766-d128f877d058 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:34.114943 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94b193-9cbd-4022-9766-d128f877d058 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:34.115219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94b193-9cbd-4022-9766-d128f877d058 None admin] PATH_INFO: `/v3/users/2210d96e89dc40be82fec394b47a55b2` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:34.121598 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a937a2-d2bd-4d26-9738-d64eb7a7a9f9 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:34.130299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94b193-9cbd-4022-9766-d128f877d058 None admin] RBAC: Authorizing `identity:get_user(user_id=2210d96e89dc40be82fec394b47a55b2)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:34.132256 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94b193-9cbd-4022-9766-d128f877d058 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:34.134560 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 109/218] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:33 2022] GET /identity/v3/users/2210d96e89dc40be82fec394b47a55b2 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:34.139588 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94b193-9cbd-4022-9766-d128f877d058 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:34.230677 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a937a2-d2bd-4d26-9738-d64eb7a7a9f9 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:34.240676 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94b193-9cbd-4022-9766-d128f877d058 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:34.265506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d84b6d-d3f7-4460-bdcf-b5184e85961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:34.266339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d84b6d-d3f7-4460-bdcf-b5184e85961e None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:34.266935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d84b6d-d3f7-4460-bdcf-b5184e85961e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:34.267203 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d84b6d-d3f7-4460-bdcf-b5184e85961e None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:34.267908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d84b6d-d3f7-4460-bdcf-b5184e85961e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:34.269390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d84b6d-d3f7-4460-bdcf-b5184e85961e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:34.273844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4ed82-2b81-4fb1-8a59-c775c8f4e386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:34.274625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4ed82-2b81-4fb1-8a59-c775c8f4e386 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:34.274906 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4ed82-2b81-4fb1-8a59-c775c8f4e386 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:34.275178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4ed82-2b81-4fb1-8a59-c775c8f4e386 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:34.287838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4ed82-2b81-4fb1-8a59-c775c8f4e386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:34.291987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 110/219] 10.222.0.60 () {60 vars in 1132 bytes} [Fri May 6 23:19:34 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:19:34.292649 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d84b6d-d3f7-4460-bdcf-b5184e85961e None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:34.298167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-71b4ed82-2b81-4fb1-8a59-c775c8f4e386 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:34.298167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:34.298167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:34.298167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:34.298167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:34.298167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:34.298167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:34.298167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:34.298167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:34.298167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:34.298167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:34.298167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:34.298167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:34.298167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:34.298167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:34.298167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:34.299172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:34.299172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:34.299172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:34.299172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:34.299172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:34.299172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:34.299172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:34.299172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:34.299172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:34.299172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:34.299172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:34.299172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:34.299172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:34.299172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:34.299172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:34.299172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:34.299974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:34.299974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:34.299974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:34.299974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:34.299974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:34.299974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:34.299974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:34.299974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:34.299974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:34.299974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:34.299974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:34.299974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:34.299974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 110/220] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:19:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:34.309869 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4ed82-2b81-4fb1-8a59-c775c8f4e386 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:34.414067 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d84b6d-d3f7-4460-bdcf-b5184e85961e None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:34.431287 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4ed82-2b81-4fb1-8a59-c775c8f4e386 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:34.450000 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b49ca-71a4-4eca-b9c4-0948b4704065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:34.450671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b49ca-71a4-4eca-b9c4-0948b4704065 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:34.450953 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b49ca-71a4-4eca-b9c4-0948b4704065 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:34.451232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b49ca-71a4-4eca-b9c4-0948b4704065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:34.469422 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f806fa-ba69-48e8-98c8-db78264de787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:34.470088 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f806fa-ba69-48e8-98c8-db78264de787 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:34.470364 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f806fa-ba69-48e8-98c8-db78264de787 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:34.470640 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f806fa-ba69-48e8-98c8-db78264de787 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:34.471390 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f806fa-ba69-48e8-98c8-db78264de787 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:34.471692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f806fa-ba69-48e8-98c8-db78264de787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:34.473123 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f806fa-ba69-48e8-98c8-db78264de787 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:34.482477 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 111/221] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:34.483673 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28837d2-2465-428c-9d5b-6acd3158b531 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:34.483956 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28837d2-2465-428c-9d5b-6acd3158b531 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:34.484233 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28837d2-2465-428c-9d5b-6acd3158b531 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:34.486410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 112/222] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:34.489671 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28837d2-2465-428c-9d5b-6acd3158b531 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:34.534308 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b49ca-71a4-4eca-b9c4-0948b4704065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:34.536695 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b49ca-71a4-4eca-b9c4-0948b4704065 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:34.594900 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28837d2-2465-428c-9d5b-6acd3158b531 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:34.637639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414db08c-5138-45ff-b30b-7a9e815b4102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:34.638509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414db08c-5138-45ff-b30b-7a9e815b4102 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:34.638783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414db08c-5138-45ff-b30b-7a9e815b4102 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:34.639054 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414db08c-5138-45ff-b30b-7a9e815b4102 None admin] PATH_INFO: `/v3/users/78d21464f78c41fdb76ec23daf7d77e5` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:34.640237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414db08c-5138-45ff-b30b-7a9e815b4102 None admin] RBAC: Authorizing `identity:get_user(user_id=78d21464f78c41fdb76ec23daf7d77e5)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:34.642523 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414db08c-5138-45ff-b30b-7a9e815b4102 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:34.644050 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 113/223] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:34 2022] GET /identity/v3/users/78d21464f78c41fdb76ec23daf7d77e5 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:34.645274 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afac3fe-056d-4d48-862d-7022dc3a7b05 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:34.645552 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afac3fe-056d-4d48-862d-7022dc3a7b05 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:34.645824 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afac3fe-056d-4d48-862d-7022dc3a7b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:34.665580 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-7afac3fe-056d-4d48-862d-7022dc3a7b05 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:34.666669 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-7afac3fe-056d-4d48-862d-7022dc3a7b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:34.674548 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 111/224] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:19:34.675312 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b49ca-71a4-4eca-b9c4-0948b4704065 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:34.745272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 114/225] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:34.746196 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afac3fe-056d-4d48-862d-7022dc3a7b05 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:34.796326 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b49ca-71a4-4eca-b9c4-0948b4704065 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:34.838266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec514974-7aaa-47e0-b7ff-f752d212285e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:34.839551 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec514974-7aaa-47e0-b7ff-f752d212285e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:34.839835 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec514974-7aaa-47e0-b7ff-f752d212285e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:34.840103 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec514974-7aaa-47e0-b7ff-f752d212285e None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:34.841397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec514974-7aaa-47e0-b7ff-f752d212285e None admin] RBAC: Authorizing `identity:get_project(project_id=d63a9207a2804d7193433ab0ec5687eb)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:34.842849 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec514974-7aaa-47e0-b7ff-f752d212285e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:34.844580 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 112/226] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:34 2022] GET /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:34.845409 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec514974-7aaa-47e0-b7ff-f752d212285e None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:34.861824 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afac3fe-056d-4d48-862d-7022dc3a7b05 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:34.902134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97353b11-bbba-4d47-b70d-36e74a63b6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:34.903153 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97353b11-bbba-4d47-b70d-36e74a63b6ca None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:34.903431 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97353b11-bbba-4d47-b70d-36e74a63b6ca None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:34.903978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97353b11-bbba-4d47-b70d-36e74a63b6ca None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:34.905206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97353b11-bbba-4d47-b70d-36e74a63b6ca None admin] RBAC: Authorizing `identity:get_project(project_id=d63a9207a2804d7193433ab0ec5687eb)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:34.906655 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97353b11-bbba-4d47-b70d-36e74a63b6ca None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:34.909392 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 115/227] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:34 2022] GET /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:34.910385 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97353b11-bbba-4d47-b70d-36e74a63b6ca None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:34.958674 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec514974-7aaa-47e0-b7ff-f752d212285e None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:35.000302 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57908fb-2595-490e-bf31-dd794886e167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:35.001140 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57908fb-2595-490e-bf31-dd794886e167 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:35.001414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57908fb-2595-490e-bf31-dd794886e167 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:35.002033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57908fb-2595-490e-bf31-dd794886e167 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:35.015420 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57908fb-2595-490e-bf31-dd794886e167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:35.025628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97353b11-bbba-4d47-b70d-36e74a63b6ca None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:35.027663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-d57908fb-2595-490e-bf31-dd794886e167 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:19:35.027663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:35.027663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:35.027663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:35.027663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:35.027663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:35.027663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:35.027663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:35.027663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:35.027663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:35.027663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:35.027663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:35.027663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:35.027663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:35.027663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:35.027663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:35.028555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:35.028555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:35.028555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:35.028555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:35.028555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:35.028555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:35.028555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:35.028555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:35.028555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:35.028555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:35.028555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:35.028555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:35.028555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:35.028555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:35.028555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:35.028555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:35.029791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:35.029791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:35.029791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:35.029791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:35.029791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:35.029791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:35.029791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:35.029791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:35.029791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:35.029791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:35.029791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:19:35.029791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:35.029791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 113/228] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:19:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:35.030639 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57908fb-2595-490e-bf31-dd794886e167 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:35.076561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81721a2-f13e-4540-9f08-d99c6098c3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:35.076561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81721a2-f13e-4540-9f08-d99c6098c3a4 None admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:35.076561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81721a2-f13e-4540-9f08-d99c6098c3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:35.076561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81721a2-f13e-4540-9f08-d99c6098c3a4 None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb/users/78d21464f78c41fdb76ec23daf7d77e5/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:35.077000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81721a2-f13e-4540-9f08-d99c6098c3a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d63a9207a2804d7193433ab0ec5687eb, user_id=78d21464f78c41fdb76ec23daf7d77e5, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:35.077000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81721a2-f13e-4540-9f08-d99c6098c3a4 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:35.086598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 116/229] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:19:34 2022] PUT /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb/users/78d21464f78c41fdb76ec23daf7d77e5/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:19:35.087787 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81721a2-f13e-4540-9f08-d99c6098c3a4 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:35.146361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57908fb-2595-490e-bf31-dd794886e167 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:35.181270 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe54c68-f05e-44a4-878a-e6e033aea4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:35.181932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe54c68-f05e-44a4-878a-e6e033aea4d4 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:35.182213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe54c68-f05e-44a4-878a-e6e033aea4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:35.182555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe54c68-f05e-44a4-878a-e6e033aea4d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:35.183392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe54c68-f05e-44a4-878a-e6e033aea4d4 None admin] RBAC: Adding query filter params (role.id=4bc18e5c60c043ae8d42db9c4e9cd438, scope.project.id=d63a9207a2804d7193433ab0ec5687eb, user.id=2210d96e89dc40be82fec394b47a55b2) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:35.183698 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe54c68-f05e-44a4-878a-e6e033aea4d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:35.185204 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe54c68-f05e-44a4-878a-e6e033aea4d4 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:35.191279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 114/230] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:19:35 2022] GET /identity/v3/role_assignments?user.id=2210d96e89dc40be82fec394b47a55b2&scope.project.id=d63a9207a2804d7193433ab0ec5687eb&role.id=4bc18e5c60c043ae8d42db9c4e9cd438 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:35.207123 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81721a2-f13e-4540-9f08-d99c6098c3a4 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:35.274244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9566fb1-35b5-466e-b31e-b35481a12f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:35.274943 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9566fb1-35b5-466e-b31e-b35481a12f3a None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:35.275266 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9566fb1-35b5-466e-b31e-b35481a12f3a None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:35.275553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9566fb1-35b5-466e-b31e-b35481a12f3a None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:35.276411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9566fb1-35b5-466e-b31e-b35481a12f3a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:35.276749 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9566fb1-35b5-466e-b31e-b35481a12f3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:35.278319 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9566fb1-35b5-466e-b31e-b35481a12f3a None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:35.296351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 117/231] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:19:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:35.301902 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe54c68-f05e-44a4-878a-e6e033aea4d4 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:35.424226 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe54c68-f05e-44a4-878a-e6e033aea4d4 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:35.477935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464ddb2-04ab-4348-b8a0-df432f1ae3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:35.478834 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464ddb2-04ab-4348-b8a0-df432f1ae3ce None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:35.479119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464ddb2-04ab-4348-b8a0-df432f1ae3ce None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:35.479932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464ddb2-04ab-4348-b8a0-df432f1ae3ce None admin] PATH_INFO: `/v3/users/78d21464f78c41fdb76ec23daf7d77e5` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:35.481177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464ddb2-04ab-4348-b8a0-df432f1ae3ce None admin] RBAC: Authorizing `identity:get_user(user_id=78d21464f78c41fdb76ec23daf7d77e5)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:35.482636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464ddb2-04ab-4348-b8a0-df432f1ae3ce None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:35.484280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 115/232] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:35 2022] GET /identity/v3/users/78d21464f78c41fdb76ec23daf7d77e5 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:35.489891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9566fb1-35b5-466e-b31e-b35481a12f3a None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:35.665931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9566fb1-35b5-466e-b31e-b35481a12f3a None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:35.717344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f7b7d-5acb-4b10-bb00-98e8454da587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:35.718134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f7b7d-5acb-4b10-bb00-98e8454da587 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:35.718414 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f7b7d-5acb-4b10-bb00-98e8454da587 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:35.718685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f7b7d-5acb-4b10-bb00-98e8454da587 None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:35.719930 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f7b7d-5acb-4b10-bb00-98e8454da587 None admin] RBAC: Authorizing `identity:get_project(project_id=d63a9207a2804d7193433ab0ec5687eb)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:35.721417 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f7b7d-5acb-4b10-bb00-98e8454da587 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:35.723116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 118/233] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:35 2022] GET /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:35.728707 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464ddb2-04ab-4348-b8a0-df432f1ae3ce None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:35.862440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464ddb2-04ab-4348-b8a0-df432f1ae3ce None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:35.906140 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f52e4a-c9a3-4a9a-a18d-0787dca8a041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:35.907403 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f52e4a-c9a3-4a9a-a18d-0787dca8a041 None admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:35.907872 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f52e4a-c9a3-4a9a-a18d-0787dca8a041 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:35.908362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f52e4a-c9a3-4a9a-a18d-0787dca8a041 None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb/users/78d21464f78c41fdb76ec23daf7d77e5/roles/2cfb5ae0e4244117845519425cb9235e` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:35.910904 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f52e4a-c9a3-4a9a-a18d-0787dca8a041 None admin] RBAC: Authorizing `identity:create_grant(project_id=d63a9207a2804d7193433ab0ec5687eb, user_id=78d21464f78c41fdb76ec23daf7d77e5, role_id=2cfb5ae0e4244117845519425cb9235e)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:35.912566 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f52e4a-c9a3-4a9a-a18d-0787dca8a041 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:35.944713 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 116/234] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:19:35 2022] PUT /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb/users/78d21464f78c41fdb76ec23daf7d77e5/roles/2cfb5ae0e4244117845519425cb9235e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:19:36.867231 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24461b3b-24ad-4d2f-95e3-458370a909c8 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:36.867722 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24461b3b-24ad-4d2f-95e3-458370a909c8 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:36.867795 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24461b3b-24ad-4d2f-95e3-458370a909c8 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:36.869544 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 119/235] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:36.878537 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecf2fd-7073-4968-ba38-1ba72c4bdb53 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:36.879082 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecf2fd-7073-4968-ba38-1ba72c4bdb53 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:36.879082 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecf2fd-7073-4968-ba38-1ba72c4bdb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:36.905074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-0cecf2fd-7073-4968-ba38-1ba72c4bdb53 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:36.906289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-0cecf2fd-7073-4968-ba38-1ba72c4bdb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:36.990941 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 117/236] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:37.034319 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24461b3b-24ad-4d2f-95e3-458370a909c8 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:37.070979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c416e2-5146-420e-bb8e-b96f664586b4 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:37.071610 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c416e2-5146-420e-bb8e-b96f664586b4 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:37.072104 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c416e2-5146-420e-bb8e-b96f664586b4 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:37.073798 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 118/237] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:19:37.078945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5755097-8976-4900-ba5b-f63943df1384 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:37.079448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5755097-8976-4900-ba5b-f63943df1384 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:37.079921 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5755097-8976-4900-ba5b-f63943df1384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:37.097631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-c5755097-8976-4900-ba5b-f63943df1384 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:37.099111 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c5755097-8976-4900-ba5b-f63943df1384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:37.165652 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 119/238] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:19:37.190562 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5755097-8976-4900-ba5b-f63943df1384 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:37.230289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24461b3b-24ad-4d2f-95e3-458370a909c8 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:37.290336 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5755097-8976-4900-ba5b-f63943df1384 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:37.317817 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c4c34-725d-450f-8e6c-703e944f99a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:37.318612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c4c34-725d-450f-8e6c-703e944f99a9 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:37.319054 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c4c34-725d-450f-8e6c-703e944f99a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:37.319477 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c4c34-725d-450f-8e6c-703e944f99a9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:37.325894 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cfc64-3e99-4f00-91b2-26ef2f39fff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:37.326934 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cfc64-3e99-4f00-91b2-26ef2f39fff0 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:37.327469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cfc64-3e99-4f00-91b2-26ef2f39fff0 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:37.327939 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cfc64-3e99-4f00-91b2-26ef2f39fff0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:37.329391 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cfc64-3e99-4f00-91b2-26ef2f39fff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:37.331103 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cfc64-3e99-4f00-91b2-26ef2f39fff0 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:37.333350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 120/239] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:19:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:37.339760 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cfc64-3e99-4f00-91b2-26ef2f39fff0 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:37.353536 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c4c34-725d-450f-8e6c-703e944f99a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:37.368581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-752c4c34-725d-450f-8e6c-703e944f99a9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 06 23:19:37.368581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:37.368581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:37.368581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:37.368581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:37.368581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:37.368581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:37.368581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:37.368581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:37.368581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:37.368581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:37.368581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:37.368581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:37.368581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:37.368581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:37.368581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:37.369491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:37.369491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:37.369491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:37.369491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:37.369491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:37.369491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:37.369491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:37.369491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:37.369491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:37.369491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:37.369491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:37.369491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:37.369491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:37.369491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:37.369491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:37.369491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:37.370335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:37.370335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:37.370335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:37.370335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:37.370335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:37.370335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:37.370335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:37.370335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:37.370335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:37.370335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:37.370335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 06 23:19:37.370335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:37.370335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 120/240] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:37.375344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c4c34-725d-450f-8e6c-703e944f99a9 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:37.444158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cfc64-3e99-4f00-91b2-26ef2f39fff0 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:37.478995 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe920c-8e3e-42d9-bcd6-afcf2e74fbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:37.480241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe920c-8e3e-42d9-bcd6-afcf2e74fbe4 None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:37.480527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe920c-8e3e-42d9-bcd6-afcf2e74fbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:37.480829 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe920c-8e3e-42d9-bcd6-afcf2e74fbe4 None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:37.481547 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe920c-8e3e-42d9-bcd6-afcf2e74fbe4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:37.483004 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe920c-8e3e-42d9-bcd6-afcf2e74fbe4 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:37.504965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 121/241] 10.222.0.60 () {60 vars in 1132 bytes} [Fri May 6 23:19:37 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:19:37.598471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c4c34-725d-450f-8e6c-703e944f99a9 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:37.651396 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c962d-cbda-42d0-a1b2-0b826e3f738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:37.652049 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c962d-cbda-42d0-a1b2-0b826e3f738b None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:37.652335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c962d-cbda-42d0-a1b2-0b826e3f738b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:37.652630 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c962d-cbda-42d0-a1b2-0b826e3f738b None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:37.653453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c962d-cbda-42d0-a1b2-0b826e3f738b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:37.653761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c962d-cbda-42d0-a1b2-0b826e3f738b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:37.655160 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c962d-cbda-42d0-a1b2-0b826e3f738b None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:37.667317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 121/242] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:37.672840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe920c-8e3e-42d9-bcd6-afcf2e74fbe4 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:37.818977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe920c-8e3e-42d9-bcd6-afcf2e74fbe4 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:37.872006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192440a-8019-42ec-85ce-287262686cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:37.873251 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192440a-8019-42ec-85ce-287262686cc2 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:37.873736 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192440a-8019-42ec-85ce-287262686cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:37.874210 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192440a-8019-42ec-85ce-287262686cc2 None admin] PATH_INFO: `/v3/users/f758597c91f6471282413bb314fa0521` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:37.893476 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192440a-8019-42ec-85ce-287262686cc2 None admin] RBAC: Authorizing `identity:get_user(user_id=f758597c91f6471282413bb314fa0521)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:37.894978 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192440a-8019-42ec-85ce-287262686cc2 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:37.897068 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 122/243] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:37 2022] GET /identity/v3/users/f758597c91f6471282413bb314fa0521 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:37.903676 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c962d-cbda-42d0-a1b2-0b826e3f738b None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:38.002259 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9855e9-380c-4be0-82da-c3f64ba593ea None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:38.002907 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9855e9-380c-4be0-82da-c3f64ba593ea None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:38.003386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9855e9-380c-4be0-82da-c3f64ba593ea None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:38.005296 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 123/244] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:19:38.011026 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f455e4-78cf-4ebe-9a9d-e8e9bed6cc4f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:38.011611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f455e4-78cf-4ebe-9a9d-e8e9bed6cc4f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:38.012093 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f455e4-78cf-4ebe-9a9d-e8e9bed6cc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:38.019419 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c962d-cbda-42d0-a1b2-0b826e3f738b None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:38.038345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-98f455e4-78cf-4ebe-9a9d-e8e9bed6cc4f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:38.039918 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-98f455e4-78cf-4ebe-9a9d-e8e9bed6cc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:38.063165 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44884ef-b0ba-4d19-afca-8a3799563c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:38.063834 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44884ef-b0ba-4d19-afca-8a3799563c3d None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:38.064120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44884ef-b0ba-4d19-afca-8a3799563c3d None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:38.064398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44884ef-b0ba-4d19-afca-8a3799563c3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:38.123478 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 124/245] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:38.141636 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44884ef-b0ba-4d19-afca-8a3799563c3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:38.143453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44884ef-b0ba-4d19-afca-8a3799563c3d None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:38.152501 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f455e4-78cf-4ebe-9a9d-e8e9bed6cc4f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:38.255246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 122/246] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:19:38.260294 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44884ef-b0ba-4d19-afca-8a3799563c3d None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:38.264722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f455e4-78cf-4ebe-9a9d-e8e9bed6cc4f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:38.302866 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454c68c-91d1-45b0-b001-877704b160f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:38.303667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454c68c-91d1-45b0-b001-877704b160f0 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:38.303939 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454c68c-91d1-45b0-b001-877704b160f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:38.304210 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454c68c-91d1-45b0-b001-877704b160f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:38.321826 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454c68c-91d1-45b0-b001-877704b160f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:38.330722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-7454c68c-91d1-45b0-b001-877704b160f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:38.330722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:38.330722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:38.330722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:38.330722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:38.330722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:38.330722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:38.330722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:38.330722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:38.330722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:38.330722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:38.330722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:38.330722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:38.330722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:38.330722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:38.330722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:38.331589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:38.331589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:38.331589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:38.331589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:38.331589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:38.331589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:38.331589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:38.331589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:38.331589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:38.331589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:38.331589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:38.331589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:38.331589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:38.331589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:38.331589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:38.331589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:38.332372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:38.332372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:38.332372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:38.332372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:38.332372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:38.332372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:38.332372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:38.332372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:38.332372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:38.332372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:38.332372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:38.332372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:38.332372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 125/247] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:19:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:38.336557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8f2b4-13db-425f-b650-a9275778793c None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:38.336557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8f2b4-13db-425f-b650-a9275778793c None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:38.336557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8f2b4-13db-425f-b650-a9275778793c None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:38.336557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 126/248] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:38.340188 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8f2b4-13db-425f-b650-a9275778793c None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:38.367419 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44884ef-b0ba-4d19-afca-8a3799563c3d None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:38.421227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8cf24-005f-4652-bf7e-5de01a3f2096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:38.422080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8cf24-005f-4652-bf7e-5de01a3f2096 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:38.422350 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8cf24-005f-4652-bf7e-5de01a3f2096 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:38.422618 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8cf24-005f-4652-bf7e-5de01a3f2096 None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:38.423792 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8cf24-005f-4652-bf7e-5de01a3f2096 None admin] RBAC: Authorizing `identity:get_project(project_id=d63a9207a2804d7193433ab0ec5687eb)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:38.426118 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8cf24-005f-4652-bf7e-5de01a3f2096 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:38.429082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 123/249] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:38 2022] GET /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:38.431751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c216e6c-9e18-4716-bdda-5143cb10b8ec None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:38.432028 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c216e6c-9e18-4716-bdda-5143cb10b8ec None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:38.432339 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c216e6c-9e18-4716-bdda-5143cb10b8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:38.461688 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-4c216e6c-9e18-4716-bdda-5143cb10b8ec None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:38.465934 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-4c216e6c-9e18-4716-bdda-5143cb10b8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:38.490959 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8f2b4-13db-425f-b650-a9275778793c None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:38.549552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a9553-32d1-49a3-89c5-bd8b335dc628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:38.550444 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a9553-32d1-49a3-89c5-bd8b335dc628 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:38.550909 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a9553-32d1-49a3-89c5-bd8b335dc628 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:38.551361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a9553-32d1-49a3-89c5-bd8b335dc628 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:38.552688 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a9553-32d1-49a3-89c5-bd8b335dc628 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:38.553066 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a9553-32d1-49a3-89c5-bd8b335dc628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:38.554748 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a9553-32d1-49a3-89c5-bd8b335dc628 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:38.565816 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 127/250] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:38.566702 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a9553-32d1-49a3-89c5-bd8b335dc628 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:38.618220 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 124/251] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:38.619098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c216e6c-9e18-4716-bdda-5143cb10b8ec None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:38.693013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a9553-32d1-49a3-89c5-bd8b335dc628 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:38.747473 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422ab46-09fc-40d9-9638-89f9dc40c844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:38.748140 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ab46-09fc-40d9-9638-89f9dc40c844 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:38.748427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ab46-09fc-40d9-9638-89f9dc40c844 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:38.748734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ab46-09fc-40d9-9638-89f9dc40c844 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:38.749566 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422ab46-09fc-40d9-9638-89f9dc40c844 None admin] RBAC: Adding query filter params (role.id=4258c5283ef14edba6c29f6e63fa1839, scope.project.id=d63a9207a2804d7193433ab0ec5687eb, user.id=f758597c91f6471282413bb314fa0521) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:38.749879 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422ab46-09fc-40d9-9638-89f9dc40c844 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:38.751327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422ab46-09fc-40d9-9638-89f9dc40c844 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:38.757232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 128/252] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:19:38 2022] GET /identity/v3/role_assignments?user.id=f758597c91f6471282413bb314fa0521&scope.project.id=d63a9207a2804d7193433ab0ec5687eb&role.id=4258c5283ef14edba6c29f6e63fa1839 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:38.758046 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422ab46-09fc-40d9-9638-89f9dc40c844 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:38.769745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c216e6c-9e18-4716-bdda-5143cb10b8ec None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:38.813303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0286784-0e8f-40f3-b345-333f877a4013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:38.814139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0286784-0e8f-40f3-b345-333f877a4013 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:38.814424 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0286784-0e8f-40f3-b345-333f877a4013 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:38.814702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0286784-0e8f-40f3-b345-333f877a4013 None admin] PATH_INFO: `/v3/users/78d21464f78c41fdb76ec23daf7d77e5` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:38.816068 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0286784-0e8f-40f3-b345-333f877a4013 None admin] RBAC: Authorizing `identity:get_user(user_id=78d21464f78c41fdb76ec23daf7d77e5)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:38.817589 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0286784-0e8f-40f3-b345-333f877a4013 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:38.819869 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 125/253] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:38 2022] GET /identity/v3/users/78d21464f78c41fdb76ec23daf7d77e5 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:38.821177 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc6cca-82a1-4a6d-a9b7-bc84be1b5aac None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:38.821465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc6cca-82a1-4a6d-a9b7-bc84be1b5aac None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:38.821742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc6cca-82a1-4a6d-a9b7-bc84be1b5aac None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:38.828574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 126/254] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:38.832560 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc6cca-82a1-4a6d-a9b7-bc84be1b5aac None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:38.966279 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc6cca-82a1-4a6d-a9b7-bc84be1b5aac None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:39.005935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422ab46-09fc-40d9-9638-89f9dc40c844 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:39.019956 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127dc0f4-4dea-43c9-a8cf-7980f2e74738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:39.020679 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dc0f4-4dea-43c9-a8cf-7980f2e74738 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:39.020924 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dc0f4-4dea-43c9-a8cf-7980f2e74738 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:39.021205 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dc0f4-4dea-43c9-a8cf-7980f2e74738 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:39.049251 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c0b2a-8864-480b-92fe-47e29035ab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:39.050453 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c0b2a-8864-480b-92fe-47e29035ab04 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:39.050955 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c0b2a-8864-480b-92fe-47e29035ab04 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:39.051468 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c0b2a-8864-480b-92fe-47e29035ab04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:39.074595 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c0b2a-8864-480b-92fe-47e29035ab04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:39.083765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-019c0b2a-8864-480b-92fe-47e29035ab04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:39.083765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:39.083765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:39.083765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:39.083765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:39.083765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:39.083765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:39.083765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:39.083765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:39.083765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:39.083765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:39.083765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:39.083765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:39.083765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:39.083765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:39.083765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:39.084706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:39.084706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:39.084706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:39.084706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:39.084706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:39.084706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:39.084706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:39.084706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:39.084706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:39.084706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:39.084706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:39.084706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:39.084706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:39.084706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:39.084706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:39.084706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:39.085504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:39.085504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:39.085504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:39.085504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:39.085504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:39.085504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:39.085504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:39.085504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:39.085504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:39.085504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:39.085504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:39.085504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:39.085504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 129/255] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:39.086685 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040adb01-b814-483e-9a8a-7a1be5bd4000 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:39.086685 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040adb01-b814-483e-9a8a-7a1be5bd4000 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:39.086835 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040adb01-b814-483e-9a8a-7a1be5bd4000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:39.097180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127dc0f4-4dea-43c9-a8cf-7980f2e74738 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:39.098963 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127dc0f4-4dea-43c9-a8cf-7980f2e74738 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:39.127606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-040adb01-b814-483e-9a8a-7a1be5bd4000 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:39.128832 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-040adb01-b814-483e-9a8a-7a1be5bd4000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:39.208429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 127/256] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:19:39.209639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127dc0f4-4dea-43c9-a8cf-7980f2e74738 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:39.273829 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 130/257] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:39.274804 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040adb01-b814-483e-9a8a-7a1be5bd4000 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:39.332504 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127dc0f4-4dea-43c9-a8cf-7980f2e74738 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:39.377707 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa5977-134c-43bd-a567-41db3ba2813f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:39.379036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa5977-134c-43bd-a567-41db3ba2813f None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:39.379777 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa5977-134c-43bd-a567-41db3ba2813f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:39.380565 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa5977-134c-43bd-a567-41db3ba2813f None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:39.381531 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa5977-134c-43bd-a567-41db3ba2813f None admin] RBAC: Adding query filter params (name=member) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:39.382039 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa5977-134c-43bd-a567-41db3ba2813f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:39.384093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa5977-134c-43bd-a567-41db3ba2813f None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:39.395445 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 128/258] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:39.395934 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040adb01-b814-483e-9a8a-7a1be5bd4000 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:39.396787 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa5977-134c-43bd-a567-41db3ba2813f None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:39.454800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77367e4-e00c-4faa-a65a-f5a87c03fbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:39.455664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77367e4-e00c-4faa-a65a-f5a87c03fbfe None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:39.456504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77367e4-e00c-4faa-a65a-f5a87c03fbfe None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:39.456799 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77367e4-e00c-4faa-a65a-f5a87c03fbfe None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:39.458080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77367e4-e00c-4faa-a65a-f5a87c03fbfe None admin] RBAC: Authorizing `identity:get_project(project_id=d63a9207a2804d7193433ab0ec5687eb)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:39.461597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77367e4-e00c-4faa-a65a-f5a87c03fbfe None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:39.463320 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 131/259] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:39 2022] GET /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:39.465772 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77367e4-e00c-4faa-a65a-f5a87c03fbfe None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:39.569272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa5977-134c-43bd-a567-41db3ba2813f None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:39.608981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038e90f-5e56-4286-ad5b-0c8386e8b11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:39.608981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038e90f-5e56-4286-ad5b-0c8386e8b11c None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:39.608981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038e90f-5e56-4286-ad5b-0c8386e8b11c None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:39.608981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038e90f-5e56-4286-ad5b-0c8386e8b11c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:39.631144 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038e90f-5e56-4286-ad5b-0c8386e8b11c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:39.639820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-9038e90f-5e56-4286-ad5b-0c8386e8b11c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:19:39.639820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:39.639820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:39.639820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:39.639820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:39.639820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:39.639820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:39.639820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:39.639820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:39.639820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:39.639820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:39.639820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:39.639820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:39.639820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:39.639820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:39.639820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:39.641397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:39.641397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:39.641397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:39.641397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:39.641397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:39.641397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:39.641397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:39.641397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:39.641397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:39.641397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:39.641397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:39.641397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:39.641397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:39.641397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:39.641397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:39.641397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:39.642876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:39.642876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:39.642876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:39.642876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:39.642876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:39.642876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:39.642876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:39.642876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:39.642876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:39.642876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:39.642876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:19:39.642876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:39.642876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 129/260] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:19:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:39.644128 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038e90f-5e56-4286-ad5b-0c8386e8b11c None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:39.680573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77367e4-e00c-4faa-a65a-f5a87c03fbfe None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:39.721424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1d49d-2a55-47cd-a198-997c1757a360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:39.722696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1d49d-2a55-47cd-a198-997c1757a360 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:39.723176 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1d49d-2a55-47cd-a198-997c1757a360 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:39.723666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1d49d-2a55-47cd-a198-997c1757a360 None admin] PATH_INFO: `/v3/users/2210d96e89dc40be82fec394b47a55b2` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:39.726351 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1d49d-2a55-47cd-a198-997c1757a360 None admin] RBAC: Authorizing `identity:get_user(user_id=2210d96e89dc40be82fec394b47a55b2)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:39.731005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1d49d-2a55-47cd-a198-997c1757a360 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:39.734190 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 132/261] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:39 2022] GET /identity/v3/users/2210d96e89dc40be82fec394b47a55b2 => generated 297 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:39.736529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1d49d-2a55-47cd-a198-997c1757a360 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:39.814700 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038e90f-5e56-4286-ad5b-0c8386e8b11c None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:39.860189 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd466a2b-46a7-42b1-9973-830f8593f364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:39.860814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd466a2b-46a7-42b1-9973-830f8593f364 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:39.861099 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd466a2b-46a7-42b1-9973-830f8593f364 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:39.861375 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd466a2b-46a7-42b1-9973-830f8593f364 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:39.862215 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd466a2b-46a7-42b1-9973-830f8593f364 None admin] RBAC: Adding query filter params (role.id=408ee9a3a38640a48dbcdb2c377efcd8, scope.project.id=d63a9207a2804d7193433ab0ec5687eb, user.id=78d21464f78c41fdb76ec23daf7d77e5) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:39.862530 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd466a2b-46a7-42b1-9973-830f8593f364 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:39.863987 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd466a2b-46a7-42b1-9973-830f8593f364 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:39.879464 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 130/262] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:19:39 2022] GET /identity/v3/role_assignments?user.id=78d21464f78c41fdb76ec23daf7d77e5&scope.project.id=d63a9207a2804d7193433ab0ec5687eb&role.id=408ee9a3a38640a48dbcdb2c377efcd8 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:39.880293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd466a2b-46a7-42b1-9973-830f8593f364 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:39.949899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1d49d-2a55-47cd-a198-997c1757a360 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:40.028118 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eb527-cc8e-421a-8207-37956f12d8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:40.028910 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eb527-cc8e-421a-8207-37956f12d8b4 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:40.029110 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eb527-cc8e-421a-8207-37956f12d8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:40.029389 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eb527-cc8e-421a-8207-37956f12d8b4 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:40.030154 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7eb527-cc8e-421a-8207-37956f12d8b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:40.030463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7eb527-cc8e-421a-8207-37956f12d8b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:40.031867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7eb527-cc8e-421a-8207-37956f12d8b4 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:40.051561 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 133/263] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:19:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:40.058353 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eb527-cc8e-421a-8207-37956f12d8b4 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:40.100305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd466a2b-46a7-42b1-9973-830f8593f364 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:40.172408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809113cb-ff52-4618-a4c0-96d0c56257d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:40.173229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809113cb-ff52-4618-a4c0-96d0c56257d4 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:40.173922 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809113cb-ff52-4618-a4c0-96d0c56257d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:40.174207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809113cb-ff52-4618-a4c0-96d0c56257d4 None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:40.177365 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809113cb-ff52-4618-a4c0-96d0c56257d4 None admin] RBAC: Authorizing `identity:get_project(project_id=d63a9207a2804d7193433ab0ec5687eb)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:40.179116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809113cb-ff52-4618-a4c0-96d0c56257d4 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:40.181210 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 131/264] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:39 2022] GET /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:40.188367 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809113cb-ff52-4618-a4c0-96d0c56257d4 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:40.283394 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eb527-cc8e-421a-8207-37956f12d8b4 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:40.345912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809113cb-ff52-4618-a4c0-96d0c56257d4 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:40.360279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134a4e9-efd2-449d-b9e7-c136ad155dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:40.361506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134a4e9-efd2-449d-b9e7-c136ad155dcb None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:40.362012 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134a4e9-efd2-449d-b9e7-c136ad155dcb None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:40.362495 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134a4e9-efd2-449d-b9e7-c136ad155dcb None admin] PATH_INFO: `/v3/users/78d21464f78c41fdb76ec23daf7d77e5` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:40.363944 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134a4e9-efd2-449d-b9e7-c136ad155dcb None admin] RBAC: Authorizing `identity:get_user(user_id=78d21464f78c41fdb76ec23daf7d77e5)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:40.365682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134a4e9-efd2-449d-b9e7-c136ad155dcb None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:40.373453 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 134/265] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:40 2022] GET /identity/v3/users/78d21464f78c41fdb76ec23daf7d77e5 => generated 283 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:40.377541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134a4e9-efd2-449d-b9e7-c136ad155dcb None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:40.391786 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bad79-d4ef-4b70-81f8-47e626b3c3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:40.392738 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bad79-d4ef-4b70-81f8-47e626b3c3f9 None admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:40.393022 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bad79-d4ef-4b70-81f8-47e626b3c3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:40.393298 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bad79-d4ef-4b70-81f8-47e626b3c3f9 None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb/users/2210d96e89dc40be82fec394b47a55b2/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:40.395464 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633bad79-d4ef-4b70-81f8-47e626b3c3f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d63a9207a2804d7193433ab0ec5687eb, user_id=2210d96e89dc40be82fec394b47a55b2, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:40.400025 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633bad79-d4ef-4b70-81f8-47e626b3c3f9 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:40.419814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 132/266] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:19:40 2022] PUT /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb/users/2210d96e89dc40be82fec394b47a55b2/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:19:40.535321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134a4e9-efd2-449d-b9e7-c136ad155dcb None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:40.580286 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4111b4-8247-4282-9c71-cb94576d52d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:40.580984 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4111b4-8247-4282-9c71-cb94576d52d1 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:40.581261 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4111b4-8247-4282-9c71-cb94576d52d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:40.581531 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4111b4-8247-4282-9c71-cb94576d52d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:40.631935 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91168961-e8a5-4093-b3b9-9bd6ee0a994d None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:40.632615 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91168961-e8a5-4093-b3b9-9bd6ee0a994d None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:40.633090 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91168961-e8a5-4093-b3b9-9bd6ee0a994d None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:40.634955 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 133/267] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:40.646253 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c49be3-56e8-4fc9-b7d2-d3b373dd0c40 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:40.646855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c49be3-56e8-4fc9-b7d2-d3b373dd0c40 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:40.647321 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c49be3-56e8-4fc9-b7d2-d3b373dd0c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:40.667059 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4111b4-8247-4282-9c71-cb94576d52d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:40.670031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4111b4-8247-4282-9c71-cb94576d52d1 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:40.674774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-d5c49be3-56e8-4fc9-b7d2-d3b373dd0c40 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:40.675970 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d5c49be3-56e8-4fc9-b7d2-d3b373dd0c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:40.754739 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 134/268] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:19:40.771571 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 135/269] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:19:40.777635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c49be3-56e8-4fc9-b7d2-d3b373dd0c40 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:40.783200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4111b4-8247-4282-9c71-cb94576d52d1 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:40.917615 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c49be3-56e8-4fc9-b7d2-d3b373dd0c40 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:40.955317 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4111b4-8247-4282-9c71-cb94576d52d1 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:40.960529 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060b14e-1b82-4724-b6f4-db5b004a0c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:40.961425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060b14e-1b82-4724-b6f4-db5b004a0c3a None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:40.961708 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060b14e-1b82-4724-b6f4-db5b004a0c3a None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:40.961984 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060b14e-1b82-4724-b6f4-db5b004a0c3a None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:40.971200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060b14e-1b82-4724-b6f4-db5b004a0c3a None admin] RBAC: Authorizing `identity:get_project(project_id=d63a9207a2804d7193433ab0ec5687eb)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:40.972716 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060b14e-1b82-4724-b6f4-db5b004a0c3a None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:40.974630 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 135/270] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:40 2022] GET /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:40.979555 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1c4e4-0f01-41b5-b5f6-306ac4c9f855 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:40.979555 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1c4e4-0f01-41b5-b5f6-306ac4c9f855 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:40.979555 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1c4e4-0f01-41b5-b5f6-306ac4c9f855 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:40.979555 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 136/271] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:40.984192 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1c4e4-0f01-41b5-b5f6-306ac4c9f855 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:41.007831 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d4901-0c9e-4039-b08f-1f2d441366b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:41.009054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d4901-0c9e-4039-b08f-1f2d441366b7 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:41.009569 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d4901-0c9e-4039-b08f-1f2d441366b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:41.010047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d4901-0c9e-4039-b08f-1f2d441366b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:41.021912 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d4901-0c9e-4039-b08f-1f2d441366b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:41.030179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-1a4d4901-0c9e-4039-b08f-1f2d441366b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:41.030179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:41.030179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:41.030179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:41.030179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:41.030179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:41.030179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:41.030179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:41.030179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:41.030179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:41.030179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:41.030179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:41.030179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:41.030179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:41.030179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:41.030179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:41.031469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:41.031469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:41.031469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:41.031469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:41.031469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:41.031469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:41.031469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:41.031469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:41.031469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:41.031469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:41.031469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:41.031469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:41.031469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:41.031469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:41.031469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:41.031469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:41.032272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:41.032272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:41.032272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:41.032272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:41.032272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:41.032272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:41.032272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:41.032272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:41.032272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:41.032272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:41.032272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:41.032272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:41.036367 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 136/272] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:19:41.037863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e0377-48a8-4a3f-aa4c-e35a4d4b7477 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:41.038409 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e0377-48a8-4a3f-aa4c-e35a4d4b7477 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:41.038899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e0377-48a8-4a3f-aa4c-e35a4d4b7477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:41.058010 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-3a3e0377-48a8-4a3f-aa4c-e35a4d4b7477 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:41.059608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-3a3e0377-48a8-4a3f-aa4c-e35a4d4b7477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:41.085935 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1c4e4-0f01-41b5-b5f6-306ac4c9f855 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:41.120801 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07bc1f-66d3-4933-9f65-a7ea3a5b7b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:41.121391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07bc1f-66d3-4933-9f65-a7ea3a5b7b92 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:41.121642 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07bc1f-66d3-4933-9f65-a7ea3a5b7b92 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:41.122097 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07bc1f-66d3-4933-9f65-a7ea3a5b7b92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:41.123078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07bc1f-66d3-4933-9f65-a7ea3a5b7b92 None admin] RBAC: Adding query filter params (role.id=2cfb5ae0e4244117845519425cb9235e, scope.project.id=d63a9207a2804d7193433ab0ec5687eb, user.id=78d21464f78c41fdb76ec23daf7d77e5) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:41.123574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07bc1f-66d3-4933-9f65-a7ea3a5b7b92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:41.125211 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07bc1f-66d3-4933-9f65-a7ea3a5b7b92 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:41.131477 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 137/273] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:19:40 2022] GET /identity/v3/role_assignments?user.id=78d21464f78c41fdb76ec23daf7d77e5&scope.project.id=d63a9207a2804d7193433ab0ec5687eb&role.id=2cfb5ae0e4244117845519425cb9235e => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:41.132495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07bc1f-66d3-4933-9f65-a7ea3a5b7b92 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:41.137213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 137/274] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:41.185978 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e0377-48a8-4a3f-aa4c-e35a4d4b7477 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:41.252188 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07bc1f-66d3-4933-9f65-a7ea3a5b7b92 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:41.298712 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759104b1-9929-4c63-9832-fa12864ee4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:41.299397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759104b1-9929-4c63-9832-fa12864ee4ef None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:41.299674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759104b1-9929-4c63-9832-fa12864ee4ef None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:41.299947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759104b1-9929-4c63-9832-fa12864ee4ef None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:41.312788 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759104b1-9929-4c63-9832-fa12864ee4ef None admin] RBAC: Adding query filter params (name=member) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:41.312788 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759104b1-9929-4c63-9832-fa12864ee4ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:41.312788 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759104b1-9929-4c63-9832-fa12864ee4ef None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:41.323806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 138/275] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:41.329742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759104b1-9929-4c63-9832-fa12864ee4ef None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:41.341164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e0377-48a8-4a3f-aa4c-e35a4d4b7477 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:41.386846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d633cc-3978-4f52-9f6f-f862d7124c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:41.387662 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d633cc-3978-4f52-9f6f-f862d7124c52 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:41.387948 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d633cc-3978-4f52-9f6f-f862d7124c52 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:41.388223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d633cc-3978-4f52-9f6f-f862d7124c52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:41.391583 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d633cc-3978-4f52-9f6f-f862d7124c52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:41.393110 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d633cc-3978-4f52-9f6f-f862d7124c52 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:41.395138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 138/276] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:19:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:41.409781 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d633cc-3978-4f52-9f6f-f862d7124c52 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:41.451500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759104b1-9929-4c63-9832-fa12864ee4ef None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:41.488634 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c221497-8297-4207-ba64-7ca664c6375e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:41.490073 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c221497-8297-4207-ba64-7ca664c6375e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:41.490351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c221497-8297-4207-ba64-7ca664c6375e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:41.490622 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c221497-8297-4207-ba64-7ca664c6375e None admin] PATH_INFO: `/v3/users/84e56154fcb54388b5a575aefb78ff52` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:41.508286 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c221497-8297-4207-ba64-7ca664c6375e None admin] RBAC: Authorizing `identity:get_user(user_id=84e56154fcb54388b5a575aefb78ff52)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:41.510357 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c221497-8297-4207-ba64-7ca664c6375e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:41.516706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 139/277] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:41 2022] GET /identity/v3/users/84e56154fcb54388b5a575aefb78ff52 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:41.518678 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c221497-8297-4207-ba64-7ca664c6375e None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:41.535969 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d633cc-3978-4f52-9f6f-f862d7124c52 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:41.582094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63ed92-4ad1-499a-a6ed-2ee5b1d01434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:41.582772 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63ed92-4ad1-499a-a6ed-2ee5b1d01434 None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:41.583053 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63ed92-4ad1-499a-a6ed-2ee5b1d01434 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:41.583326 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63ed92-4ad1-499a-a6ed-2ee5b1d01434 None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:41.584037 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63ed92-4ad1-499a-a6ed-2ee5b1d01434 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:41.585546 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63ed92-4ad1-499a-a6ed-2ee5b1d01434 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:41.611751 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 139/278] 10.222.0.60 () {60 vars in 1132 bytes} [Fri May 6 23:19:41 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:19:41.630247 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd7ef7-03aa-4e8f-ac8a-af7f5214990d None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:41.630615 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd7ef7-03aa-4e8f-ac8a-af7f5214990d None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:41.630802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd7ef7-03aa-4e8f-ac8a-af7f5214990d None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:41.632526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 140/279] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:19:41.638636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31794318-79dc-4797-b3a0-90e443181880 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:41.638920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31794318-79dc-4797-b3a0-90e443181880 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:41.639159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31794318-79dc-4797-b3a0-90e443181880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:41.660343 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c221497-8297-4207-ba64-7ca664c6375e None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:41.664830 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-31794318-79dc-4797-b3a0-90e443181880 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:41.666039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-31794318-79dc-4797-b3a0-90e443181880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:41.698487 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5a46c-748d-45dc-9420-42f787333509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:41.699584 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5a46c-748d-45dc-9420-42f787333509 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:41.700110 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5a46c-748d-45dc-9420-42f787333509 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:41.700628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5a46c-748d-45dc-9420-42f787333509 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:41.701730 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5a46c-748d-45dc-9420-42f787333509 None admin] RBAC: Adding query filter params (role.id=4bc18e5c60c043ae8d42db9c4e9cd438, user.id=84e56154fcb54388b5a575aefb78ff52, scope.system=all) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:41.702266 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5a46c-748d-45dc-9420-42f787333509 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:41.704031 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5a46c-748d-45dc-9420-42f787333509 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:41.710259 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 140/280] 10.222.0.60 () {56 vars in 1308 bytes} [Fri May 6 23:19:41 2022] GET /identity/v3/role_assignments?user.id=84e56154fcb54388b5a575aefb78ff52&scope.system=all&role.id=4bc18e5c60c043ae8d42db9c4e9cd438 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:41.754932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 141/281] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:19:41.777653 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5a46c-748d-45dc-9420-42f787333509 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:41.917548 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5a46c-748d-45dc-9420-42f787333509 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:41.953674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03202c7f-7cc4-4f81-bff2-edb034d0008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:41.954474 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03202c7f-7cc4-4f81-bff2-edb034d0008c None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:41.954748 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03202c7f-7cc4-4f81-bff2-edb034d0008c None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:41.955019 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03202c7f-7cc4-4f81-bff2-edb034d0008c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:41.967805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03202c7f-7cc4-4f81-bff2-edb034d0008c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:41.975909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-03202c7f-7cc4-4f81-bff2-edb034d0008c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 06 23:19:41.975909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:41.975909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:41.975909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:41.975909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:41.975909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:41.975909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:41.975909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:41.975909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:41.975909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:41.975909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:41.975909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:41.975909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:41.975909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:41.975909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:41.975909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:41.977344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:41.977344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:41.977344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:41.977344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:41.977344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:41.977344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:41.977344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:41.977344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:41.977344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:41.977344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:41.977344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:41.977344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:41.977344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:41.977344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:41.977344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:41.977344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:41.978178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:41.978178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:41.978178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:41.978178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:41.978178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:41.978178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:41.978178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:41.978178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:41.978178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:41.978178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:41.978178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 06 23:19:41.978178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:41.981006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 141/282] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:41.986295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31794318-79dc-4797-b3a0-90e443181880 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:42.099668 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31794318-79dc-4797-b3a0-90e443181880 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:42.133562 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaf692-c579-4e34-8c89-47d14af09a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:42.134241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaf692-c579-4e34-8c89-47d14af09a1e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:42.134547 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaf692-c579-4e34-8c89-47d14af09a1e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:42.134844 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaf692-c579-4e34-8c89-47d14af09a1e None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:42.136158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaf692-c579-4e34-8c89-47d14af09a1e None admin] RBAC: Adding query filter params (name=reader) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:42.136488 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaf692-c579-4e34-8c89-47d14af09a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:42.138008 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaf692-c579-4e34-8c89-47d14af09a1e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:42.148214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 142/283] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:42.153519 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03202c7f-7cc4-4f81-bff2-edb034d0008c None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:42.260167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03202c7f-7cc4-4f81-bff2-edb034d0008c None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:42.300955 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51449e0-5978-4ca8-8f64-e64a68dcfbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:42.301860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51449e0-5978-4ca8-8f64-e64a68dcfbc4 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:42.302109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51449e0-5978-4ca8-8f64-e64a68dcfbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:42.302385 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51449e0-5978-4ca8-8f64-e64a68dcfbc4 None admin] PATH_INFO: `/v3/users/f758597c91f6471282413bb314fa0521` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:42.303588 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51449e0-5978-4ca8-8f64-e64a68dcfbc4 None admin] RBAC: Authorizing `identity:get_user(user_id=f758597c91f6471282413bb314fa0521)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:42.305071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51449e0-5978-4ca8-8f64-e64a68dcfbc4 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:42.307020 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 142/284] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:42 2022] GET /identity/v3/users/f758597c91f6471282413bb314fa0521 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:42.313050 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaf692-c579-4e34-8c89-47d14af09a1e None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:42.412493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaf692-c579-4e34-8c89-47d14af09a1e None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:42.446050 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbb5ce-3768-4911-a8f4-80f500f85919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:42.446913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbb5ce-3768-4911-a8f4-80f500f85919 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:42.447197 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbb5ce-3768-4911-a8f4-80f500f85919 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:42.447469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbb5ce-3768-4911-a8f4-80f500f85919 None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:42.448771 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbb5ce-3768-4911-a8f4-80f500f85919 None admin] RBAC: Authorizing `identity:get_project(project_id=d63a9207a2804d7193433ab0ec5687eb)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:42.450240 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbb5ce-3768-4911-a8f4-80f500f85919 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:42.451949 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 143/285] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:42 2022] GET /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:42.457613 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51449e0-5978-4ca8-8f64-e64a68dcfbc4 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:42.602832 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51449e0-5978-4ca8-8f64-e64a68dcfbc4 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:42.651431 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25097bff-9a92-4c00-b0f5-d1e3574db9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:42.652671 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25097bff-9a92-4c00-b0f5-d1e3574db9c7 None admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:42.653132 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25097bff-9a92-4c00-b0f5-d1e3574db9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:42.653583 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25097bff-9a92-4c00-b0f5-d1e3574db9c7 None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb/users/f758597c91f6471282413bb314fa0521/roles/4258c5283ef14edba6c29f6e63fa1839` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:42.661316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25097bff-9a92-4c00-b0f5-d1e3574db9c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d63a9207a2804d7193433ab0ec5687eb, user_id=f758597c91f6471282413bb314fa0521, role_id=4258c5283ef14edba6c29f6e63fa1839)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:42.662981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25097bff-9a92-4c00-b0f5-d1e3574db9c7 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:42.685630 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 143/286] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:19:42 2022] PUT /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb/users/f758597c91f6471282413bb314fa0521/roles/4258c5283ef14edba6c29f6e63fa1839 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:19:43.073817 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2900a42-c1b8-44da-a287-38fb89cd8f1b None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:43.074090 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2900a42-c1b8-44da-a287-38fb89cd8f1b None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:43.074370 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2900a42-c1b8-44da-a287-38fb89cd8f1b None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:43.075758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 144/287] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:43.081903 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c6766-ceb7-443f-960b-13314a578790 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:43.082434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c6766-ceb7-443f-960b-13314a578790 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:43.082939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c6766-ceb7-443f-960b-13314a578790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:43.102774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-a85c6766-ceb7-443f-960b-13314a578790 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:43.104932 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-a85c6766-ceb7-443f-960b-13314a578790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:43.175895 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 144/288] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:43.198414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2900a42-c1b8-44da-a287-38fb89cd8f1b None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:43.316086 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2900a42-c1b8-44da-a287-38fb89cd8f1b None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:43.350711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78198a-3cec-4d17-b876-bb0e7520a896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:43.351722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78198a-3cec-4d17-b876-bb0e7520a896 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:43.352142 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78198a-3cec-4d17-b876-bb0e7520a896 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:43.352574 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78198a-3cec-4d17-b876-bb0e7520a896 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:43.363106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78198a-3cec-4d17-b876-bb0e7520a896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:43.371028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-9b78198a-3cec-4d17-b876-bb0e7520a896 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:43.371028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:43.371028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:43.371028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:43.371028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:43.371028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:43.371028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:43.371028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:43.371028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:43.371028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:43.371028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:43.371028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:43.371028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:43.371028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:43.371028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:43.371028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:43.372039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:43.372039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:43.372039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:43.372039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:43.372039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:43.372039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:43.372039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:43.372039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:43.372039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:43.372039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:43.372039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:43.372039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:43.372039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:43.372039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:43.372039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:43.372039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:43.373041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:43.373041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:43.373041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:43.373041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:43.373041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:43.373041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:43.373041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:43.373041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:43.373041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:43.373041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:43.373041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:43.373041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:43.374925 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 145/289] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:43.380929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c6766-ceb7-443f-960b-13314a578790 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:43.571094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c6766-ceb7-443f-960b-13314a578790 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:43.617831 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524af08-b798-466d-bd99-79750c907d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:43.618485 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524af08-b798-466d-bd99-79750c907d9e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:43.618828 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524af08-b798-466d-bd99-79750c907d9e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:43.619106 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524af08-b798-466d-bd99-79750c907d9e None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:43.619986 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524af08-b798-466d-bd99-79750c907d9e None admin] RBAC: Adding query filter params (name=member) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:43.620321 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524af08-b798-466d-bd99-79750c907d9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:43.621752 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524af08-b798-466d-bd99-79750c907d9e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:43.630128 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 145/290] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:43.635787 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78198a-3cec-4d17-b876-bb0e7520a896 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:43.756012 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78198a-3cec-4d17-b876-bb0e7520a896 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:43.798378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae7922-d0ea-4a96-823b-f808f0d7e02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:43.799615 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae7922-d0ea-4a96-823b-f808f0d7e02d None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:43.800130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae7922-d0ea-4a96-823b-f808f0d7e02d None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:43.800662 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae7922-d0ea-4a96-823b-f808f0d7e02d None admin] PATH_INFO: `/v3/users/2210d96e89dc40be82fec394b47a55b2` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:43.802068 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae7922-d0ea-4a96-823b-f808f0d7e02d None admin] RBAC: Authorizing `identity:get_user(user_id=2210d96e89dc40be82fec394b47a55b2)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:43.803729 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae7922-d0ea-4a96-823b-f808f0d7e02d None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:43.805920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 146/291] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:43 2022] GET /identity/v3/users/2210d96e89dc40be82fec394b47a55b2 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:43.811736 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524af08-b798-466d-bd99-79750c907d9e None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:44.000659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524af08-b798-466d-bd99-79750c907d9e None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:44.049794 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bd058-a2dc-4409-8b67-d488b64d4295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:44.050849 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bd058-a2dc-4409-8b67-d488b64d4295 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:44.051342 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bd058-a2dc-4409-8b67-d488b64d4295 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:44.051825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bd058-a2dc-4409-8b67-d488b64d4295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:44.132776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bd058-a2dc-4409-8b67-d488b64d4295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:44.134642 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bd058-a2dc-4409-8b67-d488b64d4295 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:44.235601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 146/292] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:19:44.240985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae7922-d0ea-4a96-823b-f808f0d7e02d None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:44.417572 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae7922-d0ea-4a96-823b-f808f0d7e02d None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:44.452063 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75931cfc-0e81-4457-b264-785a4fc411a8 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:44.452411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75931cfc-0e81-4457-b264-785a4fc411a8 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:44.452638 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75931cfc-0e81-4457-b264-785a4fc411a8 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:44.454793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 147/293] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:44.462236 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880bc9d-779f-4280-a141-80d396a2a2d7 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:44.462861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880bc9d-779f-4280-a141-80d396a2a2d7 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:44.464315 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880bc9d-779f-4280-a141-80d396a2a2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:44.464616 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba58bd-3e08-4c2b-b99e-756cf475c67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:44.465499 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba58bd-3e08-4c2b-b99e-756cf475c67e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:44.465779 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba58bd-3e08-4c2b-b99e-756cf475c67e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:44.466049 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba58bd-3e08-4c2b-b99e-756cf475c67e None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:44.467301 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba58bd-3e08-4c2b-b99e-756cf475c67e None admin] RBAC: Authorizing `identity:get_project(project_id=d63a9207a2804d7193433ab0ec5687eb)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:44.468800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba58bd-3e08-4c2b-b99e-756cf475c67e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:44.470844 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 147/294] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:44 2022] GET /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:44.481506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba58bd-3e08-4c2b-b99e-756cf475c67e None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:44.499537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-5880bc9d-779f-4280-a141-80d396a2a2d7 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:44.500775 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-5880bc9d-779f-4280-a141-80d396a2a2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:44.598725 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 148/295] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:44.632198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880bc9d-779f-4280-a141-80d396a2a2d7 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:44.660219 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba58bd-3e08-4c2b-b99e-756cf475c67e None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:44.694660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a77b03-24cc-4e1f-a794-2a265911b5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:44.695549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a77b03-24cc-4e1f-a794-2a265911b5c2 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:44.695969 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a77b03-24cc-4e1f-a794-2a265911b5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:44.696380 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a77b03-24cc-4e1f-a794-2a265911b5c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:44.697365 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a77b03-24cc-4e1f-a794-2a265911b5c2 None admin] RBAC: Adding query filter params (role.id=4bc18e5c60c043ae8d42db9c4e9cd438, scope.project.id=d63a9207a2804d7193433ab0ec5687eb, user.id=2210d96e89dc40be82fec394b47a55b2) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:44.697919 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a77b03-24cc-4e1f-a794-2a265911b5c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:44.699506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a77b03-24cc-4e1f-a794-2a265911b5c2 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:44.705715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 148/296] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:19:44 2022] GET /identity/v3/role_assignments?user.id=2210d96e89dc40be82fec394b47a55b2&scope.project.id=d63a9207a2804d7193433ab0ec5687eb&role.id=4bc18e5c60c043ae8d42db9c4e9cd438 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:44.714799 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923695-89bc-4cf6-8e0d-fcd173cfffa5 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:44.715092 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923695-89bc-4cf6-8e0d-fcd173cfffa5 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:44.715559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923695-89bc-4cf6-8e0d-fcd173cfffa5 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:44.718048 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 149/297] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:44.719502 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee927f-f013-450d-9b60-39a476538d7c None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:44.719787 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee927f-f013-450d-9b60-39a476538d7c None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:44.720062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee927f-f013-450d-9b60-39a476538d7c None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:44.724740 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 150/298] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:44.726255 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f559a-7bce-444b-bc99-3ac89c36238a None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:44.726547 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f559a-7bce-444b-bc99-3ac89c36238a None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:44.726828 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f559a-7bce-444b-bc99-3ac89c36238a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:44.757745 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-f01f559a-7bce-444b-bc99-3ac89c36238a None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:44.759130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f01f559a-7bce-444b-bc99-3ac89c36238a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:44.765079 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880bc9d-779f-4280-a141-80d396a2a2d7 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:44.801830 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781b55a-4193-450c-8bfa-ec506655ff0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:44.802934 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781b55a-4193-450c-8bfa-ec506655ff0b None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:44.803361 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781b55a-4193-450c-8bfa-ec506655ff0b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:44.803778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781b55a-4193-450c-8bfa-ec506655ff0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:44.818123 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781b55a-4193-450c-8bfa-ec506655ff0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:44.829577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-5781b55a-4193-450c-8bfa-ec506655ff0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:44.829577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:44.829577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:44.829577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:44.829577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:44.829577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:44.829577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:44.829577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:44.829577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:44.829577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:44.829577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:44.829577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:44.829577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:44.829577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:44.829577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:44.829577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:44.830687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:44.830687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:44.830687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:44.830687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:44.830687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:44.830687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:44.830687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:44.830687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:44.830687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:44.830687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:44.830687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:44.830687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:44.830687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:44.830687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:44.830687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:44.830687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:44.831538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:44.831538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:44.831538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:44.831538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:44.831538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:44.831538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:44.831538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:44.831538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:44.831538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:44.831538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:44.831538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:44.831538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:44.833861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 149/299] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:19:44.835622 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac675e-2b3c-4f88-91a5-fbf0305762cf None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:44.836082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac675e-2b3c-4f88-91a5-fbf0305762cf None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:44.836568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac675e-2b3c-4f88-91a5-fbf0305762cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:44.848680 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 151/300] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:44.848680 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f559a-7bce-444b-bc99-3ac89c36238a None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:44.881453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-84ac675e-2b3c-4f88-91a5-fbf0305762cf None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:44.883054 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-84ac675e-2b3c-4f88-91a5-fbf0305762cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:44.957823 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f559a-7bce-444b-bc99-3ac89c36238a None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:44.966851 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 150/301] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:44.967738 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac675e-2b3c-4f88-91a5-fbf0305762cf None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:45.005171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07864cd9-a23b-431b-a1a5-15af04cfea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:45.005847 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07864cd9-a23b-431b-a1a5-15af04cfea6c None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:45.006131 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07864cd9-a23b-431b-a1a5-15af04cfea6c None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:45.006404 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07864cd9-a23b-431b-a1a5-15af04cfea6c None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:45.007907 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07864cd9-a23b-431b-a1a5-15af04cfea6c None admin] RBAC: Adding query filter params (name=member) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:45.007907 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07864cd9-a23b-431b-a1a5-15af04cfea6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:45.008871 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07864cd9-a23b-431b-a1a5-15af04cfea6c None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:45.017930 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 152/302] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:45.018754 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07864cd9-a23b-431b-a1a5-15af04cfea6c None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:45.083232 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac675e-2b3c-4f88-91a5-fbf0305762cf None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:45.113464 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07864cd9-a23b-431b-a1a5-15af04cfea6c None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:45.121232 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2b5bb-c8b9-442b-9ab6-b409bdb7bf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:45.122028 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2b5bb-c8b9-442b-9ab6-b409bdb7bf76 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:45.122308 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2b5bb-c8b9-442b-9ab6-b409bdb7bf76 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:45.122936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2b5bb-c8b9-442b-9ab6-b409bdb7bf76 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:45.133676 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2b5bb-c8b9-442b-9ab6-b409bdb7bf76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:45.141579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-d5f2b5bb-c8b9-442b-9ab6-b409bdb7bf76 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 06 23:19:45.141579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:45.141579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:45.141579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:45.141579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:45.141579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:45.141579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:45.141579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:45.141579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:45.141579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:45.141579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:45.141579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:45.141579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:45.141579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:45.141579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:45.141579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:45.142495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:45.142495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:45.142495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:45.142495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:45.142495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:45.142495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:45.142495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:45.142495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:45.142495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:45.142495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:45.142495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:45.142495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:45.142495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:45.142495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:45.142495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:45.142495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:45.143282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:45.143282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:45.143282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:45.143282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:45.143282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:45.143282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:45.143282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:45.143282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:45.143282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:45.143282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:45.143282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 06 23:19:45.143282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:45.143282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 151/303] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:45.144490 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2b5bb-c8b9-442b-9ab6-b409bdb7bf76 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:45.151111 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a970db-29ac-47fc-ab66-cc8b034a1b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:45.151910 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a970db-29ac-47fc-ab66-cc8b034a1b3c None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:45.152195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a970db-29ac-47fc-ab66-cc8b034a1b3c None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:45.152469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a970db-29ac-47fc-ab66-cc8b034a1b3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:45.153670 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a970db-29ac-47fc-ab66-cc8b034a1b3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:45.155139 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a970db-29ac-47fc-ab66-cc8b034a1b3c None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:45.161442 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 153/304] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:19:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:45.161442 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a970db-29ac-47fc-ab66-cc8b034a1b3c None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:45.246369 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2b5bb-c8b9-442b-9ab6-b409bdb7bf76 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:45.258590 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a970db-29ac-47fc-ab66-cc8b034a1b3c None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:45.278726 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b82a4-0d3b-4e2d-8e5a-24e474750259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:45.279600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b82a4-0d3b-4e2d-8e5a-24e474750259 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:45.279884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b82a4-0d3b-4e2d-8e5a-24e474750259 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:45.280229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b82a4-0d3b-4e2d-8e5a-24e474750259 None admin] PATH_INFO: `/v3/users/84e56154fcb54388b5a575aefb78ff52` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:45.281398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b82a4-0d3b-4e2d-8e5a-24e474750259 None admin] RBAC: Authorizing `identity:get_user(user_id=84e56154fcb54388b5a575aefb78ff52)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:45.282882 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b82a4-0d3b-4e2d-8e5a-24e474750259 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:45.288888 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 152/305] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:45 2022] GET /identity/v3/users/84e56154fcb54388b5a575aefb78ff52 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:45.288888 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b82a4-0d3b-4e2d-8e5a-24e474750259 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:45.295934 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d628f-3853-4661-9ca8-47e6e30fda3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:45.296618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d628f-3853-4661-9ca8-47e6e30fda3f None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:45.296900 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d628f-3853-4661-9ca8-47e6e30fda3f None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:45.297171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d628f-3853-4661-9ca8-47e6e30fda3f None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:45.297910 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d628f-3853-4661-9ca8-47e6e30fda3f None admin] RBAC: Adding query filter params (name=reader) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:45.298214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d628f-3853-4661-9ca8-47e6e30fda3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:45.299580 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d628f-3853-4661-9ca8-47e6e30fda3f None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:45.307742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 154/306] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:45.308498 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d628f-3853-4661-9ca8-47e6e30fda3f None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:45.387309 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b82a4-0d3b-4e2d-8e5a-24e474750259 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:45.405051 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d628f-3853-4661-9ca8-47e6e30fda3f None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:45.422460 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b3793-4f67-457e-9d19-b851d7af10da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:45.423131 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b3793-4f67-457e-9d19-b851d7af10da None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:45.423414 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b3793-4f67-457e-9d19-b851d7af10da None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:45.423690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b3793-4f67-457e-9d19-b851d7af10da None admin] PATH_INFO: `/v3/groups` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:45.424415 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b3793-4f67-457e-9d19-b851d7af10da None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:45.425895 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b3793-4f67-457e-9d19-b851d7af10da None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:45.440124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b115bed-7502-4860-867f-97305b492cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:45.441034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b115bed-7502-4860-867f-97305b492cbe None admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:45.441309 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 153/307] 10.222.0.60 () {60 vars in 1134 bytes} [Fri May 6 23:19:45 2022] POST /identity/v3/groups => generated 229 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:19:45.441408 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b115bed-7502-4860-867f-97305b492cbe None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:45.441584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b115bed-7502-4860-867f-97305b492cbe None admin] PATH_INFO: `/v3/system/users/84e56154fcb54388b5a575aefb78ff52/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:45.443066 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b115bed-7502-4860-867f-97305b492cbe None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=84e56154fcb54388b5a575aefb78ff52, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:45.444516 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b115bed-7502-4860-867f-97305b492cbe None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:45.449871 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b3793-4f67-457e-9d19-b851d7af10da None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:45.457051 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 155/308] 10.222.0.60 () {58 vars in 1334 bytes} [Fri May 6 23:19:45 2022] PUT /identity/v3/system/users/84e56154fcb54388b5a575aefb78ff52/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:19:45.581215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168095b-9bf0-4bfd-ba2c-42aad18b74e0 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:45.581451 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168095b-9bf0-4bfd-ba2c-42aad18b74e0 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:45.581681 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168095b-9bf0-4bfd-ba2c-42aad18b74e0 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:45.583422 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 156/309] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:19:45.585052 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b3793-4f67-457e-9d19-b851d7af10da None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:45.589669 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbc9ad-f4d1-4ebe-a995-a5975349daf1 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:45.590019 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbc9ad-f4d1-4ebe-a995-a5975349daf1 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:45.590229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbc9ad-f4d1-4ebe-a995-a5975349daf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:45.608772 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-46bbc9ad-f4d1-4ebe-a995-a5975349daf1 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:45.610008 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-46bbc9ad-f4d1-4ebe-a995-a5975349daf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:45.627883 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2389d6-4e6a-488e-ab41-2d4931bdedb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:45.629252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2389d6-4e6a-488e-ab41-2d4931bdedb7 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:45.629849 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2389d6-4e6a-488e-ab41-2d4931bdedb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:45.630351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2389d6-4e6a-488e-ab41-2d4931bdedb7 None admin] PATH_INFO: `/v3/users/d8079c949ad64dcc80045cd8750fbaa9` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:45.647744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2389d6-4e6a-488e-ab41-2d4931bdedb7 None admin] RBAC: Authorizing `identity:get_user(user_id=d8079c949ad64dcc80045cd8750fbaa9)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:45.649625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2389d6-4e6a-488e-ab41-2d4931bdedb7 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:45.651997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 154/310] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:45 2022] GET /identity/v3/users/d8079c949ad64dcc80045cd8750fbaa9 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:45.657675 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2389d6-4e6a-488e-ab41-2d4931bdedb7 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:45.684131 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 157/311] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:45.707488 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbc9ad-f4d1-4ebe-a995-a5975349daf1 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:45.778807 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2389d6-4e6a-488e-ab41-2d4931bdedb7 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:45.817915 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbc9ad-f4d1-4ebe-a995-a5975349daf1 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:45.821829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3954b-aa2c-4b1b-945d-7b52948f9997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:45.823247 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3954b-aa2c-4b1b-945d-7b52948f9997 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:45.823712 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3954b-aa2c-4b1b-945d-7b52948f9997 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:45.824196 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3954b-aa2c-4b1b-945d-7b52948f9997 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:45.825256 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3954b-aa2c-4b1b-945d-7b52948f9997 None admin] RBAC: Adding query filter params (role.id=4258c5283ef14edba6c29f6e63fa1839, user.id=d8079c949ad64dcc80045cd8750fbaa9, scope.system=all) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:45.825754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3954b-aa2c-4b1b-945d-7b52948f9997 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:45.827384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3954b-aa2c-4b1b-945d-7b52948f9997 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:45.840642 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 155/312] 10.222.0.60 () {56 vars in 1308 bytes} [Fri May 6 23:19:45 2022] GET /identity/v3/role_assignments?user.id=d8079c949ad64dcc80045cd8750fbaa9&scope.system=all&role.id=4258c5283ef14edba6c29f6e63fa1839 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:45.870176 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302b621-4250-48b1-919c-49d606b02f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:45.871037 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302b621-4250-48b1-919c-49d606b02f42 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:45.871320 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302b621-4250-48b1-919c-49d606b02f42 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:45.871592 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302b621-4250-48b1-919c-49d606b02f42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:45.883292 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9302b621-4250-48b1-919c-49d606b02f42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:45.891861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-9302b621-4250-48b1-919c-49d606b02f42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 06 23:19:45.891861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:45.891861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:45.891861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:45.891861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:45.891861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:45.891861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:45.891861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:45.891861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:45.891861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:45.891861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:45.891861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:45.891861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:45.891861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:45.891861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:45.891861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:45.892814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:45.892814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:45.892814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:45.892814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:45.892814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:45.892814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:45.892814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:45.892814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:45.892814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:45.892814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:45.892814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:45.892814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:45.892814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:45.892814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:45.892814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:45.892814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:45.893600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:45.893600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:45.893600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:45.893600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:45.893600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:45.893600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:45.893600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:45.893600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:45.893600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:45.893600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:45.893600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 06 23:19:45.893600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:45.893600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 158/313] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:19:45.899293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3954b-aa2c-4b1b-945d-7b52948f9997 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:46.009062 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3954b-aa2c-4b1b-945d-7b52948f9997 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:46.046147 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e041e-e239-48b6-962b-9014717e8509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:46.046819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e041e-e239-48b6-962b-9014717e8509 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:46.047102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e041e-e239-48b6-962b-9014717e8509 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:46.047376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e041e-e239-48b6-962b-9014717e8509 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:46.048135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e041e-e239-48b6-962b-9014717e8509 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:46.048441 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e041e-e239-48b6-962b-9014717e8509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:46.049851 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e041e-e239-48b6-962b-9014717e8509 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:46.059173 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 156/314] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:46.064682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302b621-4250-48b1-919c-49d606b02f42 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:46.175945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302b621-4250-48b1-919c-49d606b02f42 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:46.208453 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494a048-83c8-42ec-9f11-9774e7d1ae13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:46.209416 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494a048-83c8-42ec-9f11-9774e7d1ae13 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:46.209698 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494a048-83c8-42ec-9f11-9774e7d1ae13 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:46.209970 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494a048-83c8-42ec-9f11-9774e7d1ae13 None admin] PATH_INFO: `/v3/users/f758597c91f6471282413bb314fa0521` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:46.211169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494a048-83c8-42ec-9f11-9774e7d1ae13 None admin] RBAC: Authorizing `identity:get_user(user_id=f758597c91f6471282413bb314fa0521)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:46.212651 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494a048-83c8-42ec-9f11-9774e7d1ae13 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:46.214796 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 159/315] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:46 2022] GET /identity/v3/users/f758597c91f6471282413bb314fa0521 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:46.220565 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e041e-e239-48b6-962b-9014717e8509 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:46.329250 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e041e-e239-48b6-962b-9014717e8509 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:46.363624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796701b-41b1-42e0-a49f-3bc3f07e0c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:46.364277 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796701b-41b1-42e0-a49f-3bc3f07e0c77 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:46.364580 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796701b-41b1-42e0-a49f-3bc3f07e0c77 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:46.364863 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796701b-41b1-42e0-a49f-3bc3f07e0c77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:46.433504 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796701b-41b1-42e0-a49f-3bc3f07e0c77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:46.435659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796701b-41b1-42e0-a49f-3bc3f07e0c77 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:46.534267 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 157/316] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:19:46.539857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494a048-83c8-42ec-9f11-9774e7d1ae13 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:46.640567 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494a048-83c8-42ec-9f11-9774e7d1ae13 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:46.675728 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2369d4-66a1-409c-b6d3-831acb6ccd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:46.676653 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2369d4-66a1-409c-b6d3-831acb6ccd64 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:46.676935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2369d4-66a1-409c-b6d3-831acb6ccd64 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:46.677206 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2369d4-66a1-409c-b6d3-831acb6ccd64 None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:46.678531 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2369d4-66a1-409c-b6d3-831acb6ccd64 None admin] RBAC: Authorizing `identity:get_project(project_id=d63a9207a2804d7193433ab0ec5687eb)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:46.680138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2369d4-66a1-409c-b6d3-831acb6ccd64 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:46.682387 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 160/317] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:46 2022] GET /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:46.688345 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796701b-41b1-42e0-a49f-3bc3f07e0c77 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:46.788785 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796701b-41b1-42e0-a49f-3bc3f07e0c77 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:46.822503 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc587a-8b6b-4a43-b941-e29d92cc5956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:46.828282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc587a-8b6b-4a43-b941-e29d92cc5956 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:46.828594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc587a-8b6b-4a43-b941-e29d92cc5956 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:46.828874 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc587a-8b6b-4a43-b941-e29d92cc5956 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:46.829731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc587a-8b6b-4a43-b941-e29d92cc5956 None admin] RBAC: Adding query filter params (role.id=4258c5283ef14edba6c29f6e63fa1839, scope.project.id=d63a9207a2804d7193433ab0ec5687eb, user.id=f758597c91f6471282413bb314fa0521) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:46.830044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc587a-8b6b-4a43-b941-e29d92cc5956 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:46.831489 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc587a-8b6b-4a43-b941-e29d92cc5956 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:46.851551 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 158/318] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:19:46 2022] GET /identity/v3/role_assignments?user.id=f758597c91f6471282413bb314fa0521&scope.project.id=d63a9207a2804d7193433ab0ec5687eb&role.id=4258c5283ef14edba6c29f6e63fa1839 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:47.742744 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41406a-8616-480d-8782-67c88df966a3 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:47.743260 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41406a-8616-480d-8782-67c88df966a3 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:47.743260 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41406a-8616-480d-8782-67c88df966a3 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:47.745774 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 161/319] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:47.751519 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516f6b9-b633-4248-837c-509db4ebca15 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:47.751973 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516f6b9-b633-4248-837c-509db4ebca15 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:47.752069 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516f6b9-b633-4248-837c-509db4ebca15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:47.769662 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-9516f6b9-b633-4248-837c-509db4ebca15 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:47.771152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-9516f6b9-b633-4248-837c-509db4ebca15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:47.783873 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6c63e-ca5b-4937-96f7-64b921c59efa None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:47.784161 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6c63e-ca5b-4937-96f7-64b921c59efa None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:47.784439 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6c63e-ca5b-4937-96f7-64b921c59efa None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:47.785850 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 162/320] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:19:47.790871 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef1764-8422-4449-aa08-7f3c8e8ddf7d None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:47.791145 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef1764-8422-4449-aa08-7f3c8e8ddf7d None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:47.791844 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef1764-8422-4449-aa08-7f3c8e8ddf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:47.811079 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-ffef1764-8422-4449-aa08-7f3c8e8ddf7d None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:47.812254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-ffef1764-8422-4449-aa08-7f3c8e8ddf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:47.841123 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 159/321] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:47.864056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516f6b9-b633-4248-837c-509db4ebca15 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:47.884892 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 163/322] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:47.906813 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef1764-8422-4449-aa08-7f3c8e8ddf7d None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:47.967389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516f6b9-b633-4248-837c-509db4ebca15 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:48.000124 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502827a-4058-4806-88fa-53003acf4f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:48.000869 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502827a-4058-4806-88fa-53003acf4f45 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:48.001153 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502827a-4058-4806-88fa-53003acf4f45 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:48.001434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502827a-4058-4806-88fa-53003acf4f45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:48.007932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef1764-8422-4449-aa08-7f3c8e8ddf7d None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:48.011762 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502827a-4058-4806-88fa-53003acf4f45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:48.019469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-9502827a-4058-4806-88fa-53003acf4f45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:48.019469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:48.019469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:48.019469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:48.019469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:48.019469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:48.019469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:48.019469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:48.019469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:48.019469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:48.019469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:48.019469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:48.019469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:48.019469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:48.019469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:48.019469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:48.020524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:48.020524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:48.020524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:48.020524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:48.020524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:48.020524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:48.020524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:48.020524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:48.020524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:48.020524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:48.020524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:48.020524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:48.020524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:48.020524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:48.020524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:48.020524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:48.021344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:48.021344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:48.021344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:48.021344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:48.021344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:48.021344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:48.021344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:48.021344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:48.021344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:48.021344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:48.021344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:48.021344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:48.021344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 160/323] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:19:48.026870 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502827a-4058-4806-88fa-53003acf4f45 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:48.045773 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8585ad-d84c-477b-bf6b-58a1141d25ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:48.046564 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8585ad-d84c-477b-bf6b-58a1141d25ff None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:48.046846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8585ad-d84c-477b-bf6b-58a1141d25ff None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:48.047118 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8585ad-d84c-477b-bf6b-58a1141d25ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:48.048290 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8585ad-d84c-477b-bf6b-58a1141d25ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:48.049789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8585ad-d84c-477b-bf6b-58a1141d25ff None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:48.056301 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 164/324] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:19:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:48.057275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8585ad-d84c-477b-bf6b-58a1141d25ff None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:48.135627 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502827a-4058-4806-88fa-53003acf4f45 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:48.157122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8585ad-d84c-477b-bf6b-58a1141d25ff None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:48.167740 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e721f9f-6927-4432-80e5-4881e6535fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:48.168394 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e721f9f-6927-4432-80e5-4881e6535fb8 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:48.168697 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e721f9f-6927-4432-80e5-4881e6535fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:48.168970 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e721f9f-6927-4432-80e5-4881e6535fb8 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:48.169715 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e721f9f-6927-4432-80e5-4881e6535fb8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:48.170012 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e721f9f-6927-4432-80e5-4881e6535fb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:48.171378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e721f9f-6927-4432-80e5-4881e6535fb8 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:48.178963 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 161/325] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:48.180235 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331d7db-77ef-4916-977b-d923caf45144 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:48.180514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331d7db-77ef-4916-977b-d923caf45144 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:48.180817 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331d7db-77ef-4916-977b-d923caf45144 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:48.182053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 162/326] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:48.184295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331d7db-77ef-4916-977b-d923caf45144 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:48.189175 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06dd0d-86f5-4d98-a833-a1827a27b76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:48.189840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06dd0d-86f5-4d98-a833-a1827a27b76a None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:48.190121 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06dd0d-86f5-4d98-a833-a1827a27b76a None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:48.190392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06dd0d-86f5-4d98-a833-a1827a27b76a None admin] PATH_INFO: `/v3/groups` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:48.191091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06dd0d-86f5-4d98-a833-a1827a27b76a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:48.192630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06dd0d-86f5-4d98-a833-a1827a27b76a None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:48.207611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 165/327] 10.222.0.60 () {60 vars in 1134 bytes} [Fri May 6 23:19:48 2022] POST /identity/v3/groups => generated 226 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:19:48.208856 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fffc8-7d7c-42ee-98ff-d064d7f303d4 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:48.209132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fffc8-7d7c-42ee-98ff-d064d7f303d4 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:48.209408 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fffc8-7d7c-42ee-98ff-d064d7f303d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:48.227842 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-410fffc8-7d7c-42ee-98ff-d064d7f303d4 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:48.229661 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-410fffc8-7d7c-42ee-98ff-d064d7f303d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:48.294744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331d7db-77ef-4916-977b-d923caf45144 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:48.300316 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 166/328] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:48.323179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fffc8-7d7c-42ee-98ff-d064d7f303d4 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:48.333151 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0fb64-cf5b-446d-a43a-38788f856ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:48.334046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0fb64-cf5b-446d-a43a-38788f856ce7 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:48.334333 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0fb64-cf5b-446d-a43a-38788f856ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:48.334607 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0fb64-cf5b-446d-a43a-38788f856ce7 None admin] PATH_INFO: `/v3/users/84e56154fcb54388b5a575aefb78ff52` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:48.335853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0fb64-cf5b-446d-a43a-38788f856ce7 None admin] RBAC: Authorizing `identity:get_user(user_id=84e56154fcb54388b5a575aefb78ff52)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:48.337378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0fb64-cf5b-446d-a43a-38788f856ce7 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:48.344907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 163/329] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:48 2022] GET /identity/v3/users/84e56154fcb54388b5a575aefb78ff52 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:48.345800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0fb64-cf5b-446d-a43a-38788f856ce7 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:48.430706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fffc8-7d7c-42ee-98ff-d064d7f303d4 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:48.462112 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0fb64-cf5b-446d-a43a-38788f856ce7 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:48.468712 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9546a2f-ee79-4f91-bcbc-4d766fe9d3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:48.469506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9546a2f-ee79-4f91-bcbc-4d766fe9d3b7 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:48.469783 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9546a2f-ee79-4f91-bcbc-4d766fe9d3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:48.470476 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9546a2f-ee79-4f91-bcbc-4d766fe9d3b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:48.482535 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9546a2f-ee79-4f91-bcbc-4d766fe9d3b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:48.490276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-f9546a2f-ee79-4f91-bcbc-4d766fe9d3b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 06 23:19:48.490276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:48.490276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:48.490276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:48.490276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:48.490276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:48.490276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:48.490276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:48.490276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:48.490276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:48.490276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:48.490276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:48.490276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:48.490276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:48.490276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:48.490276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:48.491162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:48.491162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:48.491162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:48.491162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:48.491162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:48.491162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:48.491162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:48.491162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:48.491162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:48.491162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:48.491162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:48.491162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:48.491162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:48.491162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:48.491162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:48.491162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:48.492157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:48.492157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:48.492157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:48.492157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:48.492157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:48.492157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:48.492157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:48.492157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:48.492157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:48.492157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:48.492157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 06 23:19:48.492157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:48.492157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 167/330] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:19:48.497767 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9546a2f-ee79-4f91-bcbc-4d766fe9d3b7 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:48.507076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4af41e-a4e1-4c15-8a0d-15fea253cdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:48.508034 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4af41e-a4e1-4c15-8a0d-15fea253cdff None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:48.508570 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4af41e-a4e1-4c15-8a0d-15fea253cdff None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:48.509064 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4af41e-a4e1-4c15-8a0d-15fea253cdff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:48.510147 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4af41e-a4e1-4c15-8a0d-15fea253cdff None admin] RBAC: Adding query filter params (role.id=4bc18e5c60c043ae8d42db9c4e9cd438, user.id=84e56154fcb54388b5a575aefb78ff52, scope.system=all) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:48.510663 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4af41e-a4e1-4c15-8a0d-15fea253cdff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:48.512314 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4af41e-a4e1-4c15-8a0d-15fea253cdff None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:48.526278 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 164/331] 10.222.0.60 () {56 vars in 1308 bytes} [Fri May 6 23:19:48 2022] GET /identity/v3/role_assignments?user.id=84e56154fcb54388b5a575aefb78ff52&scope.system=all&role.id=4bc18e5c60c043ae8d42db9c4e9cd438 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:48.609704 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9546a2f-ee79-4f91-bcbc-4d766fe9d3b7 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:48.647450 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ce8cd-8068-44f4-ad22-4c2f8ec2fdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:48.648493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ce8cd-8068-44f4-ad22-4c2f8ec2fdef None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:48.649027 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ce8cd-8068-44f4-ad22-4c2f8ec2fdef None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:48.649526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ce8cd-8068-44f4-ad22-4c2f8ec2fdef None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:48.650485 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ce8cd-8068-44f4-ad22-4c2f8ec2fdef None admin] RBAC: Adding query filter params (name=reader) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:48.651041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ce8cd-8068-44f4-ad22-4c2f8ec2fdef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:48.652657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ce8cd-8068-44f4-ad22-4c2f8ec2fdef None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:48.662883 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 168/332] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:48.668887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4af41e-a4e1-4c15-8a0d-15fea253cdff None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:48.784771 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4af41e-a4e1-4c15-8a0d-15fea253cdff None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:48.819006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2dcf7c-38da-41b4-9d39-36cd40560893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:48.819885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2dcf7c-38da-41b4-9d39-36cd40560893 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:48.820164 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2dcf7c-38da-41b4-9d39-36cd40560893 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:48.820436 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2dcf7c-38da-41b4-9d39-36cd40560893 None admin] PATH_INFO: `/v3/users/d8079c949ad64dcc80045cd8750fbaa9` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:48.821669 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2dcf7c-38da-41b4-9d39-36cd40560893 None admin] RBAC: Authorizing `identity:get_user(user_id=d8079c949ad64dcc80045cd8750fbaa9)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:48.824675 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2dcf7c-38da-41b4-9d39-36cd40560893 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:48.826447 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 165/333] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:48 2022] GET /identity/v3/users/d8079c949ad64dcc80045cd8750fbaa9 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:48.833759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ce8cd-8068-44f4-ad22-4c2f8ec2fdef None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:48.943276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ce8cd-8068-44f4-ad22-4c2f8ec2fdef None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:48.977584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8feea-eee3-4b97-9639-0808261508d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:48.978449 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8feea-eee3-4b97-9639-0808261508d9 None admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:48.978727 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8feea-eee3-4b97-9639-0808261508d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:48.979527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8feea-eee3-4b97-9639-0808261508d9 None admin] PATH_INFO: `/v3/system/users/d8079c949ad64dcc80045cd8750fbaa9/roles/4258c5283ef14edba6c29f6e63fa1839` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:48.981043 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8feea-eee3-4b97-9639-0808261508d9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d8079c949ad64dcc80045cd8750fbaa9, role_id=4258c5283ef14edba6c29f6e63fa1839)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:48.982428 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8feea-eee3-4b97-9639-0808261508d9 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:48.992863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 169/334] 10.222.0.60 () {58 vars in 1334 bytes} [Fri May 6 23:19:48 2022] PUT /identity/v3/system/users/d8079c949ad64dcc80045cd8750fbaa9/roles/4258c5283ef14edba6c29f6e63fa1839 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:19:50.679778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c5894-1bfa-45c8-afa3-daf720d8d778 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:50.680837 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c5894-1bfa-45c8-afa3-daf720d8d778 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:50.681344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c5894-1bfa-45c8-afa3-daf720d8d778 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:50.682972 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 166/335] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:50.688295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bef43-149d-43bb-a76b-74f1faeca763 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:50.689220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bef43-149d-43bb-a76b-74f1faeca763 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:50.689701 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bef43-149d-43bb-a76b-74f1faeca763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:50.717668 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-751bef43-149d-43bb-a76b-74f1faeca763 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:50.719175 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-751bef43-149d-43bb-a76b-74f1faeca763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:50.801980 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 170/336] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:19:50.833243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c5894-1bfa-45c8-afa3-daf720d8d778 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:50.976099 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c5894-1bfa-45c8-afa3-daf720d8d778 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:51.013764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3107e4e-1e33-4908-bb9f-99ff0752ea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:51.014570 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3107e4e-1e33-4908-bb9f-99ff0752ea4b None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:51.014854 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3107e4e-1e33-4908-bb9f-99ff0752ea4b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:51.015134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3107e4e-1e33-4908-bb9f-99ff0752ea4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:51.030649 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3107e4e-1e33-4908-bb9f-99ff0752ea4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:51.038410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-f3107e4e-1e33-4908-bb9f-99ff0752ea4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:51.038410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:51.038410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:51.038410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:51.038410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:51.038410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:51.038410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:51.038410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:51.038410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:51.038410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:51.038410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:51.038410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:51.038410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:51.038410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:51.038410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:51.038410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:51.039272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:51.039272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:51.039272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:51.039272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:51.039272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:51.039272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:51.039272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:51.039272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:51.039272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:51.039272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:51.039272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:51.039272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:51.039272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:51.039272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:51.039272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:51.039272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:51.040033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:51.040033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:51.040033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:51.040033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:51.040033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:51.040033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:51.040033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:51.040033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:51.040033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:51.040033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:51.040033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:51.040033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:51.040033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 167/337] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:51.045978 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bef43-149d-43bb-a76b-74f1faeca763 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:51.174744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136dea36-3314-4392-979c-f08db51bb4e9 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:51.175026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136dea36-3314-4392-979c-f08db51bb4e9 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:51.175472 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136dea36-3314-4392-979c-f08db51bb4e9 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:51.177249 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 168/338] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:51.182708 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55660f94-5a04-4819-9834-c8aebf2a9e3a None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:51.183166 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55660f94-5a04-4819-9834-c8aebf2a9e3a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:51.183620 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55660f94-5a04-4819-9834-c8aebf2a9e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:51.209637 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bef43-149d-43bb-a76b-74f1faeca763 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:51.217539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-55660f94-5a04-4819-9834-c8aebf2a9e3a None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:51.218980 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-55660f94-5a04-4819-9834-c8aebf2a9e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:51.290214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea2254-b87a-45b3-b1df-00a1cdc5d2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:51.290897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea2254-b87a-45b3-b1df-00a1cdc5d2cc None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:51.291179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea2254-b87a-45b3-b1df-00a1cdc5d2cc None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:51.291512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea2254-b87a-45b3-b1df-00a1cdc5d2cc None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:51.292270 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea2254-b87a-45b3-b1df-00a1cdc5d2cc None admin] RBAC: Adding query filter params (name=member) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:51.292589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea2254-b87a-45b3-b1df-00a1cdc5d2cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:51.293997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea2254-b87a-45b3-b1df-00a1cdc5d2cc None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:51.312725 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 171/339] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:51.319642 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea2254-b87a-45b3-b1df-00a1cdc5d2cc None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:51.386933 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 169/340] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:19:51.434537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55660f94-5a04-4819-9834-c8aebf2a9e3a None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:51.486403 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea2254-b87a-45b3-b1df-00a1cdc5d2cc None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:51.521571 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e32e3-1e46-4523-90c1-146c3985908b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:51.522565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e32e3-1e46-4523-90c1-146c3985908b None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:51.523065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e32e3-1e46-4523-90c1-146c3985908b None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:51.523526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e32e3-1e46-4523-90c1-146c3985908b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:51.574088 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55660f94-5a04-4819-9834-c8aebf2a9e3a None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:51.621956 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e32e3-1e46-4523-90c1-146c3985908b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:51.623448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e32e3-1e46-4523-90c1-146c3985908b None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:51.646126 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2efd9-a90d-463e-a328-d81a8005a616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:51.646943 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2efd9-a90d-463e-a328-d81a8005a616 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:51.647227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2efd9-a90d-463e-a328-d81a8005a616 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:51.647499 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2efd9-a90d-463e-a328-d81a8005a616 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:51.681500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2efd9-a90d-463e-a328-d81a8005a616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:51.690439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-ebf2efd9-a90d-463e-a328-d81a8005a616 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:19:51.690439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:51.690439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:51.690439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:51.690439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:51.690439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:51.690439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:51.690439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:51.690439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:51.690439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:51.690439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:51.690439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:51.690439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:51.690439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:51.690439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:51.690439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:51.691303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:51.691303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:51.691303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:51.691303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:51.691303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:51.691303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:51.691303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:51.691303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:51.691303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:51.691303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:51.691303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:51.691303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:51.691303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:51.691303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:51.691303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:51.691303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:51.692085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:51.692085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:51.692085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:51.692085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:51.692085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:51.692085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:51.692085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:51.692085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:51.692085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:51.692085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:51.692085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:19:51.692085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:51.692719 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 170/341] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:19:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:19:51.697612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2efd9-a90d-463e-a328-d81a8005a616 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:51.738340 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 172/342] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:19:51.739642 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e32e3-1e46-4523-90c1-146c3985908b None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:51.834656 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2efd9-a90d-463e-a328-d81a8005a616 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:51.838885 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e32e3-1e46-4523-90c1-146c3985908b None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:51.876028 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6c4b8-6978-4b00-9ac4-b6a1b8b634a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:51.877121 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ab6d4-dbb9-41f9-b397-2a0fe21cfb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:51.877982 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ab6d4-dbb9-41f9-b397-2a0fe21cfb45 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:51.878262 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ab6d4-dbb9-41f9-b397-2a0fe21cfb45 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:51.878533 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ab6d4-dbb9-41f9-b397-2a0fe21cfb45 None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:51.879345 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6c4b8-6978-4b00-9ac4-b6a1b8b634a5 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:51.879618 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6c4b8-6978-4b00-9ac4-b6a1b8b634a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:51.879883 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6c4b8-6978-4b00-9ac4-b6a1b8b634a5 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:51.880664 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6c4b8-6978-4b00-9ac4-b6a1b8b634a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:51.880971 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6c4b8-6978-4b00-9ac4-b6a1b8b634a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:51.881717 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ab6d4-dbb9-41f9-b397-2a0fe21cfb45 None admin] RBAC: Authorizing `identity:get_project(project_id=0e884d4d1ec14a62a4ff4500b91183db)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:51.883180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ab6d4-dbb9-41f9-b397-2a0fe21cfb45 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:51.886938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6c4b8-6978-4b00-9ac4-b6a1b8b634a5 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:51.893874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 173/343] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:51 2022] GET /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:51.895471 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ab6d4-dbb9-41f9-b397-2a0fe21cfb45 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:51.909331 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 171/344] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:19:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:51.913803 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6c4b8-6978-4b00-9ac4-b6a1b8b634a5 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:52.083225 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ab6d4-dbb9-41f9-b397-2a0fe21cfb45 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:52.112493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6c4b8-6978-4b00-9ac4-b6a1b8b634a5 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:52.145429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64ff74-ef7b-418c-b42f-a403cfdda7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:52.146298 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64ff74-ef7b-418c-b42f-a403cfdda7c3 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:52.146579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64ff74-ef7b-418c-b42f-a403cfdda7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:52.146852 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64ff74-ef7b-418c-b42f-a403cfdda7c3 None admin] PATH_INFO: `/v3/groups/c9cb46662e9245f5b8283121aa5aa220` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:52.165266 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b071e33-00fb-42a2-ad38-d03f24ae213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:52.165937 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b071e33-00fb-42a2-ad38-d03f24ae213c None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:52.166249 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b071e33-00fb-42a2-ad38-d03f24ae213c None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:52.166560 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b071e33-00fb-42a2-ad38-d03f24ae213c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:52.168493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64ff74-ef7b-418c-b42f-a403cfdda7c3 None admin] RBAC: Authorizing `identity:get_group(group_id=c9cb46662e9245f5b8283121aa5aa220)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:52.170027 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64ff74-ef7b-418c-b42f-a403cfdda7c3 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:52.171846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 174/345] 10.222.0.60 () {56 vars in 1180 bytes} [Fri May 6 23:19:51 2022] GET /identity/v3/groups/c9cb46662e9245f5b8283121aa5aa220 => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:52.173114 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8c89f-03a6-4ac3-94cb-30fc3b483233 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:52.173396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8c89f-03a6-4ac3-94cb-30fc3b483233 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:52.173669 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8c89f-03a6-4ac3-94cb-30fc3b483233 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:52.178065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 175/346] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:52.185678 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c675ef9-5e9b-4a62-b484-f95e23375db9 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:52.185999 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c675ef9-5e9b-4a62-b484-f95e23375db9 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:52.186238 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c675ef9-5e9b-4a62-b484-f95e23375db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:52.214555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-6c675ef9-5e9b-4a62-b484-f95e23375db9 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:52.215751 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-6c675ef9-5e9b-4a62-b484-f95e23375db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:52.312178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b071e33-00fb-42a2-ad38-d03f24ae213c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:52.313774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b071e33-00fb-42a2-ad38-d03f24ae213c None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:52.317487 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 176/347] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:52.318545 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c675ef9-5e9b-4a62-b484-f95e23375db9 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:52.453355 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c675ef9-5e9b-4a62-b484-f95e23375db9 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:52.497785 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c352b0-86d4-4b0e-a7da-7f6e6dea2c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:52.498445 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c352b0-86d4-4b0e-a7da-7f6e6dea2c42 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:52.498723 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c352b0-86d4-4b0e-a7da-7f6e6dea2c42 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:52.498990 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c352b0-86d4-4b0e-a7da-7f6e6dea2c42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:52.499818 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c352b0-86d4-4b0e-a7da-7f6e6dea2c42 None admin] RBAC: Adding query filter params (group.id=c9cb46662e9245f5b8283121aa5aa220, role.id=4bc18e5c60c043ae8d42db9c4e9cd438, scope.project.id=0e884d4d1ec14a62a4ff4500b91183db) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:52.500123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c352b0-86d4-4b0e-a7da-7f6e6dea2c42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:52.501598 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c352b0-86d4-4b0e-a7da-7f6e6dea2c42 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:52.510180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 177/348] 10.222.0.60 () {56 vars in 1376 bytes} [Fri May 6 23:19:52 2022] GET /identity/v3/role_assignments?group.id=c9cb46662e9245f5b8283121aa5aa220&scope.project.id=0e884d4d1ec14a62a4ff4500b91183db&role.id=4bc18e5c60c043ae8d42db9c4e9cd438 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:52.518426 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c352b0-86d4-4b0e-a7da-7f6e6dea2c42 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:52.535691 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 172/349] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:19:52.545730 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b071e33-00fb-42a2-ad38-d03f24ae213c None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:52.671921 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c352b0-86d4-4b0e-a7da-7f6e6dea2c42 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:52.694323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b071e33-00fb-42a2-ad38-d03f24ae213c None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:52.711819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd14c9-8767-492c-93b6-cbf36ffb2ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:52.712689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd14c9-8767-492c-93b6-cbf36ffb2ec9 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:52.712907 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd14c9-8767-492c-93b6-cbf36ffb2ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:52.713306 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd14c9-8767-492c-93b6-cbf36ffb2ec9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:52.727881 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd14c9-8767-492c-93b6-cbf36ffb2ec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:52.736217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-9dbd14c9-8767-492c-93b6-cbf36ffb2ec9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:52.736217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:52.736217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:52.736217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:52.736217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:52.736217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:52.736217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:52.736217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:52.736217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:52.736217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:52.736217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:52.736217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:52.736217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:52.736217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:52.736217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:52.736217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:52.737229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:52.737229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:52.737229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:52.737229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:52.737229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:52.737229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:52.737229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:52.737229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:52.737229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:52.737229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:52.737229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:52.737229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:52.737229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:52.737229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:52.737229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:52.737229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:52.738024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:52.738024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:52.738024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:52.738024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:52.738024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:52.738024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:52.738024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:52.738024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:52.738024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:52.738024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:52.738024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:52.738024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:52.738024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 178/350] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:52.740457 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506236a8-0b6e-4600-8d47-6140e57375ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:52.741645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506236a8-0b6e-4600-8d47-6140e57375ff None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:52.742161 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506236a8-0b6e-4600-8d47-6140e57375ff None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:52.742712 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506236a8-0b6e-4600-8d47-6140e57375ff None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:52.743978 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18232498-842e-4fb8-81ee-6f55dbe56bad None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:52.744276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18232498-842e-4fb8-81ee-6f55dbe56bad None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:52.744649 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18232498-842e-4fb8-81ee-6f55dbe56bad None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:52.745095 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506236a8-0b6e-4600-8d47-6140e57375ff None admin] RBAC: Authorizing `identity:get_project(project_id=0e884d4d1ec14a62a4ff4500b91183db)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:52.746474 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 179/351] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:52.746982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506236a8-0b6e-4600-8d47-6140e57375ff None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:52.747567 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18232498-842e-4fb8-81ee-6f55dbe56bad None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:52.749410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 173/352] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:52 2022] GET /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:52.751921 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f3d98-bb72-45f6-b059-cbc553eedfa7 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:52.752426 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f3d98-bb72-45f6-b059-cbc553eedfa7 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:52.752945 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f3d98-bb72-45f6-b059-cbc553eedfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:52.773124 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-540f3d98-bb72-45f6-b059-cbc553eedfa7 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:52.774685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-540f3d98-bb72-45f6-b059-cbc553eedfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:52.859980 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18232498-842e-4fb8-81ee-6f55dbe56bad None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:52.861784 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 174/353] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:19:52.862877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f3d98-bb72-45f6-b059-cbc553eedfa7 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:52.895573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a1c0b-a182-4f3a-89eb-ad1a0970b643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:52.896235 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a1c0b-a182-4f3a-89eb-ad1a0970b643 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:52.896734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a1c0b-a182-4f3a-89eb-ad1a0970b643 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:52.897150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a1c0b-a182-4f3a-89eb-ad1a0970b643 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:52.898052 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a1c0b-a182-4f3a-89eb-ad1a0970b643 None admin] RBAC: Adding query filter params (name=member) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:52.898497 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a1c0b-a182-4f3a-89eb-ad1a0970b643 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:52.900080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a1c0b-a182-4f3a-89eb-ad1a0970b643 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:52.910135 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 180/354] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:52.915576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a1c0b-a182-4f3a-89eb-ad1a0970b643 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:52.964617 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f3d98-bb72-45f6-b059-cbc553eedfa7 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:52.999004 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec9088-2492-4268-a065-25ae7c37f3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:53.000064 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec9088-2492-4268-a065-25ae7c37f3e2 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:53.000355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec9088-2492-4268-a065-25ae7c37f3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:53.000654 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec9088-2492-4268-a065-25ae7c37f3e2 None admin] PATH_INFO: `/v3/groups/c9cb46662e9245f5b8283121aa5aa220` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:53.002157 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec9088-2492-4268-a065-25ae7c37f3e2 None admin] RBAC: Authorizing `identity:get_group(group_id=c9cb46662e9245f5b8283121aa5aa220)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:53.003585 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec9088-2492-4268-a065-25ae7c37f3e2 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:53.005875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 175/355] 10.222.0.60 () {56 vars in 1180 bytes} [Fri May 6 23:19:52 2022] GET /identity/v3/groups/c9cb46662e9245f5b8283121aa5aa220 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:53.006749 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec9088-2492-4268-a065-25ae7c37f3e2 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:53.019817 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a1c0b-a182-4f3a-89eb-ad1a0970b643 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:53.056431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ec296-f02d-410c-9807-bf498045dd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:53.058132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ec296-f02d-410c-9807-bf498045dd6f None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:53.058612 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ec296-f02d-410c-9807-bf498045dd6f None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:53.059101 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ec296-f02d-410c-9807-bf498045dd6f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:53.071993 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ec296-f02d-410c-9807-bf498045dd6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:53.081152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-b79ec296-f02d-410c-9807-bf498045dd6f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 06 23:19:53.081152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:53.081152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:53.081152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:53.081152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:53.081152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:53.081152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:53.081152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:53.081152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:53.081152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:53.081152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:53.081152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:53.081152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:53.081152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:53.081152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:53.081152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:53.082100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:53.082100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:53.082100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:53.082100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:53.082100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:53.082100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:53.082100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:53.082100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:53.082100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:53.082100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:53.082100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:53.082100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:53.082100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:53.082100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:53.082100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:53.082100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:53.082887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:53.082887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:53.082887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:53.082887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:53.082887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:53.082887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:53.082887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:53.082887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:53.082887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:53.082887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:53.082887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 06 23:19:53.082887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:53.085468 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 181/356] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:53.086738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ec296-f02d-410c-9807-bf498045dd6f None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:53.123285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec9088-2492-4268-a065-25ae7c37f3e2 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:53.169484 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e8395-8814-4a45-ae12-83e7c15ccf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:53.170144 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e8395-8814-4a45-ae12-83e7c15ccf26 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:53.170428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e8395-8814-4a45-ae12-83e7c15ccf26 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:53.170694 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e8395-8814-4a45-ae12-83e7c15ccf26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:53.223406 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ec296-f02d-410c-9807-bf498045dd6f None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:53.258265 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e8395-8814-4a45-ae12-83e7c15ccf26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:53.260650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e8395-8814-4a45-ae12-83e7c15ccf26 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:53.266478 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6964df-95cc-4bfc-86c0-7683ea761a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:53.267455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6964df-95cc-4bfc-86c0-7683ea761a5e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:53.267935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6964df-95cc-4bfc-86c0-7683ea761a5e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:53.268414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6964df-95cc-4bfc-86c0-7683ea761a5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:53.271033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6964df-95cc-4bfc-86c0-7683ea761a5e None admin] RBAC: Adding query filter params (group.id=c9cb46662e9245f5b8283121aa5aa220, role.id=2cfb5ae0e4244117845519425cb9235e, scope.project.id=0e884d4d1ec14a62a4ff4500b91183db) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:53.271389 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6964df-95cc-4bfc-86c0-7683ea761a5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:53.272901 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6964df-95cc-4bfc-86c0-7683ea761a5e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:53.284993 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 182/357] 10.222.0.60 () {56 vars in 1376 bytes} [Fri May 6 23:19:53 2022] GET /identity/v3/role_assignments?group.id=c9cb46662e9245f5b8283121aa5aa220&scope.project.id=0e884d4d1ec14a62a4ff4500b91183db&role.id=2cfb5ae0e4244117845519425cb9235e => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:53.284993 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6964df-95cc-4bfc-86c0-7683ea761a5e None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:53.418258 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6964df-95cc-4bfc-86c0-7683ea761a5e None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:53.418690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 176/358] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:19:53.419747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ba30d-a457-4334-ba98-aa5edc9ea1f8 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:53.420073 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ba30d-a457-4334-ba98-aa5edc9ea1f8 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:53.420377 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ba30d-a457-4334-ba98-aa5edc9ea1f8 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:53.422021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 177/359] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:53.423108 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f7345-0135-4ed2-b9c1-4e3e7f34874d None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:53.423389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f7345-0135-4ed2-b9c1-4e3e7f34874d None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:53.423666 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f7345-0135-4ed2-b9c1-4e3e7f34874d None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:53.424912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 178/360] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:53.429530 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f7345-0135-4ed2-b9c1-4e3e7f34874d None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:53.469989 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33288620-4d85-482d-8095-34694cba5227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:53.470677 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33288620-4d85-482d-8095-34694cba5227 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:53.470961 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33288620-4d85-482d-8095-34694cba5227 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:53.471237 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33288620-4d85-482d-8095-34694cba5227 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:53.471996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33288620-4d85-482d-8095-34694cba5227 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:53.472305 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33288620-4d85-482d-8095-34694cba5227 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:53.473823 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33288620-4d85-482d-8095-34694cba5227 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:53.484700 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 183/361] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:53.486087 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5c7c5-b5b3-48ce-b430-16bb0cc7b36a None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:53.486380 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5c7c5-b5b3-48ce-b430-16bb0cc7b36a None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:53.486659 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5c7c5-b5b3-48ce-b430-16bb0cc7b36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:53.509978 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-99e5c7c5-b5b3-48ce-b430-16bb0cc7b36a None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:53.512507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-99e5c7c5-b5b3-48ce-b430-16bb0cc7b36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:53.548922 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f7345-0135-4ed2-b9c1-4e3e7f34874d None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:53.585056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ac5bb-5736-41e8-990c-d8d3ed839618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:53.585921 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ac5bb-5736-41e8-990c-d8d3ed839618 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:53.586207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ac5bb-5736-41e8-990c-d8d3ed839618 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:53.586494 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ac5bb-5736-41e8-990c-d8d3ed839618 None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:53.587799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ac5bb-5736-41e8-990c-d8d3ed839618 None admin] RBAC: Authorizing `identity:get_project(project_id=d63a9207a2804d7193433ab0ec5687eb)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:53.590217 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ac5bb-5736-41e8-990c-d8d3ed839618 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:53.591654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 184/362] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:53.592018 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 179/363] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:53 2022] GET /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:53.596578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ac5bb-5736-41e8-990c-d8d3ed839618 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:53.597905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83821565-4f8d-4005-9a00-15301b38d970 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:53.598206 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83821565-4f8d-4005-9a00-15301b38d970 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:53.598587 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83821565-4f8d-4005-9a00-15301b38d970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:53.629565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-83821565-4f8d-4005-9a00-15301b38d970 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:53.630918 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-83821565-4f8d-4005-9a00-15301b38d970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:53.699830 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ac5bb-5736-41e8-990c-d8d3ed839618 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:53.703478 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 185/364] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:53.704426 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83821565-4f8d-4005-9a00-15301b38d970 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:53.735668 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62d14e-5fc9-49e1-9e61-834b8b744184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:53.736783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62d14e-5fc9-49e1-9e61-834b8b744184 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:53.737283 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62d14e-5fc9-49e1-9e61-834b8b744184 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:53.737704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62d14e-5fc9-49e1-9e61-834b8b744184 None admin] PATH_INFO: `/v3/users/d8079c949ad64dcc80045cd8750fbaa9` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:53.739084 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62d14e-5fc9-49e1-9e61-834b8b744184 None admin] RBAC: Authorizing `identity:get_user(user_id=d8079c949ad64dcc80045cd8750fbaa9)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:53.740765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62d14e-5fc9-49e1-9e61-834b8b744184 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:53.742882 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 180/365] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:19:53 2022] GET /identity/v3/users/d8079c949ad64dcc80045cd8750fbaa9 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:53.743883 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62d14e-5fc9-49e1-9e61-834b8b744184 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:53.817189 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83821565-4f8d-4005-9a00-15301b38d970 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:53.849289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62d14e-5fc9-49e1-9e61-834b8b744184 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:53.854961 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7e2c6-8116-4019-b4bb-f525353cdcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:53.855899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7e2c6-8116-4019-b4bb-f525353cdcbb None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:53.856256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7e2c6-8116-4019-b4bb-f525353cdcbb None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:53.856651 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7e2c6-8116-4019-b4bb-f525353cdcbb None admin] PATH_INFO: `/v3/groups/c9cb46662e9245f5b8283121aa5aa220` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:53.857958 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7e2c6-8116-4019-b4bb-f525353cdcbb None admin] RBAC: Authorizing `identity:get_group(group_id=c9cb46662e9245f5b8283121aa5aa220)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:53.859441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7e2c6-8116-4019-b4bb-f525353cdcbb None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:53.861501 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 186/366] 10.222.0.60 () {56 vars in 1180 bytes} [Fri May 6 23:19:53 2022] GET /identity/v3/groups/c9cb46662e9245f5b8283121aa5aa220 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:53.862425 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7e2c6-8116-4019-b4bb-f525353cdcbb None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:53.886997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc615a5-4825-4076-9d7e-8d686ab02321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:53.888167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc615a5-4825-4076-9d7e-8d686ab02321 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:53.888864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc615a5-4825-4076-9d7e-8d686ab02321 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:53.890409 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc615a5-4825-4076-9d7e-8d686ab02321 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:53.906673 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc615a5-4825-4076-9d7e-8d686ab02321 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:53.917053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-adc615a5-4825-4076-9d7e-8d686ab02321 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:19:53.917053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:53.917053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:53.917053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:53.917053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:53.917053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:53.917053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:53.917053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:53.917053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:53.917053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:53.917053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:53.917053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:53.917053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:53.917053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:53.917053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:53.917053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:53.918008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:53.918008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:53.918008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:53.918008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:53.918008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:53.918008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:53.918008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:53.918008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:53.918008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:53.918008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:53.918008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:53.918008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:53.918008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:53.918008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:53.918008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:53.918008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:53.918860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:53.918860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:53.918860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:53.918860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:53.918860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:53.918860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:53.918860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:53.918860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:53.918860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:53.918860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:53.918860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:19:53.918860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:53.918860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 181/367] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:19:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:53.919619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc615a5-4825-4076-9d7e-8d686ab02321 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:53.999588 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7e2c6-8116-4019-b4bb-f525353cdcbb None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:54.036989 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc615a5-4825-4076-9d7e-8d686ab02321 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:54.037962 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d34642-2b45-40e7-8750-07b43e8134f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:54.039133 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d34642-2b45-40e7-8750-07b43e8134f3 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:54.039468 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d34642-2b45-40e7-8750-07b43e8134f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:54.039745 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d34642-2b45-40e7-8750-07b43e8134f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:54.051367 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d34642-2b45-40e7-8750-07b43e8134f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:54.059215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-d6d34642-2b45-40e7-8750-07b43e8134f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:54.059215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:54.059215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:54.059215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:54.059215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:54.059215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:54.059215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:54.059215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:54.059215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:54.059215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:54.059215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:54.059215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:54.059215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:54.059215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:54.059215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:54.059215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:54.060108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:54.060108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:54.060108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:54.060108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:54.060108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:54.060108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:54.060108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:54.060108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:54.060108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:54.060108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:54.060108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:54.060108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:54.060108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:54.060108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:54.060108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:54.060108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:54.060936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:54.060936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:54.060936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:54.060936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:54.060936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:54.060936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:54.060936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:54.060936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:54.060936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:54.060936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:54.060936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:54.060936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:54.060936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 187/368] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:19:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:54.061597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d34642-2b45-40e7-8750-07b43e8134f3 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:54.074331 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630470f-61ce-433d-b14d-6e35df0c908d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:54.075003 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630470f-61ce-433d-b14d-6e35df0c908d None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:54.075289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630470f-61ce-433d-b14d-6e35df0c908d None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:54.075567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630470f-61ce-433d-b14d-6e35df0c908d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:54.076409 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630470f-61ce-433d-b14d-6e35df0c908d None admin] RBAC: Adding query filter params (role.id=4258c5283ef14edba6c29f6e63fa1839, user.id=d8079c949ad64dcc80045cd8750fbaa9, scope.system=all) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:54.077274 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630470f-61ce-433d-b14d-6e35df0c908d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:54.078790 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630470f-61ce-433d-b14d-6e35df0c908d None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:54.091837 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 182/369] 10.222.0.60 () {56 vars in 1308 bytes} [Fri May 6 23:19:53 2022] GET /identity/v3/role_assignments?user.id=d8079c949ad64dcc80045cd8750fbaa9&scope.system=all&role.id=4258c5283ef14edba6c29f6e63fa1839 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:54.092713 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630470f-61ce-433d-b14d-6e35df0c908d None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:54.172401 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d34642-2b45-40e7-8750-07b43e8134f3 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:54.212203 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebd08d-0f91-4cdc-88a0-727fb1a0f62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:54.212898 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebd08d-0f91-4cdc-88a0-727fb1a0f62c None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:54.213997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebd08d-0f91-4cdc-88a0-727fb1a0f62c None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:54.214278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebd08d-0f91-4cdc-88a0-727fb1a0f62c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:54.215110 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebd08d-0f91-4cdc-88a0-727fb1a0f62c None admin] RBAC: Adding query filter params (group.id=c9cb46662e9245f5b8283121aa5aa220, role.id=4bc18e5c60c043ae8d42db9c4e9cd438, scope.project.id=d63a9207a2804d7193433ab0ec5687eb) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:54.215425 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebd08d-0f91-4cdc-88a0-727fb1a0f62c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:54.216922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebd08d-0f91-4cdc-88a0-727fb1a0f62c None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:54.228710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 188/370] 10.222.0.60 () {56 vars in 1376 bytes} [Fri May 6 23:19:54 2022] GET /identity/v3/role_assignments?group.id=c9cb46662e9245f5b8283121aa5aa220&scope.project.id=d63a9207a2804d7193433ab0ec5687eb&role.id=4bc18e5c60c043ae8d42db9c4e9cd438 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:54.229787 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebd08d-0f91-4cdc-88a0-727fb1a0f62c None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:54.249807 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630470f-61ce-433d-b14d-6e35df0c908d None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:54.310480 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79625f9a-b145-4c8f-a308-ec46cdfa108e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:54.311181 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79625f9a-b145-4c8f-a308-ec46cdfa108e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:54.311466 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79625f9a-b145-4c8f-a308-ec46cdfa108e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:54.311747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79625f9a-b145-4c8f-a308-ec46cdfa108e None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:54.312517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79625f9a-b145-4c8f-a308-ec46cdfa108e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:54.312850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79625f9a-b145-4c8f-a308-ec46cdfa108e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:54.314251 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79625f9a-b145-4c8f-a308-ec46cdfa108e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:54.331433 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 183/371] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:19:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:54.336884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79625f9a-b145-4c8f-a308-ec46cdfa108e None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:54.403397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebd08d-0f91-4cdc-88a0-727fb1a0f62c None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:54.470605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79625f9a-b145-4c8f-a308-ec46cdfa108e None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:54.490283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816b57e-d541-4745-ae06-3e784b1e1036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:54.490967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816b57e-d541-4745-ae06-3e784b1e1036 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:54.491247 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816b57e-d541-4745-ae06-3e784b1e1036 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:54.491516 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816b57e-d541-4745-ae06-3e784b1e1036 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:54.492273 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816b57e-d541-4745-ae06-3e784b1e1036 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:54.492597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816b57e-d541-4745-ae06-3e784b1e1036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:54.494016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816b57e-d541-4745-ae06-3e784b1e1036 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:54.512118 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 189/372] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:54.512768 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5726ca0-a632-42c9-88c5-135413b2caae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:54.513435 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726ca0-a632-42c9-88c5-135413b2caae None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:54.513711 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726ca0-a632-42c9-88c5-135413b2caae None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:54.513981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726ca0-a632-42c9-88c5-135413b2caae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:54.518723 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816b57e-d541-4745-ae06-3e784b1e1036 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:54.645198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5726ca0-a632-42c9-88c5-135413b2caae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:54.646701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5726ca0-a632-42c9-88c5-135413b2caae None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:54.704380 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816b57e-d541-4745-ae06-3e784b1e1036 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:54.766598 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6baa692-b920-47cf-a851-ffe8f9968550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:54.767584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baa692-b920-47cf-a851-ffe8f9968550 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:54.768070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baa692-b920-47cf-a851-ffe8f9968550 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:54.768529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baa692-b920-47cf-a851-ffe8f9968550 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:54.832592 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 184/373] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 06 23:19:54.838233 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5726ca0-a632-42c9-88c5-135413b2caae None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:54.870473 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6baa692-b920-47cf-a851-ffe8f9968550 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:54.872658 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6baa692-b920-47cf-a851-ffe8f9968550 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:54.992477 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 190/374] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:19:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:19:54.999827 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6baa692-b920-47cf-a851-ffe8f9968550 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:55.037681 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5726ca0-a632-42c9-88c5-135413b2caae None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:55.107285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6835f-26d8-4015-aef4-9519026f956e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:55.108591 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6835f-26d8-4015-aef4-9519026f956e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:55.109089 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6835f-26d8-4015-aef4-9519026f956e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:55.109595 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6835f-26d8-4015-aef4-9519026f956e None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:55.111741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6835f-26d8-4015-aef4-9519026f956e None admin] RBAC: Authorizing `identity:get_project(project_id=d63a9207a2804d7193433ab0ec5687eb)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:55.113443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6835f-26d8-4015-aef4-9519026f956e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:55.120507 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 185/375] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:54 2022] GET /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:55.126218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6835f-26d8-4015-aef4-9519026f956e None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:55.157754 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6baa692-b920-47cf-a851-ffe8f9968550 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:55.212231 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09f02b-c435-411f-91d6-bba08f1ba23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:55.213937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09f02b-c435-411f-91d6-bba08f1ba23d None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:55.214220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09f02b-c435-411f-91d6-bba08f1ba23d None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:55.214491 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09f02b-c435-411f-91d6-bba08f1ba23d None admin] PATH_INFO: `/v3/projects/6afc05c85d9a4c7da004b8027296012b` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:55.216213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09f02b-c435-411f-91d6-bba08f1ba23d None admin] RBAC: Authorizing `identity:get_project(project_id=6afc05c85d9a4c7da004b8027296012b)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:55.217342 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09f02b-c435-411f-91d6-bba08f1ba23d None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:55.223316 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 191/376] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:54 2022] GET /identity/v3/projects/6afc05c85d9a4c7da004b8027296012b => generated 344 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:55.224430 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09f02b-c435-411f-91d6-bba08f1ba23d None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:55.243855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6835f-26d8-4015-aef4-9519026f956e None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:55.284299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f28c76-4c51-4439-9b18-17e955e051d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:55.285560 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f28c76-4c51-4439-9b18-17e955e051d4 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:55.286048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f28c76-4c51-4439-9b18-17e955e051d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:55.286513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f28c76-4c51-4439-9b18-17e955e051d4 None admin] PATH_INFO: `/v3/groups/c9cb46662e9245f5b8283121aa5aa220` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:55.287946 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f28c76-4c51-4439-9b18-17e955e051d4 None admin] RBAC: Authorizing `identity:get_group(group_id=c9cb46662e9245f5b8283121aa5aa220)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:55.289620 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f28c76-4c51-4439-9b18-17e955e051d4 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:55.292077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 186/377] 10.222.0.60 () {56 vars in 1180 bytes} [Fri May 6 23:19:55 2022] GET /identity/v3/groups/c9cb46662e9245f5b8283121aa5aa220 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:55.297338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f28c76-4c51-4439-9b18-17e955e051d4 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:55.355628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09f02b-c435-411f-91d6-bba08f1ba23d None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:55.391112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc19189-6b40-4fa4-9d15-268a7a0f16df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:55.391953 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc19189-6b40-4fa4-9d15-268a7a0f16df None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:55.392245 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc19189-6b40-4fa4-9d15-268a7a0f16df None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:55.392519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc19189-6b40-4fa4-9d15-268a7a0f16df None admin] PATH_INFO: `/v3/groups/4512b607163b493e874c61ae76ca7578` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:55.397464 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc19189-6b40-4fa4-9d15-268a7a0f16df None admin] RBAC: Authorizing `identity:get_group(group_id=4512b607163b493e874c61ae76ca7578)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:55.398922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc19189-6b40-4fa4-9d15-268a7a0f16df None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:55.400990 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 192/378] 10.222.0.60 () {56 vars in 1180 bytes} [Fri May 6 23:19:55 2022] GET /identity/v3/groups/4512b607163b493e874c61ae76ca7578 => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:55.407724 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f28c76-4c51-4439-9b18-17e955e051d4 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:55.409295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc19189-6b40-4fa4-9d15-268a7a0f16df None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:55.442490 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7cd28-d8e5-4523-8997-8978b774d92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:55.443492 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7cd28-d8e5-4523-8997-8978b774d92b None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:55.443997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7cd28-d8e5-4523-8997-8978b774d92b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:55.444474 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7cd28-d8e5-4523-8997-8978b774d92b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:55.445564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7cd28-d8e5-4523-8997-8978b774d92b None admin] RBAC: Adding query filter params (group.id=c9cb46662e9245f5b8283121aa5aa220, role.id=2cfb5ae0e4244117845519425cb9235e, scope.project.id=d63a9207a2804d7193433ab0ec5687eb) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:55.446075 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7cd28-d8e5-4523-8997-8978b774d92b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:55.448226 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7cd28-d8e5-4523-8997-8978b774d92b None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:55.454520 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 187/379] 10.222.0.60 () {56 vars in 1376 bytes} [Fri May 6 23:19:55 2022] GET /identity/v3/role_assignments?group.id=c9cb46662e9245f5b8283121aa5aa220&scope.project.id=d63a9207a2804d7193433ab0ec5687eb&role.id=2cfb5ae0e4244117845519425cb9235e => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:55.498086 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8d1a5-4721-44a8-84e3-4bf40c768e42 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:55.498720 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8d1a5-4721-44a8-84e3-4bf40c768e42 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:55.499207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8d1a5-4721-44a8-84e3-4bf40c768e42 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:55.502319 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 188/380] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:19:55.508082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdc6c7-6473-48b4-9fc7-cd9b372f4a04 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:55.508705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdc6c7-6473-48b4-9fc7-cd9b372f4a04 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:55.509205 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdc6c7-6473-48b4-9fc7-cd9b372f4a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:55.531155 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-1cbdc6c7-6473-48b4-9fc7-cd9b372f4a04 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:55.533231 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-1cbdc6c7-6473-48b4-9fc7-cd9b372f4a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:55.535831 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc19189-6b40-4fa4-9d15-268a7a0f16df None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:55.578488 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c557b4f-6e74-4548-9ca1-e7305bd64e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:55.579125 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c557b4f-6e74-4548-9ca1-e7305bd64e92 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:55.579411 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c557b4f-6e74-4548-9ca1-e7305bd64e92 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:55.579686 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c557b4f-6e74-4548-9ca1-e7305bd64e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:55.580528 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c557b4f-6e74-4548-9ca1-e7305bd64e92 None admin] RBAC: Adding query filter params (group.id=4512b607163b493e874c61ae76ca7578, role.id=408ee9a3a38640a48dbcdb2c377efcd8, scope.project.id=6afc05c85d9a4c7da004b8027296012b) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:55.580866 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c557b4f-6e74-4548-9ca1-e7305bd64e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:55.582462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c557b4f-6e74-4548-9ca1-e7305bd64e92 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:55.590176 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 193/381] 10.222.0.60 () {56 vars in 1376 bytes} [Fri May 6 23:19:55 2022] GET /identity/v3/role_assignments?group.id=4512b607163b493e874c61ae76ca7578&scope.project.id=6afc05c85d9a4c7da004b8027296012b&role.id=408ee9a3a38640a48dbcdb2c377efcd8 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:55.624012 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 189/382] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:19:55.648393 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c557b4f-6e74-4548-9ca1-e7305bd64e92 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:55.779144 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c557b4f-6e74-4548-9ca1-e7305bd64e92 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:55.819986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d78399-1b93-4295-ab22-5d38070a38d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:55.820882 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d78399-1b93-4295-ab22-5d38070a38d2 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:55.821161 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d78399-1b93-4295-ab22-5d38070a38d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:55.821477 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d78399-1b93-4295-ab22-5d38070a38d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:55.833621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d78399-1b93-4295-ab22-5d38070a38d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:55.841996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-49d78399-1b93-4295-ab22-5d38070a38d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:55.841996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:55.841996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:55.841996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:55.841996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:55.841996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:55.841996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:55.841996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:55.841996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:55.841996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:55.841996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:55.841996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:55.841996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:55.841996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:55.841996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:55.841996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:55.842905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:55.842905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:55.842905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:55.842905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:55.842905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:55.842905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:55.842905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:55.842905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:55.842905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:55.842905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:55.842905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:55.842905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:55.842905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:55.842905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:55.842905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:55.842905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:55.843689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:55.843689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:55.843689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:55.843689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:55.843689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:55.843689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:55.843689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:55.843689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:55.843689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:55.843689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:55.843689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:55.843689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:55.843689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 194/383] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:55.849060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdc6c7-6473-48b4-9fc7-cd9b372f4a04 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:56.023552 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdc6c7-6473-48b4-9fc7-cd9b372f4a04 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:56.065829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b348c-b5d7-4c18-90a7-ab49b2764405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:56.066883 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b348c-b5d7-4c18-90a7-ab49b2764405 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:56.067397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b348c-b5d7-4c18-90a7-ab49b2764405 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:56.067881 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b348c-b5d7-4c18-90a7-ab49b2764405 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:56.068867 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b348c-b5d7-4c18-90a7-ab49b2764405 None admin] RBAC: Adding query filter params (name=member) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:56.069377 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b348c-b5d7-4c18-90a7-ab49b2764405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:56.070962 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b348c-b5d7-4c18-90a7-ab49b2764405 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:56.081082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 190/384] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:56.086442 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d78399-1b93-4295-ab22-5d38070a38d2 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:56.206903 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d78399-1b93-4295-ab22-5d38070a38d2 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:56.243435 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf006e4-15d1-41df-ad04-f8088ef0454f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:56.244335 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf006e4-15d1-41df-ad04-f8088ef0454f None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:56.244650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf006e4-15d1-41df-ad04-f8088ef0454f None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:56.244928 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf006e4-15d1-41df-ad04-f8088ef0454f None admin] PATH_INFO: `/v3/groups/c9cb46662e9245f5b8283121aa5aa220` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:56.246127 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf006e4-15d1-41df-ad04-f8088ef0454f None admin] RBAC: Authorizing `identity:get_group(group_id=c9cb46662e9245f5b8283121aa5aa220)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:56.247581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf006e4-15d1-41df-ad04-f8088ef0454f None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:56.249245 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 195/385] 10.222.0.60 () {56 vars in 1180 bytes} [Fri May 6 23:19:56 2022] GET /identity/v3/groups/c9cb46662e9245f5b8283121aa5aa220 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:56.254951 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b348c-b5d7-4c18-90a7-ab49b2764405 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:56.326802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ef155-d6ac-4355-a5c8-28fc31f15df2 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:56.327122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ef155-d6ac-4355-a5c8-28fc31f15df2 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:56.327357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ef155-d6ac-4355-a5c8-28fc31f15df2 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:56.329271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 196/386] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:19:56.334512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497aa24-e320-4f0c-8df1-bc510ae14691 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:56.334792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497aa24-e320-4f0c-8df1-bc510ae14691 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:56.335067 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497aa24-e320-4f0c-8df1-bc510ae14691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:56.354218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-7497aa24-e320-4f0c-8df1-bc510ae14691 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:56.355847 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-7497aa24-e320-4f0c-8df1-bc510ae14691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:56.434375 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 197/387] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:19:56.463171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497aa24-e320-4f0c-8df1-bc510ae14691 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:56.464785 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b348c-b5d7-4c18-90a7-ab49b2764405 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:56.543173 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828bc73-f20f-4eca-9d77-96de5a6dd37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:56.544389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828bc73-f20f-4eca-9d77-96de5a6dd37e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:56.545034 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828bc73-f20f-4eca-9d77-96de5a6dd37e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:56.545373 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828bc73-f20f-4eca-9d77-96de5a6dd37e None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:56.549401 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828bc73-f20f-4eca-9d77-96de5a6dd37e None admin] RBAC: Authorizing `identity:get_project(project_id=0e884d4d1ec14a62a4ff4500b91183db)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:56.551074 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828bc73-f20f-4eca-9d77-96de5a6dd37e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:56.556577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 191/388] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:56 2022] GET /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:56.560453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828bc73-f20f-4eca-9d77-96de5a6dd37e None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:56.579795 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497aa24-e320-4f0c-8df1-bc510ae14691 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:56.620825 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f520b8-fdf0-4b81-8973-5accc7dd1d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:56.622047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f520b8-fdf0-4b81-8973-5accc7dd1d15 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:56.622656 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f520b8-fdf0-4b81-8973-5accc7dd1d15 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:56.623226 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f520b8-fdf0-4b81-8973-5accc7dd1d15 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:56.636611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f520b8-fdf0-4b81-8973-5accc7dd1d15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:56.647015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-75f520b8-fdf0-4b81-8973-5accc7dd1d15 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:19:56.647015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:56.647015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:56.647015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:56.647015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:56.647015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:56.647015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:56.647015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:56.647015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:56.647015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:56.647015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:56.647015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:56.647015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:56.647015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:56.647015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:56.647015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:56.647908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:56.647908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:56.647908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:56.647908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:56.647908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:56.647908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:56.647908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:56.647908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:56.647908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:56.647908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:56.647908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:56.647908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:56.647908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:56.647908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:56.647908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:56.647908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:56.648722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:56.648722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:56.648722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:56.648722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:56.648722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:56.648722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:56.648722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:56.648722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:56.648722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:56.648722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:56.648722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:19:56.648722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:56.654853 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 198/389] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:19:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:19:56.661613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f520b8-fdf0-4b81-8973-5accc7dd1d15 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:56.758930 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828bc73-f20f-4eca-9d77-96de5a6dd37e None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:56.783928 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f520b8-fdf0-4b81-8973-5accc7dd1d15 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:56.801569 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c7215-331b-40d4-8452-55235a7025aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:56.802795 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c7215-331b-40d4-8452-55235a7025aa None admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:56.803321 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c7215-331b-40d4-8452-55235a7025aa None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:56.803701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c7215-331b-40d4-8452-55235a7025aa None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db/groups/c9cb46662e9245f5b8283121aa5aa220/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:56.814046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c7215-331b-40d4-8452-55235a7025aa None admin] RBAC: Authorizing `identity:create_grant(project_id=0e884d4d1ec14a62a4ff4500b91183db, group_id=c9cb46662e9245f5b8283121aa5aa220, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:56.816305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c7215-331b-40d4-8452-55235a7025aa None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:56.835849 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485da080-826a-45d7-9e76-41d436057288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:56.837305 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485da080-826a-45d7-9e76-41d436057288 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:56.837305 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485da080-826a-45d7-9e76-41d436057288 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:56.837305 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485da080-826a-45d7-9e76-41d436057288 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:56.842088 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485da080-826a-45d7-9e76-41d436057288 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:56.842508 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485da080-826a-45d7-9e76-41d436057288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:56.844097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485da080-826a-45d7-9e76-41d436057288 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:56.847636 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 192/390] 10.222.0.60 () {58 vars in 1442 bytes} [Fri May 6 23:19:56 2022] PUT /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db/groups/c9cb46662e9245f5b8283121aa5aa220/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:19:56.857783 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 199/391] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:19:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:56.865772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c7215-331b-40d4-8452-55235a7025aa None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:56.984305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c7215-331b-40d4-8452-55235a7025aa None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:57.023374 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a902593-490f-46af-83e2-27f82e8a2283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:57.024498 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a902593-490f-46af-83e2-27f82e8a2283 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:57.024974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a902593-490f-46af-83e2-27f82e8a2283 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:57.025409 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a902593-490f-46af-83e2-27f82e8a2283 None admin] PATH_INFO: `/v3/groups/c9cb46662e9245f5b8283121aa5aa220` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:57.026971 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a902593-490f-46af-83e2-27f82e8a2283 None admin] RBAC: Authorizing `identity:get_group(group_id=c9cb46662e9245f5b8283121aa5aa220)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:57.028626 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a902593-490f-46af-83e2-27f82e8a2283 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:57.030793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 193/392] 10.222.0.60 () {56 vars in 1180 bytes} [Fri May 6 23:19:56 2022] GET /identity/v3/groups/c9cb46662e9245f5b8283121aa5aa220 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:57.035988 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485da080-826a-45d7-9e76-41d436057288 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:57.142245 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485da080-826a-45d7-9e76-41d436057288 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:57.180865 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc9dc7-4504-4071-b795-880b7d33c001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:57.181835 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc9dc7-4504-4071-b795-880b7d33c001 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:57.182116 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc9dc7-4504-4071-b795-880b7d33c001 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:57.182390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc9dc7-4504-4071-b795-880b7d33c001 None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:57.184100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc9dc7-4504-4071-b795-880b7d33c001 None admin] RBAC: Authorizing `identity:get_project(project_id=0e884d4d1ec14a62a4ff4500b91183db)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:57.185579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc9dc7-4504-4071-b795-880b7d33c001 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:57.187578 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 200/393] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:57 2022] GET /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:57.193542 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a902593-490f-46af-83e2-27f82e8a2283 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:57.317245 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a902593-490f-46af-83e2-27f82e8a2283 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:57.351863 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe2940-c3f2-408a-8073-1499793fef37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:57.353220 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe2940-c3f2-408a-8073-1499793fef37 None admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:57.354330 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe2940-c3f2-408a-8073-1499793fef37 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:57.354815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe2940-c3f2-408a-8073-1499793fef37 None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db/groups/c9cb46662e9245f5b8283121aa5aa220/roles/2cfb5ae0e4244117845519425cb9235e` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:57.357235 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe2940-c3f2-408a-8073-1499793fef37 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e884d4d1ec14a62a4ff4500b91183db, group_id=c9cb46662e9245f5b8283121aa5aa220, role_id=2cfb5ae0e4244117845519425cb9235e)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:57.358918 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe2940-c3f2-408a-8073-1499793fef37 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:57.381806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 194/394] 10.222.0.60 () {58 vars in 1442 bytes} [Fri May 6 23:19:57 2022] PUT /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db/groups/c9cb46662e9245f5b8283121aa5aa220/roles/2cfb5ae0e4244117845519425cb9235e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:19:57.830428 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50486daa-58ec-41b6-a4db-a74c38be70c6 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:57.830816 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50486daa-58ec-41b6-a4db-a74c38be70c6 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:57.830990 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50486daa-58ec-41b6-a4db-a74c38be70c6 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:57.832675 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 201/395] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:57.838240 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72b4ca-d90c-4633-9987-fabb79ddf8ed None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:57.838775 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72b4ca-d90c-4633-9987-fabb79ddf8ed None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:57.839068 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72b4ca-d90c-4633-9987-fabb79ddf8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:57.865592 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-ec72b4ca-d90c-4633-9987-fabb79ddf8ed None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:57.866807 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-ec72b4ca-d90c-4633-9987-fabb79ddf8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:57.951078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 195/396] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:57.986326 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50486daa-58ec-41b6-a4db-a74c38be70c6 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:58.122445 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50486daa-58ec-41b6-a4db-a74c38be70c6 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:58.160717 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1d0a6-ee8a-42f3-97e1-f171544bc0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:58.161507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1d0a6-ee8a-42f3-97e1-f171544bc0c7 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:58.161779 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1d0a6-ee8a-42f3-97e1-f171544bc0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:58.162050 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1d0a6-ee8a-42f3-97e1-f171544bc0c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:58.178903 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1d0a6-ee8a-42f3-97e1-f171544bc0c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:58.187265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-77d1d0a6-ee8a-42f3-97e1-f171544bc0c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:58.187265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:58.187265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:58.187265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:58.187265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:58.187265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:58.187265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:58.187265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:58.187265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:58.187265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:58.187265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:58.187265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:58.187265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:58.187265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:58.187265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:58.187265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:58.188212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:58.188212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:58.188212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:58.188212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:58.188212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:58.188212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:58.188212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:58.188212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:58.188212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:58.188212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:58.188212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:58.188212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:58.188212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:58.188212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:58.188212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:58.188212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:58.189064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:58.189064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:58.189064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:58.189064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:58.189064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:58.189064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:58.189064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:58.189064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:58.189064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:58.189064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:58.189064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 06 23:19:58.189064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:58.189064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 202/397] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:58.197774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72b4ca-d90c-4633-9987-fabb79ddf8ed None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:58.321334 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72b4ca-d90c-4633-9987-fabb79ddf8ed None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:58.364052 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd05bc-a9a3-41a0-93cd-04e85325482b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:58.364779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd05bc-a9a3-41a0-93cd-04e85325482b None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:58.365117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd05bc-a9a3-41a0-93cd-04e85325482b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:58.365399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd05bc-a9a3-41a0-93cd-04e85325482b None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:58.366158 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd05bc-a9a3-41a0-93cd-04e85325482b None admin] RBAC: Adding query filter params (name=member) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:58.366469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd05bc-a9a3-41a0-93cd-04e85325482b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:58.367859 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd05bc-a9a3-41a0-93cd-04e85325482b None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:58.378315 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 196/398] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:19:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:58.383987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1d0a6-ee8a-42f3-97e1-f171544bc0c7 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:58.477786 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adec19-44ee-4d07-a074-71ef9c4b4424 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:58.478421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adec19-44ee-4d07-a074-71ef9c4b4424 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:58.479449 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adec19-44ee-4d07-a074-71ef9c4b4424 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:58.481326 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 197/399] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:58.487385 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a20168-069b-4390-a978-f5b42e9005c3 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:58.487991 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a20168-069b-4390-a978-f5b42e9005c3 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:58.488472 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a20168-069b-4390-a978-f5b42e9005c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:58.508046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-e0a20168-069b-4390-a978-f5b42e9005c3 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:58.509647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-e0a20168-069b-4390-a978-f5b42e9005c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:58.527780 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1d0a6-ee8a-42f3-97e1-f171544bc0c7 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:58.589848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 198/400] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:19:58.594206 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdd6bb-b924-4e17-ab45-bb7b92aeb92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:58.595057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdd6bb-b924-4e17-ab45-bb7b92aeb92a None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:58.595333 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdd6bb-b924-4e17-ab45-bb7b92aeb92a None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:58.595601 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdd6bb-b924-4e17-ab45-bb7b92aeb92a None admin] PATH_INFO: `/v3/groups/c9cb46662e9245f5b8283121aa5aa220` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:58.601240 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdd6bb-b924-4e17-ab45-bb7b92aeb92a None admin] RBAC: Authorizing `identity:get_group(group_id=c9cb46662e9245f5b8283121aa5aa220)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:58.602717 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdd6bb-b924-4e17-ab45-bb7b92aeb92a None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:58.605232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 203/401] 10.222.0.60 () {56 vars in 1180 bytes} [Fri May 6 23:19:58 2022] GET /identity/v3/groups/c9cb46662e9245f5b8283121aa5aa220 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:58.610674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a47f7-afb9-41a1-b864-e14c8f3ca373 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:58.611243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a47f7-afb9-41a1-b864-e14c8f3ca373 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:58.611765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a47f7-afb9-41a1-b864-e14c8f3ca373 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:58.613361 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 199/402] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:58.615079 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdd6bb-b924-4e17-ab45-bb7b92aeb92a None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:58.618627 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641852b-485b-49ca-9869-21c976479fda None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:58.619177 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641852b-485b-49ca-9869-21c976479fda None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:58.619718 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641852b-485b-49ca-9869-21c976479fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:58.641083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-a641852b-485b-49ca-9869-21c976479fda None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:58.642659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-a641852b-485b-49ca-9869-21c976479fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:58.736698 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdd6bb-b924-4e17-ab45-bb7b92aeb92a None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:58.740923 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 200/403] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:19:58.741815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641852b-485b-49ca-9869-21c976479fda None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:58.774310 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f5701-99f4-4444-9805-c5d9699c6f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:58.776074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f5701-99f4-4444-9805-c5d9699c6f3b None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:58.776641 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f5701-99f4-4444-9805-c5d9699c6f3b None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:58.777119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f5701-99f4-4444-9805-c5d9699c6f3b None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:58.780157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f5701-99f4-4444-9805-c5d9699c6f3b None admin] RBAC: Authorizing `identity:get_project(project_id=d63a9207a2804d7193433ab0ec5687eb)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:58.782161 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f5701-99f4-4444-9805-c5d9699c6f3b None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:58.784547 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 204/404] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:58 2022] GET /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:58.785859 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f5701-99f4-4444-9805-c5d9699c6f3b None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:58.878844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641852b-485b-49ca-9869-21c976479fda None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:58.902628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f5701-99f4-4444-9805-c5d9699c6f3b None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:58.912921 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62b42b-4237-4a7f-870d-b446cbca5ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:58.913717 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62b42b-4237-4a7f-870d-b446cbca5ab8 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:58.913997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62b42b-4237-4a7f-870d-b446cbca5ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:58.914272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62b42b-4237-4a7f-870d-b446cbca5ab8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:58.924978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62b42b-4237-4a7f-870d-b446cbca5ab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:58.933977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-ba62b42b-4237-4a7f-870d-b446cbca5ab8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:58.933977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:58.933977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:58.933977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:58.933977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:58.933977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:58.933977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:58.933977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:58.933977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:58.933977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:58.933977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:58.933977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:58.933977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:58.933977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:58.933977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:58.933977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:58.934861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:58.934861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:58.934861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:58.934861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:58.934861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:58.934861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:58.934861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:58.934861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:58.934861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:58.934861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:58.934861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:58.934861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:19:58.934861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:58.934861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:58.934861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:58.934861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:58.935651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:58.935651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:58.935651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:58.935651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:58.935651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:58.935651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:58.935651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:58.935651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:58.935651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:58.935651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:58.935651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:19:58.935651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:19:58.935651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 201/405] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:19:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:58.937264 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62b42b-4237-4a7f-870d-b446cbca5ab8 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:58.943692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11da1dd-68de-4fec-89f0-4ab4215b251d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:58.944515 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11da1dd-68de-4fec-89f0-4ab4215b251d None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:58.944828 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11da1dd-68de-4fec-89f0-4ab4215b251d None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:58.945163 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11da1dd-68de-4fec-89f0-4ab4215b251d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:58.956126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11da1dd-68de-4fec-89f0-4ab4215b251d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:19:58.965682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-e11da1dd-68de-4fec-89f0-4ab4215b251d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:19:58.965682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:19:58.965682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:19:58.965682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:19:58.965682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:19:58.965682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:19:58.965682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:19:58.965682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:19:58.965682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:19:58.965682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:19:58.965682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:19:58.965682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:19:58.965682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:19:58.965682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:19:58.965682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:19:58.965682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:19:58.967738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:19:58.967738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:19:58.967738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:19:58.967738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:19:58.967738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:19:58.967738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:19:58.967738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:19:58.967738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:19:58.967738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:19:58.967738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:19:58.967738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:19:58.967738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:19:58.967738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:19:58.967738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:19:58.967738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:19:58.967738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:19:58.969673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:19:58.969673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:19:58.969673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:19:58.969673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:19:58.969673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:19:58.969673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:19:58.969673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:19:58.969673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:19:58.969673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:19:58.969673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:19:58.969673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:19:58.969673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:19:58.969673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 205/406] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:19:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:19:58.969673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11da1dd-68de-4fec-89f0-4ab4215b251d None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:59.040520 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62b42b-4237-4a7f-870d-b446cbca5ab8 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:59.073422 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11da1dd-68de-4fec-89f0-4ab4215b251d None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:59.075809 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2e600-7ece-42e7-a861-ee13a4449b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:59.076724 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2e600-7ece-42e7-a861-ee13a4449b6e None admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:59.077000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2e600-7ece-42e7-a861-ee13a4449b6e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:59.077268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2e600-7ece-42e7-a861-ee13a4449b6e None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb/groups/c9cb46662e9245f5b8283121aa5aa220/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:59.079279 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2e600-7ece-42e7-a861-ee13a4449b6e None admin] RBAC: Authorizing `identity:create_grant(project_id=d63a9207a2804d7193433ab0ec5687eb, group_id=c9cb46662e9245f5b8283121aa5aa220, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:59.080763 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2e600-7ece-42e7-a861-ee13a4449b6e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:59.104013 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 202/407] 10.222.0.60 () {58 vars in 1442 bytes} [Fri May 6 23:19:58 2022] PUT /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb/groups/c9cb46662e9245f5b8283121aa5aa220/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:19:59.105188 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2e600-7ece-42e7-a861-ee13a4449b6e None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:59.122566 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88102b85-6980-486d-bc07-a215b439f246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:59.123256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88102b85-6980-486d-bc07-a215b439f246 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:59.123630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88102b85-6980-486d-bc07-a215b439f246 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:59.123912 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88102b85-6980-486d-bc07-a215b439f246 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:59.124752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88102b85-6980-486d-bc07-a215b439f246 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:59.125060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88102b85-6980-486d-bc07-a215b439f246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:59.126508 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88102b85-6980-486d-bc07-a215b439f246 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:59.138144 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 206/408] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:19:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:59.143959 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88102b85-6980-486d-bc07-a215b439f246 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:59.223722 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2e600-7ece-42e7-a861-ee13a4449b6e None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:59.265182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7d95b-3762-405f-b055-7eb731605e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:59.265874 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7d95b-3762-405f-b055-7eb731605e04 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:59.266156 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7d95b-3762-405f-b055-7eb731605e04 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:59.266433 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7d95b-3762-405f-b055-7eb731605e04 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:59.267211 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7d95b-3762-405f-b055-7eb731605e04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:19:59.267590 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7d95b-3762-405f-b055-7eb731605e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:59.269091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7d95b-3762-405f-b055-7eb731605e04 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:59.275791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88102b85-6980-486d-bc07-a215b439f246 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:59.278166 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 203/409] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:19:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:59.285498 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7d95b-3762-405f-b055-7eb731605e04 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:59.313787 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b248bf2-4547-44e4-b144-db4cc7ff0c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:59.315008 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b248bf2-4547-44e4-b144-db4cc7ff0c7b None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:59.315490 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b248bf2-4547-44e4-b144-db4cc7ff0c7b None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:59.315991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b248bf2-4547-44e4-b144-db4cc7ff0c7b None admin] PATH_INFO: `/v3/groups/4512b607163b493e874c61ae76ca7578` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:59.317533 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b248bf2-4547-44e4-b144-db4cc7ff0c7b None admin] RBAC: Authorizing `identity:get_group(group_id=4512b607163b493e874c61ae76ca7578)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:59.319243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b248bf2-4547-44e4-b144-db4cc7ff0c7b None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:59.321602 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 207/410] 10.222.0.60 () {56 vars in 1180 bytes} [Fri May 6 23:19:59 2022] GET /identity/v3/groups/4512b607163b493e874c61ae76ca7578 => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:19:59.330245 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b248bf2-4547-44e4-b144-db4cc7ff0c7b None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:59.404631 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7d95b-3762-405f-b055-7eb731605e04 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:59.445849 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737cdb9-399b-4f00-a515-705ee47df175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:59.446734 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737cdb9-399b-4f00-a515-705ee47df175 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:59.447789 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737cdb9-399b-4f00-a515-705ee47df175 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:59.447955 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737cdb9-399b-4f00-a515-705ee47df175 None admin] PATH_INFO: `/v3/groups/c9cb46662e9245f5b8283121aa5aa220` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:59.449126 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737cdb9-399b-4f00-a515-705ee47df175 None admin] RBAC: Authorizing `identity:get_group(group_id=c9cb46662e9245f5b8283121aa5aa220)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:59.450544 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737cdb9-399b-4f00-a515-705ee47df175 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:59.456571 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 204/411] 10.222.0.60 () {56 vars in 1180 bytes} [Fri May 6 23:19:59 2022] GET /identity/v3/groups/c9cb46662e9245f5b8283121aa5aa220 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:59.459047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b248bf2-4547-44e4-b144-db4cc7ff0c7b None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:59.477697 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737cdb9-399b-4f00-a515-705ee47df175 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:59.500948 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0c2c9-246b-4038-9548-1577c7b203b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:59.501858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0c2c9-246b-4038-9548-1577c7b203b0 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:59.502233 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0c2c9-246b-4038-9548-1577c7b203b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:59.502563 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0c2c9-246b-4038-9548-1577c7b203b0 None admin] PATH_INFO: `/v3/projects/6afc05c85d9a4c7da004b8027296012b` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:59.504260 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0c2c9-246b-4038-9548-1577c7b203b0 None admin] RBAC: Authorizing `identity:get_project(project_id=6afc05c85d9a4c7da004b8027296012b)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:59.506095 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0c2c9-246b-4038-9548-1577c7b203b0 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:59.509054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 208/412] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:59 2022] GET /identity/v3/projects/6afc05c85d9a4c7da004b8027296012b => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:59.516567 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0c2c9-246b-4038-9548-1577c7b203b0 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:59.674907 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0c2c9-246b-4038-9548-1577c7b203b0 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:59.683223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737cdb9-399b-4f00-a515-705ee47df175 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:59.713507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5269af-bbb5-44aa-922f-7cd2b87e1138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:59.714650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5269af-bbb5-44aa-922f-7cd2b87e1138 None admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:59.714933 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5269af-bbb5-44aa-922f-7cd2b87e1138 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:59.715203 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5269af-bbb5-44aa-922f-7cd2b87e1138 None admin] PATH_INFO: `/v3/projects/6afc05c85d9a4c7da004b8027296012b/groups/4512b607163b493e874c61ae76ca7578/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:59.717363 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5269af-bbb5-44aa-922f-7cd2b87e1138 None admin] RBAC: Authorizing `identity:create_grant(project_id=6afc05c85d9a4c7da004b8027296012b, group_id=4512b607163b493e874c61ae76ca7578, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:59.719313 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5269af-bbb5-44aa-922f-7cd2b87e1138 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:59.738657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 209/413] 10.222.0.60 () {58 vars in 1442 bytes} [Fri May 6 23:19:59 2022] PUT /identity/v3/projects/6afc05c85d9a4c7da004b8027296012b/groups/4512b607163b493e874c61ae76ca7578/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:19:59.755800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04448597-4412-4121-ab4d-bdf1bf828718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:59.756763 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04448597-4412-4121-ab4d-bdf1bf828718 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:59.757046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04448597-4412-4121-ab4d-bdf1bf828718 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:59.757323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04448597-4412-4121-ab4d-bdf1bf828718 None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:59.758636 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04448597-4412-4121-ab4d-bdf1bf828718 None admin] RBAC: Authorizing `identity:get_project(project_id=d63a9207a2804d7193433ab0ec5687eb)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:59.760219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04448597-4412-4121-ab4d-bdf1bf828718 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:19:59.762326 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 205/414] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:19:59 2022] GET /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:19:59.769505 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5269af-bbb5-44aa-922f-7cd2b87e1138 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:19:59.866913 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92599e72-e6cd-4b2a-a798-e76e96f08433 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:59.867537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92599e72-e6cd-4b2a-a798-e76e96f08433 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:59.868009 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92599e72-e6cd-4b2a-a798-e76e96f08433 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:59.870034 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 206/415] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:19:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:19:59.876645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bbbb3-b7cf-4885-b8f6-85486656d25f None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:59.877277 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bbbb3-b7cf-4885-b8f6-85486656d25f None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:59.877760 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bbbb3-b7cf-4885-b8f6-85486656d25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:59.908816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-7d0bbbb3-b7cf-4885-b8f6-85486656d25f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:19:59.908816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-7d0bbbb3-b7cf-4885-b8f6-85486656d25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:19:59.929130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5269af-bbb5-44aa-922f-7cd2b87e1138 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:19:59.982978 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59651acf-7a9c-497b-bd48-2568fb6b8720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:19:59.983859 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59651acf-7a9c-497b-bd48-2568fb6b8720 None admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:19:59.984142 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59651acf-7a9c-497b-bd48-2568fb6b8720 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:19:59.984416 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59651acf-7a9c-497b-bd48-2568fb6b8720 None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb/groups/c9cb46662e9245f5b8283121aa5aa220/roles/2cfb5ae0e4244117845519425cb9235e` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:19:59.986880 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59651acf-7a9c-497b-bd48-2568fb6b8720 None admin] RBAC: Authorizing `identity:create_grant(project_id=d63a9207a2804d7193433ab0ec5687eb, group_id=c9cb46662e9245f5b8283121aa5aa220, role_id=2cfb5ae0e4244117845519425cb9235e)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:19:59.988332 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59651acf-7a9c-497b-bd48-2568fb6b8720 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:00.004780 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 210/416] 10.222.0.60 () {58 vars in 1442 bytes} [Fri May 6 23:19:59 2022] PUT /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb/groups/c9cb46662e9245f5b8283121aa5aa220/roles/2cfb5ae0e4244117845519425cb9235e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:20:00.006758 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 207/417] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:19:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:20:00.031193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59651acf-7a9c-497b-bd48-2568fb6b8720 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:00.142866 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59651acf-7a9c-497b-bd48-2568fb6b8720 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:00.178652 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a436fb8-8e7e-4a06-9e7e-a6a095586684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:00.179743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a436fb8-8e7e-4a06-9e7e-a6a095586684 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:00.180164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a436fb8-8e7e-4a06-9e7e-a6a095586684 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:00.180641 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a436fb8-8e7e-4a06-9e7e-a6a095586684 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:00.197033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a436fb8-8e7e-4a06-9e7e-a6a095586684 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:00.205630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-2a436fb8-8e7e-4a06-9e7e-a6a095586684 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 06 23:20:00.205630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:00.205630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:00.205630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:00.205630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:00.205630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:00.205630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:00.205630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:00.205630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:00.205630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:00.205630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:00.205630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:00.205630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:00.205630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:00.205630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:00.205630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:00.206792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:00.206792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:00.206792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:00.206792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:00.206792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:00.206792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:00.206792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:00.206792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:00.206792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:00.206792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:00.206792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:00.206792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:00.206792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:00.206792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:00.206792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:00.206792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:00.207756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:00.207756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:00.207756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:00.207756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:00.207756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:00.207756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:00.207756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:00.207756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:00.207756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:00.207756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:00.207756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 06 23:20:00.207756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:00.216454 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bbbb3-b7cf-4885-b8f6-85486656d25f None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:00.216757 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 211/418] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:20:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:00.377482 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bbbb3-b7cf-4885-b8f6-85486656d25f None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:00.411146 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e41ce-efb3-49b7-886b-99a8faf2cb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:00.411820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e41ce-efb3-49b7-886b-99a8faf2cb37 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:00.412102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e41ce-efb3-49b7-886b-99a8faf2cb37 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:00.412379 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e41ce-efb3-49b7-886b-99a8faf2cb37 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:00.413158 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e41ce-efb3-49b7-886b-99a8faf2cb37 None admin] RBAC: Adding query filter params (name=member) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:00.413466 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e41ce-efb3-49b7-886b-99a8faf2cb37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:00.414852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e41ce-efb3-49b7-886b-99a8faf2cb37 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:00.427716 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 208/419] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:20:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:00.443164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a436fb8-8e7e-4a06-9e7e-a6a095586684 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:00.585719 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a436fb8-8e7e-4a06-9e7e-a6a095586684 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:00.655247 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb4aac-2dfb-47d2-be29-5338534e284f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:00.655830 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb4aac-2dfb-47d2-be29-5338534e284f None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:00.656106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb4aac-2dfb-47d2-be29-5338534e284f None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:00.656381 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb4aac-2dfb-47d2-be29-5338534e284f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:00.682716 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003de03-119d-4687-a280-060dc3938480 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:00.683000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003de03-119d-4687-a280-060dc3938480 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:00.683286 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003de03-119d-4687-a280-060dc3938480 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:00.688117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 209/420] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:00.691195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954243dd-0bd6-4568-a95d-5ead28ccdebd None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:00.691195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954243dd-0bd6-4568-a95d-5ead28ccdebd None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:00.691195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954243dd-0bd6-4568-a95d-5ead28ccdebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:00.711752 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-954243dd-0bd6-4568-a95d-5ead28ccdebd None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:00.713080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-954243dd-0bd6-4568-a95d-5ead28ccdebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:00.778361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb4aac-2dfb-47d2-be29-5338534e284f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:00.779837 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb4aac-2dfb-47d2-be29-5338534e284f None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:00.804166 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 210/421] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:00.840870 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954243dd-0bd6-4568-a95d-5ead28ccdebd None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:00.931816 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 212/422] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:20:00.937770 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb4aac-2dfb-47d2-be29-5338534e284f None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:00.972046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954243dd-0bd6-4568-a95d-5ead28ccdebd None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:01.005445 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12560b60-dbca-4318-bc31-585b92f7e682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:01.006252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12560b60-dbca-4318-bc31-585b92f7e682 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:01.006523 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12560b60-dbca-4318-bc31-585b92f7e682 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:01.006798 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12560b60-dbca-4318-bc31-585b92f7e682 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:01.017836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12560b60-dbca-4318-bc31-585b92f7e682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:01.025899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-12560b60-dbca-4318-bc31-585b92f7e682 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:20:01.025899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:01.025899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:01.025899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:01.025899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:01.025899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:01.025899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:01.025899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:01.025899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:01.025899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:01.025899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:01.025899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:01.025899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:01.025899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:01.025899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:01.025899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:01.026774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:01.026774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:01.026774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:01.026774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:01.026774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:01.026774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:01.026774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:01.026774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:01.026774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:01.026774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:01.026774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:01.026774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:01.026774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:01.026774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:01.026774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:01.026774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:01.027702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:01.027702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:01.027702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:01.027702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:01.027702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:01.027702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:01.027702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:01.027702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:01.027702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:01.027702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:01.027702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:20:01.027702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:01.027702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 211/423] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:20:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:01.037036 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb4aac-2dfb-47d2-be29-5338534e284f None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:01.037452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12560b60-dbca-4318-bc31-585b92f7e682 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:01.071150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b232758-b094-49b4-9477-e646164d39a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:01.072008 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b232758-b094-49b4-9477-e646164d39a8 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:01.072416 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b232758-b094-49b4-9477-e646164d39a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:01.073209 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b232758-b094-49b4-9477-e646164d39a8 None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:01.074398 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b232758-b094-49b4-9477-e646164d39a8 None admin] RBAC: Authorizing `identity:get_project(project_id=0e884d4d1ec14a62a4ff4500b91183db)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:01.075843 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b232758-b094-49b4-9477-e646164d39a8 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:01.077847 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 213/424] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:20:00 2022] GET /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:01.083047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b232758-b094-49b4-9477-e646164d39a8 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:01.172697 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12560b60-dbca-4318-bc31-585b92f7e682 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:01.237538 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b232758-b094-49b4-9477-e646164d39a8 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:01.262596 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3649642-4c53-48ce-9925-862a23adce14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:01.263608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3649642-4c53-48ce-9925-862a23adce14 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:01.264088 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3649642-4c53-48ce-9925-862a23adce14 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:01.264607 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3649642-4c53-48ce-9925-862a23adce14 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:01.265566 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3649642-4c53-48ce-9925-862a23adce14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:01.266080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3649642-4c53-48ce-9925-862a23adce14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:01.267659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3649642-4c53-48ce-9925-862a23adce14 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:01.276556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc77f88-eb41-4a94-b656-7d8794f3c045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:01.276556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc77f88-eb41-4a94-b656-7d8794f3c045 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:01.276556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc77f88-eb41-4a94-b656-7d8794f3c045 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:01.276556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc77f88-eb41-4a94-b656-7d8794f3c045 None admin] PATH_INFO: `/v3/groups/c9cb46662e9245f5b8283121aa5aa220` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:01.276892 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc77f88-eb41-4a94-b656-7d8794f3c045 None admin] RBAC: Authorizing `identity:get_group(group_id=c9cb46662e9245f5b8283121aa5aa220)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:01.276892 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc77f88-eb41-4a94-b656-7d8794f3c045 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:01.278772 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 214/425] 10.222.0.60 () {56 vars in 1180 bytes} [Fri May 6 23:20:01 2022] GET /identity/v3/groups/c9cb46662e9245f5b8283121aa5aa220 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:01.284358 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc77f88-eb41-4a94-b656-7d8794f3c045 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:01.285398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 212/426] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:01.291097 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3649642-4c53-48ce-9925-862a23adce14 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:01.403314 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc77f88-eb41-4a94-b656-7d8794f3c045 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:01.440390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea39c3-f622-4dac-b881-a057d8b41a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:01.441437 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea39c3-f622-4dac-b881-a057d8b41a0f None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:01.441916 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea39c3-f622-4dac-b881-a057d8b41a0f None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:01.442385 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea39c3-f622-4dac-b881-a057d8b41a0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:01.443405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea39c3-f622-4dac-b881-a057d8b41a0f None admin] RBAC: Adding query filter params (group.id=c9cb46662e9245f5b8283121aa5aa220, role.id=4bc18e5c60c043ae8d42db9c4e9cd438, scope.project.id=0e884d4d1ec14a62a4ff4500b91183db) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:01.444367 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea39c3-f622-4dac-b881-a057d8b41a0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:01.446016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea39c3-f622-4dac-b881-a057d8b41a0f None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:01.452479 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 215/427] 10.222.0.60 () {56 vars in 1376 bytes} [Fri May 6 23:20:01 2022] GET /identity/v3/role_assignments?group.id=c9cb46662e9245f5b8283121aa5aa220&scope.project.id=0e884d4d1ec14a62a4ff4500b91183db&role.id=4bc18e5c60c043ae8d42db9c4e9cd438 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:01.489033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3649642-4c53-48ce-9925-862a23adce14 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:01.524768 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe57167-6928-4c40-a130-7acc6a202253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:01.525475 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe57167-6928-4c40-a130-7acc6a202253 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:01.525759 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe57167-6928-4c40-a130-7acc6a202253 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:01.526034 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe57167-6928-4c40-a130-7acc6a202253 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:01.600002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe57167-6928-4c40-a130-7acc6a202253 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:01.601562 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe57167-6928-4c40-a130-7acc6a202253 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:01.706796 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 213/428] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:20:01.712619 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea39c3-f622-4dac-b881-a057d8b41a0f None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:01.819684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea39c3-f622-4dac-b881-a057d8b41a0f None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:01.873402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bde846-4a67-4534-b313-2f43d17c9d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:01.874574 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde846-4a67-4534-b313-2f43d17c9d20 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:01.875001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde846-4a67-4534-b313-2f43d17c9d20 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:01.875418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde846-4a67-4534-b313-2f43d17c9d20 None admin] PATH_INFO: `/v3/projects/0e884d4d1ec14a62a4ff4500b91183db` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:01.877512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bde846-4a67-4534-b313-2f43d17c9d20 None admin] RBAC: Authorizing `identity:get_project(project_id=0e884d4d1ec14a62a4ff4500b91183db)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:01.879102 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bde846-4a67-4534-b313-2f43d17c9d20 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:01.881306 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 216/429] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:20:01 2022] GET /identity/v3/projects/0e884d4d1ec14a62a4ff4500b91183db => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:01.887321 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe57167-6928-4c40-a130-7acc6a202253 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:02.006233 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe57167-6928-4c40-a130-7acc6a202253 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:02.023825 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d2b4a-6211-408f-8489-6e7a08f5d0e2 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:02.024330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d2b4a-6211-408f-8489-6e7a08f5d0e2 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:02.024794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d2b4a-6211-408f-8489-6e7a08f5d0e2 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:02.027043 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 217/430] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:20:02.033464 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20651184-b56b-49e8-bc99-154ac3d44052 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:02.033750 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20651184-b56b-49e8-bc99-154ac3d44052 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:02.034030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20651184-b56b-49e8-bc99-154ac3d44052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:02.043728 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed409c-6c64-4984-acd7-fe19eb7f586e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:02.044619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed409c-6c64-4984-acd7-fe19eb7f586e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:02.044904 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed409c-6c64-4984-acd7-fe19eb7f586e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:02.045178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed409c-6c64-4984-acd7-fe19eb7f586e None admin] PATH_INFO: `/v3/groups/c9cb46662e9245f5b8283121aa5aa220` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:02.046470 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed409c-6c64-4984-acd7-fe19eb7f586e None admin] RBAC: Authorizing `identity:get_group(group_id=c9cb46662e9245f5b8283121aa5aa220)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:02.047924 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed409c-6c64-4984-acd7-fe19eb7f586e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:02.049908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 214/431] 10.222.0.60 () {56 vars in 1180 bytes} [Fri May 6 23:20:01 2022] GET /identity/v3/groups/c9cb46662e9245f5b8283121aa5aa220 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:02.055521 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed409c-6c64-4984-acd7-fe19eb7f586e None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:02.061618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-20651184-b56b-49e8-bc99-154ac3d44052 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:02.062825 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-20651184-b56b-49e8-bc99-154ac3d44052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:02.133832 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 218/432] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:02.158941 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20651184-b56b-49e8-bc99-154ac3d44052 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:02.164153 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed409c-6c64-4984-acd7-fe19eb7f586e None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:02.204196 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d912ad-4023-4efb-b297-940bec9635d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:02.204904 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d912ad-4023-4efb-b297-940bec9635d7 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:02.205188 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d912ad-4023-4efb-b297-940bec9635d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:02.205469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d912ad-4023-4efb-b297-940bec9635d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:02.206304 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d912ad-4023-4efb-b297-940bec9635d7 None admin] RBAC: Adding query filter params (group.id=c9cb46662e9245f5b8283121aa5aa220, role.id=2cfb5ae0e4244117845519425cb9235e, scope.project.id=0e884d4d1ec14a62a4ff4500b91183db) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:02.206777 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d912ad-4023-4efb-b297-940bec9635d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:02.208437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d912ad-4023-4efb-b297-940bec9635d7 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:02.215642 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 215/433] 10.222.0.60 () {56 vars in 1376 bytes} [Fri May 6 23:20:02 2022] GET /identity/v3/role_assignments?group.id=c9cb46662e9245f5b8283121aa5aa220&scope.project.id=0e884d4d1ec14a62a4ff4500b91183db&role.id=2cfb5ae0e4244117845519425cb9235e => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:02.280067 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20651184-b56b-49e8-bc99-154ac3d44052 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:02.318960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25bb6d-1c53-4289-a85e-f70c03af8db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:02.319762 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25bb6d-1c53-4289-a85e-f70c03af8db9 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:02.320042 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25bb6d-1c53-4289-a85e-f70c03af8db9 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:02.320297 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25bb6d-1c53-4289-a85e-f70c03af8db9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:02.332046 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25bb6d-1c53-4289-a85e-f70c03af8db9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:02.340222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-ab25bb6d-1c53-4289-a85e-f70c03af8db9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 06 23:20:02.340222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:02.340222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:02.340222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:02.340222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:02.340222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:02.340222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:02.340222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:02.340222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:02.340222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:02.340222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:02.340222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:02.340222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:02.340222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:02.340222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:02.340222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:02.341205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:02.341205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:02.341205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:02.341205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:02.341205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:02.341205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:02.341205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:02.341205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:02.341205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:02.341205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:02.341205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:02.341205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:02.341205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:02.341205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:02.341205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:02.341205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:02.341979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:02.341979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:02.341979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:02.341979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:02.341979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:02.341979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:02.341979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:02.341979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:02.341979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:02.341979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:02.341979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 06 23:20:02.341979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:02.341979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 219/434] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:20:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:02.347549 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d912ad-4023-4efb-b297-940bec9635d7 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:02.437624 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e8b3b-fb3f-483b-9538-4351cd43244b None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:02.437910 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e8b3b-fb3f-483b-9538-4351cd43244b None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:02.438164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e8b3b-fb3f-483b-9538-4351cd43244b None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:02.440658 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 220/435] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:20:02.445116 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86427b9a-8608-4d28-b259-f58eadaf1482 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:02.445657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86427b9a-8608-4d28-b259-f58eadaf1482 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:02.445657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86427b9a-8608-4d28-b259-f58eadaf1482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:02.470261 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-86427b9a-8608-4d28-b259-f58eadaf1482 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:02.471471 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-86427b9a-8608-4d28-b259-f58eadaf1482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:02.472363 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d912ad-4023-4efb-b297-940bec9635d7 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:02.521591 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269b41a-4a1a-4de3-8d03-9bba0ec4d3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:02.522424 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269b41a-4a1a-4de3-8d03-9bba0ec4d3d4 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:02.523560 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269b41a-4a1a-4de3-8d03-9bba0ec4d3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:02.523843 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269b41a-4a1a-4de3-8d03-9bba0ec4d3d4 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:02.524700 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269b41a-4a1a-4de3-8d03-9bba0ec4d3d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:02.525014 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269b41a-4a1a-4de3-8d03-9bba0ec4d3d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:02.526459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269b41a-4a1a-4de3-8d03-9bba0ec4d3d4 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:02.537552 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 216/436] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:20:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:02.543545 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269b41a-4a1a-4de3-8d03-9bba0ec4d3d4 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:02.569043 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 221/437] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:20:02.593891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86427b9a-8608-4d28-b259-f58eadaf1482 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:02.676704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269b41a-4a1a-4de3-8d03-9bba0ec4d3d4 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:02.719014 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb1982-3fef-4b98-ad78-2cd5e4486488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:02.719615 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb1982-3fef-4b98-ad78-2cd5e4486488 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:02.719900 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb1982-3fef-4b98-ad78-2cd5e4486488 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:02.720795 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb1982-3fef-4b98-ad78-2cd5e4486488 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:02.738950 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86427b9a-8608-4d28-b259-f58eadaf1482 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:02.786245 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914474f-e667-4f0a-941c-e1e20a2050a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:02.787493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914474f-e667-4f0a-941c-e1e20a2050a5 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:02.787803 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914474f-e667-4f0a-941c-e1e20a2050a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:02.788056 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914474f-e667-4f0a-941c-e1e20a2050a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:02.804261 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914474f-e667-4f0a-941c-e1e20a2050a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:02.807583 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb1982-3fef-4b98-ad78-2cd5e4486488 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:02.809097 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb1982-3fef-4b98-ad78-2cd5e4486488 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:02.813793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-d914474f-e667-4f0a-941c-e1e20a2050a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:20:02.813793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:02.813793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:02.813793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:02.813793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:02.813793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:02.813793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:02.813793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:02.813793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:02.813793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:02.813793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:02.813793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:02.813793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:02.813793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:02.813793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:02.813793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:02.814667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:02.814667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:02.814667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:02.814667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:02.814667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:02.814667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:02.814667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:02.814667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:02.814667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:02.814667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:02.814667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:02.814667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:02.814667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:02.814667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:02.814667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:02.814667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:02.815613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:02.815613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:02.815613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:02.815613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:02.815613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:02.815613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:02.815613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:02.815613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:02.815613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:02.815613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:02.815613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:20:02.815613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:02.815613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 222/438] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:20:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:02.822490 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914474f-e667-4f0a-941c-e1e20a2050a5 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:02.907487 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 217/439] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 06 23:20:02.908823 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5b9b-ef81-4c37-92c4-4fe2e4ecf8c9 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:02.909116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5b9b-ef81-4c37-92c4-4fe2e4ecf8c9 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:02.909389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5b9b-ef81-4c37-92c4-4fe2e4ecf8c9 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:02.910786 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 218/440] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:02.913155 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe5b9b-ef81-4c37-92c4-4fe2e4ecf8c9 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:02.919859 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914474f-e667-4f0a-941c-e1e20a2050a5 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:02.951013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e88f8-4746-4e18-8723-c71795d80a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:02.951655 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e88f8-4746-4e18-8723-c71795d80a3e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:02.951931 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e88f8-4746-4e18-8723-c71795d80a3e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:02.952200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e88f8-4746-4e18-8723-c71795d80a3e None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:02.952973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e88f8-4746-4e18-8723-c71795d80a3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:02.953272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e88f8-4746-4e18-8723-c71795d80a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:02.954628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e88f8-4746-4e18-8723-c71795d80a3e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:02.962202 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 223/441] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:20:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:02.964179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b59e0-b027-446f-92c7-08e4f9fe84e5 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:02.964458 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b59e0-b027-446f-92c7-08e4f9fe84e5 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:02.964770 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b59e0-b027-446f-92c7-08e4f9fe84e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:02.979922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-a42b59e0-b027-446f-92c7-08e4f9fe84e5 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:02.981042 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-a42b59e0-b027-446f-92c7-08e4f9fe84e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:03.007543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe5b9b-ef81-4c37-92c4-4fe2e4ecf8c9 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:03.039051 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b3a31-ebf1-468c-a520-f3c885e488f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:03.039893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b3a31-ebf1-468c-a520-f3c885e488f9 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:03.040175 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b3a31-ebf1-468c-a520-f3c885e488f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:03.040448 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b3a31-ebf1-468c-a520-f3c885e488f9 None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:03.042117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b3a31-ebf1-468c-a520-f3c885e488f9 None admin] RBAC: Authorizing `identity:get_project(project_id=d63a9207a2804d7193433ab0ec5687eb)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:03.043140 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 224/442] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:03.043555 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b3a31-ebf1-468c-a520-f3c885e488f9 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:03.043876 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b59e0-b027-446f-92c7-08e4f9fe84e5 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:03.045446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 219/443] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:20:02 2022] GET /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:03.050709 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b3a31-ebf1-468c-a520-f3c885e488f9 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:03.138865 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b59e0-b027-446f-92c7-08e4f9fe84e5 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:03.142747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b3a31-ebf1-468c-a520-f3c885e488f9 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:03.170108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24dda17-26df-42c6-971d-fbc0e3a09c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:03.170748 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dda17-26df-42c6-971d-fbc0e3a09c5b None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:03.171025 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dda17-26df-42c6-971d-fbc0e3a09c5b None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:03.171295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dda17-26df-42c6-971d-fbc0e3a09c5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:03.174840 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ad26e-5f90-4aff-baff-e0342f8c5624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:03.175682 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ad26e-5f90-4aff-baff-e0342f8c5624 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:03.175962 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ad26e-5f90-4aff-baff-e0342f8c5624 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:03.176238 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ad26e-5f90-4aff-baff-e0342f8c5624 None admin] PATH_INFO: `/v3/groups/c9cb46662e9245f5b8283121aa5aa220` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:03.177427 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ad26e-5f90-4aff-baff-e0342f8c5624 None admin] RBAC: Authorizing `identity:get_group(group_id=c9cb46662e9245f5b8283121aa5aa220)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:03.178858 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ad26e-5f90-4aff-baff-e0342f8c5624 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:03.180460 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 220/444] 10.222.0.60 () {56 vars in 1180 bytes} [Fri May 6 23:20:03 2022] GET /identity/v3/groups/c9cb46662e9245f5b8283121aa5aa220 => generated 226 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:03.181229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ad26e-5f90-4aff-baff-e0342f8c5624 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:03.233717 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24dda17-26df-42c6-971d-fbc0e3a09c5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:03.235101 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24dda17-26df-42c6-971d-fbc0e3a09c5b None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:03.272676 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ad26e-5f90-4aff-baff-e0342f8c5624 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:03.303830 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c9279-a8e0-489f-9b9b-50b413bddc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:03.304641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c9279-a8e0-489f-9b9b-50b413bddc7f None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:03.304928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c9279-a8e0-489f-9b9b-50b413bddc7f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:03.305195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c9279-a8e0-489f-9b9b-50b413bddc7f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:03.316380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c9279-a8e0-489f-9b9b-50b413bddc7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:03.325641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-eb2c9279-a8e0-489f-9b9b-50b413bddc7f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:20:03.325641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:03.325641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:03.325641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:03.325641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:03.325641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:03.325641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:03.325641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:03.325641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:03.325641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:03.325641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:03.325641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:03.325641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:03.325641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:03.325641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:03.325641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:03.326535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:03.326535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:03.326535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:03.326535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:03.326535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:03.326535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:03.326535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:03.326535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:03.326535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:03.326535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:03.326535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:03.326535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:03.326535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:03.326535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:03.326535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:03.326535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:03.327325 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:03.327325 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:03.327325 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:03.327325 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:03.327325 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:03.327325 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:03.327325 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:03.327325 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:03.327325 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:03.327325 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:03.327325 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:20:03.327325 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:03.327325 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 221/445] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:20:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:03.327990 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c9279-a8e0-489f-9b9b-50b413bddc7f None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:03.335100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 225/446] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:20:03.335807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24dda17-26df-42c6-971d-fbc0e3a09c5b None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:03.422036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c9279-a8e0-489f-9b9b-50b413bddc7f None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:03.426764 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24dda17-26df-42c6-971d-fbc0e3a09c5b None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:03.454302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05572dba-5dd3-45cf-9b4f-0a28e531ecbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:03.454956 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05572dba-5dd3-45cf-9b4f-0a28e531ecbc None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:03.455238 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05572dba-5dd3-45cf-9b4f-0a28e531ecbc None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:03.455510 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05572dba-5dd3-45cf-9b4f-0a28e531ecbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:03.456337 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05572dba-5dd3-45cf-9b4f-0a28e531ecbc None admin] RBAC: Adding query filter params (group.id=c9cb46662e9245f5b8283121aa5aa220, role.id=4bc18e5c60c043ae8d42db9c4e9cd438, scope.project.id=d63a9207a2804d7193433ab0ec5687eb) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:03.456681 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05572dba-5dd3-45cf-9b4f-0a28e531ecbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:03.458123 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05572dba-5dd3-45cf-9b4f-0a28e531ecbc None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:03.459389 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3392b-2eee-4ef3-8400-c60e604d40c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:03.460100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3392b-2eee-4ef3-8400-c60e604d40c5 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:03.460383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3392b-2eee-4ef3-8400-c60e604d40c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:03.460688 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3392b-2eee-4ef3-8400-c60e604d40c5 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:03.461545 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3392b-2eee-4ef3-8400-c60e604d40c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:03.461940 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3392b-2eee-4ef3-8400-c60e604d40c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:03.463396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3392b-2eee-4ef3-8400-c60e604d40c5 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:03.465269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 222/447] 10.222.0.60 () {56 vars in 1376 bytes} [Fri May 6 23:20:03 2022] GET /identity/v3/role_assignments?group.id=c9cb46662e9245f5b8283121aa5aa220&scope.project.id=d63a9207a2804d7193433ab0ec5687eb&role.id=4bc18e5c60c043ae8d42db9c4e9cd438 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:03.466575 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05572dba-5dd3-45cf-9b4f-0a28e531ecbc None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:03.472588 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 226/448] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:03.482035 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3392b-2eee-4ef3-8400-c60e604d40c5 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:03.573863 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05572dba-5dd3-45cf-9b4f-0a28e531ecbc None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:03.597169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3392b-2eee-4ef3-8400-c60e604d40c5 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:03.608977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447a869-93da-400a-8b14-29f287620049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:03.609759 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447a869-93da-400a-8b14-29f287620049 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:03.610126 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447a869-93da-400a-8b14-29f287620049 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:03.610588 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447a869-93da-400a-8b14-29f287620049 None admin] PATH_INFO: `/v3/projects/6afc05c85d9a4c7da004b8027296012b` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:03.611907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447a869-93da-400a-8b14-29f287620049 None admin] RBAC: Authorizing `identity:get_project(project_id=6afc05c85d9a4c7da004b8027296012b)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:03.613446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447a869-93da-400a-8b14-29f287620049 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:03.615235 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 223/449] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:20:03 2022] GET /identity/v3/projects/6afc05c85d9a4c7da004b8027296012b => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:03.620883 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447a869-93da-400a-8b14-29f287620049 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:03.639329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba45165-2bac-4084-8bde-8c9d5a0a0ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:03.639990 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba45165-2bac-4084-8bde-8c9d5a0a0ae2 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:03.640290 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba45165-2bac-4084-8bde-8c9d5a0a0ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:03.640571 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba45165-2bac-4084-8bde-8c9d5a0a0ae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:03.719644 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba45165-2bac-4084-8bde-8c9d5a0a0ae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:03.721679 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba45165-2bac-4084-8bde-8c9d5a0a0ae2 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:03.742656 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447a869-93da-400a-8b14-29f287620049 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:03.782484 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30550b80-2bb0-4ddb-aaa1-a4d6c984491a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:03.783349 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30550b80-2bb0-4ddb-aaa1-a4d6c984491a None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:03.783626 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30550b80-2bb0-4ddb-aaa1-a4d6c984491a None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:03.783898 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30550b80-2bb0-4ddb-aaa1-a4d6c984491a None admin] PATH_INFO: `/v3/groups/4512b607163b493e874c61ae76ca7578` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:03.785712 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30550b80-2bb0-4ddb-aaa1-a4d6c984491a None admin] RBAC: Authorizing `identity:get_group(group_id=4512b607163b493e874c61ae76ca7578)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:03.788237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30550b80-2bb0-4ddb-aaa1-a4d6c984491a None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:03.789629 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 224/450] 10.222.0.60 () {56 vars in 1180 bytes} [Fri May 6 23:20:03 2022] GET /identity/v3/groups/4512b607163b493e874c61ae76ca7578 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:03.795139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30550b80-2bb0-4ddb-aaa1-a4d6c984491a None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:03.830371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 227/451] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 06 23:20:03.835949 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba45165-2bac-4084-8bde-8c9d5a0a0ae2 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:03.899555 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30550b80-2bb0-4ddb-aaa1-a4d6c984491a None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:03.931053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911f48f-8011-4b06-8fdb-8e465ceb6c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:03.931571 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba45165-2bac-4084-8bde-8c9d5a0a0ae2 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:03.931882 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911f48f-8011-4b06-8fdb-8e465ceb6c4a None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:03.932255 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911f48f-8011-4b06-8fdb-8e465ceb6c4a None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:03.932630 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911f48f-8011-4b06-8fdb-8e465ceb6c4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:03.933465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911f48f-8011-4b06-8fdb-8e465ceb6c4a None admin] RBAC: Adding query filter params (group.id=4512b607163b493e874c61ae76ca7578, role.id=408ee9a3a38640a48dbcdb2c377efcd8, scope.project.id=6afc05c85d9a4c7da004b8027296012b) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:03.933778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911f48f-8011-4b06-8fdb-8e465ceb6c4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:03.935224 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911f48f-8011-4b06-8fdb-8e465ceb6c4a None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:03.940883 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 225/452] 10.222.0.60 () {56 vars in 1376 bytes} [Fri May 6 23:20:03 2022] GET /identity/v3/role_assignments?group.id=4512b607163b493e874c61ae76ca7578&scope.project.id=6afc05c85d9a4c7da004b8027296012b&role.id=408ee9a3a38640a48dbcdb2c377efcd8 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:03.966812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37828e-516a-4bf8-b46f-a8b4a9c6713e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:03.967687 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37828e-516a-4bf8-b46f-a8b4a9c6713e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:03.967972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37828e-516a-4bf8-b46f-a8b4a9c6713e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:03.968244 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37828e-516a-4bf8-b46f-a8b4a9c6713e None admin] PATH_INFO: `/v3/projects/d63a9207a2804d7193433ab0ec5687eb` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:03.969571 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37828e-516a-4bf8-b46f-a8b4a9c6713e None admin] RBAC: Authorizing `identity:get_project(project_id=d63a9207a2804d7193433ab0ec5687eb)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:03.971865 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37828e-516a-4bf8-b46f-a8b4a9c6713e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:03.973844 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 228/453] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:20:03 2022] GET /identity/v3/projects/d63a9207a2804d7193433ab0ec5687eb => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:03.981289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911f48f-8011-4b06-8fdb-8e465ceb6c4a None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:04.085219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911f48f-8011-4b06-8fdb-8e465ceb6c4a None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:04.118736 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17fe21-d3c1-43b2-8549-f8645785f224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:04.120123 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17fe21-d3c1-43b2-8549-f8645785f224 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:04.120402 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17fe21-d3c1-43b2-8549-f8645785f224 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:04.120706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17fe21-d3c1-43b2-8549-f8645785f224 None admin] PATH_INFO: `/v3/groups/c9cb46662e9245f5b8283121aa5aa220` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:04.121886 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17fe21-d3c1-43b2-8549-f8645785f224 None admin] RBAC: Authorizing `identity:get_group(group_id=c9cb46662e9245f5b8283121aa5aa220)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:04.123316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17fe21-d3c1-43b2-8549-f8645785f224 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:04.124991 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 226/454] 10.222.0.60 () {56 vars in 1180 bytes} [Fri May 6 23:20:03 2022] GET /identity/v3/groups/c9cb46662e9245f5b8283121aa5aa220 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:04.130946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37828e-516a-4bf8-b46f-a8b4a9c6713e None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:04.224451 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37828e-516a-4bf8-b46f-a8b4a9c6713e None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:04.256937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4488b-c329-4949-8675-31b2c616c811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:04.257584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4488b-c329-4949-8675-31b2c616c811 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:04.257869 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4488b-c329-4949-8675-31b2c616c811 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:04.258146 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4488b-c329-4949-8675-31b2c616c811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:04.258975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4488b-c329-4949-8675-31b2c616c811 None admin] RBAC: Adding query filter params (group.id=c9cb46662e9245f5b8283121aa5aa220, role.id=2cfb5ae0e4244117845519425cb9235e, scope.project.id=d63a9207a2804d7193433ab0ec5687eb) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:04.259286 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4488b-c329-4949-8675-31b2c616c811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:04.260741 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4488b-c329-4949-8675-31b2c616c811 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:04.266251 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 229/455] 10.222.0.60 () {56 vars in 1376 bytes} [Fri May 6 23:20:04 2022] GET /identity/v3/role_assignments?group.id=c9cb46662e9245f5b8283121aa5aa220&scope.project.id=d63a9207a2804d7193433ab0ec5687eb&role.id=2cfb5ae0e4244117845519425cb9235e => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:07.055021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662360b9-4c86-4263-9482-a9d20f34613a None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:07.055530 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662360b9-4c86-4263-9482-a9d20f34613a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:07.055635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662360b9-4c86-4263-9482-a9d20f34613a None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:07.057744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 227/456] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:07.062852 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6d16f-60e6-4ef0-801f-6b48d5e3007e None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:07.063686 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6d16f-60e6-4ef0-801f-6b48d5e3007e None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:07.064156 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6d16f-60e6-4ef0-801f-6b48d5e3007e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:07.089788 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-7ad6d16f-60e6-4ef0-801f-6b48d5e3007e None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:07.091311 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-7ad6d16f-60e6-4ef0-801f-6b48d5e3007e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:07.176883 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 230/457] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:07.201204 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662360b9-4c86-4263-9482-a9d20f34613a None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:07.290361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523773e5-6945-4864-85c4-89f24205ea97 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:07.291090 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523773e5-6945-4864-85c4-89f24205ea97 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:07.291588 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523773e5-6945-4864-85c4-89f24205ea97 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:07.293194 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 231/458] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:20:07.298801 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa1842-ea48-4189-b80c-bf6adf6e6a59 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:07.299346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa1842-ea48-4189-b80c-bf6adf6e6a59 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:07.299816 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa1842-ea48-4189-b80c-bf6adf6e6a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:07.337088 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662360b9-4c86-4263-9482-a9d20f34613a None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:07.338421 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-68aa1842-ea48-4189-b80c-bf6adf6e6a59 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:07.340030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-68aa1842-ea48-4189-b80c-bf6adf6e6a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:07.371826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b1f99-255c-452d-8aa4-7b59fbf975e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:07.372914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b1f99-255c-452d-8aa4-7b59fbf975e6 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:07.373342 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b1f99-255c-452d-8aa4-7b59fbf975e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:07.373775 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b1f99-255c-452d-8aa4-7b59fbf975e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:07.384465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b1f99-255c-452d-8aa4-7b59fbf975e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:07.386681 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b1f99-255c-452d-8aa4-7b59fbf975e6 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:07.405316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-bc7b1f99-255c-452d-8aa4-7b59fbf975e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:07.405316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:07.405316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:07.405316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:07.405316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:07.405316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:07.405316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:07.405316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:07.405316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:07.405316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:07.405316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:07.405316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:07.405316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:07.405316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:07.405316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:07.406320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:07.406320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:07.406320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:07.406320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:07.406320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:07.406320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:07.406320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:07.406320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:07.406320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:07.406320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:07.406320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:07.406320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:07.406320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:07.406320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:07.406320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:07.406320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:07.406320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:07.407160 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:07.407160 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:07.407160 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:07.407160 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:07.409792 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 228/459] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:07.421607 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b1f99-255c-452d-8aa4-7b59fbf975e6 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:07.459214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 232/460] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:20:07.494149 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa1842-ea48-4189-b80c-bf6adf6e6a59 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:07.538162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b1f99-255c-452d-8aa4-7b59fbf975e6 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:07.574618 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2960b-c543-45f1-b21d-e02b419522a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:07.575587 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2960b-c543-45f1-b21d-e02b419522a0 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:07.576074 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2960b-c543-45f1-b21d-e02b419522a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:07.576530 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2960b-c543-45f1-b21d-e02b419522a0 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:07.577458 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2960b-c543-45f1-b21d-e02b419522a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:07.577940 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2960b-c543-45f1-b21d-e02b419522a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:07.579488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2960b-c543-45f1-b21d-e02b419522a0 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:07.592784 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 229/461] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:07.601721 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2960b-c543-45f1-b21d-e02b419522a0 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:07.622780 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa1842-ea48-4189-b80c-bf6adf6e6a59 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:07.657495 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ed76e-f60a-4850-9366-6b509446a3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:07.658170 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ed76e-f60a-4850-9366-6b509446a3a5 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:07.658449 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ed76e-f60a-4850-9366-6b509446a3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:07.658718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ed76e-f60a-4850-9366-6b509446a3a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:07.679324 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ed76e-f60a-4850-9366-6b509446a3a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:07.680867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ed76e-f60a-4850-9366-6b509446a3a5 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:07.698819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-d11ed76e-f60a-4850-9366-6b509446a3a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:07.698819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:07.698819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:07.698819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:07.698819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:07.698819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:07.698819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:07.698819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:07.698819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:07.698819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:07.698819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:07.698819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:07.698819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:07.698819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:07.698819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:07.699714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:07.699714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:07.699714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:07.699714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:07.699714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:07.699714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:07.699714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:07.699714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:07.699714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:07.699714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:07.699714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:07.699714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:07.699714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:07.699714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:07.699714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:07.699714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:07.699714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:07.700594 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:07.700594 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:07.700594 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:07.700594 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:07.700806 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 233/462] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:07.702060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374668f-f8e0-412b-897d-a61551d1e104 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:07.702344 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374668f-f8e0-412b-897d-a61551d1e104 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:07.702615 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374668f-f8e0-412b-897d-a61551d1e104 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:07.703885 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 234/463] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:07.705869 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374668f-f8e0-412b-897d-a61551d1e104 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:07.742793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2960b-c543-45f1-b21d-e02b419522a0 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:07.776316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a22db-2b92-45f2-80ed-628dd6603514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:07.777007 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a22db-2b92-45f2-80ed-628dd6603514 None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:07.777281 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a22db-2b92-45f2-80ed-628dd6603514 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:07.777550 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a22db-2b92-45f2-80ed-628dd6603514 None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:07.778249 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a22db-2b92-45f2-80ed-628dd6603514 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:07.779682 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a22db-2b92-45f2-80ed-628dd6603514 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:07.798441 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 230/464] 10.222.0.60 () {60 vars in 1132 bytes} [Fri May 6 23:20:07 2022] POST /identity/v3/users => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:20:07.799648 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e39c51-b5ff-44f4-962b-b2f6fab36752 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:07.799932 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e39c51-b5ff-44f4-962b-b2f6fab36752 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:07.800252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e39c51-b5ff-44f4-962b-b2f6fab36752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:07.818145 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-93e39c51-b5ff-44f4-962b-b2f6fab36752 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:07.819429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-93e39c51-b5ff-44f4-962b-b2f6fab36752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:07.830123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374668f-f8e0-412b-897d-a61551d1e104 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:07.879354 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76378564-5658-42dd-9e46-99ba584f5c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:07.880215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76378564-5658-42dd-9e46-99ba584f5c88 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:07.880584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76378564-5658-42dd-9e46-99ba584f5c88 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:07.880970 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76378564-5658-42dd-9e46-99ba584f5c88 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:07.881843 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76378564-5658-42dd-9e46-99ba584f5c88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:07.882551 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76378564-5658-42dd-9e46-99ba584f5c88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:07.883784 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76378564-5658-42dd-9e46-99ba584f5c88 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:07.904327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 235/465] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:07.906185 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcf039-0971-4803-8084-73004d482094 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:07.906494 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcf039-0971-4803-8084-73004d482094 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:07.906864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcf039-0971-4803-8084-73004d482094 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:07.912886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 236/466] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:07.914157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcf039-0971-4803-8084-73004d482094 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:07.914601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 231/467] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:07.916366 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d115c-867c-4fca-b3ad-5742b4189112 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:07.916833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d115c-867c-4fca-b3ad-5742b4189112 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:07.917273 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d115c-867c-4fca-b3ad-5742b4189112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:07.938880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-5f1d115c-867c-4fca-b3ad-5742b4189112 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:07.940688 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-5f1d115c-867c-4fca-b3ad-5742b4189112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:08.032260 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcf039-0971-4803-8084-73004d482094 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:08.033957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 232/468] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:08.033957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d115c-867c-4fca-b3ad-5742b4189112 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:08.068239 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be27c2-aca3-4559-8068-e9dadbe57646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:08.068968 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be27c2-aca3-4559-8068-e9dadbe57646 None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:08.069416 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be27c2-aca3-4559-8068-e9dadbe57646 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:08.069835 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be27c2-aca3-4559-8068-e9dadbe57646 None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:08.070686 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be27c2-aca3-4559-8068-e9dadbe57646 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:08.072251 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be27c2-aca3-4559-8068-e9dadbe57646 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:08.094874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 237/469] 10.222.0.60 () {60 vars in 1132 bytes} [Fri May 6 23:20:07 2022] POST /identity/v3/users => generated 248 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:20:08.097289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be27c2-aca3-4559-8068-e9dadbe57646 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:08.146034 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d115c-867c-4fca-b3ad-5742b4189112 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:08.185960 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dd9b0-4224-43f1-a8e1-e4a61936f511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:08.187154 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dd9b0-4224-43f1-a8e1-e4a61936f511 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:08.187651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dd9b0-4224-43f1-a8e1-e4a61936f511 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:08.188172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dd9b0-4224-43f1-a8e1-e4a61936f511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:08.200361 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dd9b0-4224-43f1-a8e1-e4a61936f511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:08.202289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dd9b0-4224-43f1-a8e1-e4a61936f511 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:08.209595 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be27c2-aca3-4559-8068-e9dadbe57646 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:08.222285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-c03dd9b0-4224-43f1-a8e1-e4a61936f511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:08.222285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:08.222285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:08.222285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:08.222285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:08.222285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:08.222285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:08.222285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:08.222285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:08.222285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:08.222285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:08.222285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:08.222285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:08.222285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:08.222285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:08.223200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:08.223200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:08.223200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:08.223200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:08.223200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:08.223200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:08.223200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:08.223200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:08.223200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:08.223200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:08.223200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:08.223200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:08.223200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:08.223200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:08.223200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:08.223200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:08.223200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:08.224044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:08.224044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:08.224044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:08.224044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:08.226063 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 233/470] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:08.233782 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dd9b0-4224-43f1-a8e1-e4a61936f511 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:08.252988 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b8e9d-08b9-435d-89ab-02bf857a6e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:08.254160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b8e9d-08b9-435d-89ab-02bf857a6e11 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:08.254638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b8e9d-08b9-435d-89ab-02bf857a6e11 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:08.255125 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b8e9d-08b9-435d-89ab-02bf857a6e11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:08.267161 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b8e9d-08b9-435d-89ab-02bf857a6e11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:08.269105 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b8e9d-08b9-435d-89ab-02bf857a6e11 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:08.287576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-cf3b8e9d-08b9-435d-89ab-02bf857a6e11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:08.287576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:08.287576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:08.287576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:08.287576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:08.287576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:08.287576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:08.287576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:08.287576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:08.287576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:08.287576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:08.287576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:08.287576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:08.287576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:08.287576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:08.288432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:08.288432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:08.288432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:08.288432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:08.288432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:08.288432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:08.288432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:08.288432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:08.288432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:08.288432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:08.288432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:08.288432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:08.288432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:08.288432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:08.288432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:08.288432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:08.288432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:08.289287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:08.289287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:08.289287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:08.289287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:08.293274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 238/471] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:08.298386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b8e9d-08b9-435d-89ab-02bf857a6e11 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:08.343964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dd9b0-4224-43f1-a8e1-e4a61936f511 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:08.379004 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a461cfb-044f-48c0-89f3-482003d5cc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:08.379664 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a461cfb-044f-48c0-89f3-482003d5cc45 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:08.379945 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a461cfb-044f-48c0-89f3-482003d5cc45 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:08.380235 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a461cfb-044f-48c0-89f3-482003d5cc45 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:08.380982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a461cfb-044f-48c0-89f3-482003d5cc45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:08.381286 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a461cfb-044f-48c0-89f3-482003d5cc45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:08.382733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a461cfb-044f-48c0-89f3-482003d5cc45 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:08.396104 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 234/472] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:08.401504 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a461cfb-044f-48c0-89f3-482003d5cc45 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:08.402996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b8e9d-08b9-435d-89ab-02bf857a6e11 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:08.436895 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed6f23-fd79-44c1-bfc9-c7e0d086d224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:08.437882 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed6f23-fd79-44c1-bfc9-c7e0d086d224 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:08.438377 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed6f23-fd79-44c1-bfc9-c7e0d086d224 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:08.438846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed6f23-fd79-44c1-bfc9-c7e0d086d224 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:08.439750 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed6f23-fd79-44c1-bfc9-c7e0d086d224 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:08.440311 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed6f23-fd79-44c1-bfc9-c7e0d086d224 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:08.441936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed6f23-fd79-44c1-bfc9-c7e0d086d224 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:08.459679 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 239/473] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:08.461388 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed6f23-fd79-44c1-bfc9-c7e0d086d224 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:08.509946 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a461cfb-044f-48c0-89f3-482003d5cc45 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:08.547917 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d5205-2be6-4ef8-82ff-f184e7a1adb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:08.548526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d5205-2be6-4ef8-82ff-f184e7a1adb8 None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:08.548832 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d5205-2be6-4ef8-82ff-f184e7a1adb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:08.549110 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d5205-2be6-4ef8-82ff-f184e7a1adb8 None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:08.549830 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d5205-2be6-4ef8-82ff-f184e7a1adb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:08.551375 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d5205-2be6-4ef8-82ff-f184e7a1adb8 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:08.571892 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed6f23-fd79-44c1-bfc9-c7e0d086d224 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:08.577414 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 235/474] 10.222.0.60 () {60 vars in 1132 bytes} [Fri May 6 23:20:08 2022] POST /identity/v3/users => generated 248 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:20:08.615747 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15ad3f-beeb-4811-9298-3acbbaccfef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:08.616438 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15ad3f-beeb-4811-9298-3acbbaccfef1 None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:08.616745 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15ad3f-beeb-4811-9298-3acbbaccfef1 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:08.617021 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15ad3f-beeb-4811-9298-3acbbaccfef1 None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:08.617736 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15ad3f-beeb-4811-9298-3acbbaccfef1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:08.619259 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15ad3f-beeb-4811-9298-3acbbaccfef1 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:08.644517 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 240/475] 10.222.0.60 () {60 vars in 1132 bytes} [Fri May 6 23:20:08 2022] POST /identity/v3/users => generated 249 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:20:08.688355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be16cc-0bfd-49b5-9a09-3296b1d86617 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:08.689009 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be16cc-0bfd-49b5-9a09-3296b1d86617 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:08.689505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be16cc-0bfd-49b5-9a09-3296b1d86617 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:08.691546 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 236/476] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:08.697302 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca930edb-e68d-4bb1-aa16-d81494ef14ef None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:08.697644 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca930edb-e68d-4bb1-aa16-d81494ef14ef None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:08.697932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca930edb-e68d-4bb1-aa16-d81494ef14ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:08.717845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-ca930edb-e68d-4bb1-aa16-d81494ef14ef None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:08.719070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-ca930edb-e68d-4bb1-aa16-d81494ef14ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:08.799033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 241/477] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:08.822631 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be16cc-0bfd-49b5-9a09-3296b1d86617 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:08.956699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be16cc-0bfd-49b5-9a09-3296b1d86617 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:08.995504 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c8812-5ce6-480b-a5d6-4a97a0b13b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:08.996175 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c8812-5ce6-480b-a5d6-4a97a0b13b76 None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:08.996454 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c8812-5ce6-480b-a5d6-4a97a0b13b76 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:08.996766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c8812-5ce6-480b-a5d6-4a97a0b13b76 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:08.997534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c8812-5ce6-480b-a5d6-4a97a0b13b76 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:08.998971 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c8812-5ce6-480b-a5d6-4a97a0b13b76 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:09.008354 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.sql.core [None req-8e8c8812-5ce6-480b-a5d6-4a97a0b13b76 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 06 23:20:09.008354 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 06 23:20:09.008354 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [parameters: {'id': 'd9bc3765155f422cbadb53a79955e9bc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 06 23:20:09.008354 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79804) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 06 23:20:09.025670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-8e8c8812-5ce6-480b-a5d6-4a97a0b13b76 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 06 23:20:09.025670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:09.025670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 06 23:20:09.025670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self.dialect.do_execute( May 06 23:20:09.025670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 06 23:20:09.025670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 06 23:20:09.025670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 06 23:20:09.025670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application result = self._query(query) May 06 23:20:09.025670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 06 23:20:09.025670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application conn.query(q) May 06 23:20:09.025670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 06 23:20:09.025670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 06 23:20:09.025670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 06 23:20:09.025670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application result.read() May 06 23:20:09.025670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 06 23:20:09.026578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 06 23:20:09.026578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 06 23:20:09.026578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application packet.raise_for_error() May 06 23:20:09.026578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 06 23:20:09.026578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 06 23:20:09.026578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 06 23:20:09.026578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 06 23:20:09.026578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 06 23:20:09.026578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:09.026578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 06 23:20:09.026578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:09.026578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:09.026578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 06 23:20:09.026578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 06 23:20:09.026578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 06 23:20:09.026578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return ref.to_dict() May 06 23:20:09.026578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 06 23:20:09.026578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application next(self.gen) May 06 23:20:09.027553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 06 23:20:09.027553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application yield resource May 06 23:20:09.027553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 06 23:20:09.027553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application next(self.gen) May 06 23:20:09.027553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 06 23:20:09.027553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self.session.rollback() May 06 23:20:09.027553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 06 23:20:09.027553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self.force_reraise() May 06 23:20:09.027553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 06 23:20:09.027553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise self.value May 06 23:20:09.027553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 06 23:20:09.027553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 06 23:20:09.027553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 06 23:20:09.027553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application session.commit() May 06 23:20:09.027553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 06 23:20:09.027553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 06 23:20:09.027553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 06 23:20:09.028389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._prepare_impl() May 06 23:20:09.028389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 06 23:20:09.028389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self.session.flush() May 06 23:20:09.028389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 06 23:20:09.028389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._flush(objects) May 06 23:20:09.028389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 06 23:20:09.028389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 06 23:20:09.028389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 06 23:20:09.028389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application compat.raise_( May 06 23:20:09.028389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 06 23:20:09.028389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception May 06 23:20:09.028389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 06 23:20:09.028389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application flush_context.execute() May 06 23:20:09.028389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 06 23:20:09.028389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rec.execute(self) May 06 23:20:09.028389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 06 23:20:09.028389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 06 23:20:09.029313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 06 23:20:09.029313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application _emit_insert_statements( May 06 23:20:09.029313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 06 23:20:09.029313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application c = connection._execute_20( May 06 23:20:09.029313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 06 23:20:09.029313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 06 23:20:09.029313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 06 23:20:09.029313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 06 23:20:09.029313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 06 23:20:09.029313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ret = self._execute_context( May 06 23:20:09.029313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 06 23:20:09.029313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 06 23:20:09.029313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 06 23:20:09.029313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 06 23:20:09.029313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 06 23:20:09.029313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception May 06 23:20:09.030102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 06 23:20:09.030102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self.dialect.do_execute( May 06 23:20:09.030102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 06 23:20:09.030102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 06 23:20:09.030102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 06 23:20:09.030102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application result = self._query(query) May 06 23:20:09.030102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 06 23:20:09.030102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application conn.query(q) May 06 23:20:09.030102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 06 23:20:09.030102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 06 23:20:09.030102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 06 23:20:09.030102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application result.read() May 06 23:20:09.030102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 06 23:20:09.030102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 06 23:20:09.030102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 06 23:20:09.030102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application packet.raise_for_error() May 06 23:20:09.031645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 06 23:20:09.031645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 06 23:20:09.031645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 06 23:20:09.031645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 06 23:20:09.031645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 06 23:20:09.031645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 06 23:20:09.031645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [parameters: {'id': 'd9bc3765155f422cbadb53a79955e9bc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 06 23:20:09.031645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 06 23:20:09.031645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:09.031645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:20:09.031645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:09.031645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:09.031645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:09.031645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:09.031645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:09.031645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:09.033453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:09.033453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:09.033453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:09.033453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:09.033453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:09.033453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:09.033453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 06 23:20:09.033453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 06 23:20:09.033453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:09.033453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:09.033453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 06 23:20:09.033453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 06 23:20:09.033453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 06 23:20:09.033453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 06 23:20:09.033453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 06 23:20:09.033453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:09.035328 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 237/478] 10.222.0.60 () {60 vars in 1131 bytes} [Fri May 6 23:20:08 2022] POST /identity/v3/roles => generated 144 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:09.038116 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca930edb-e68d-4bb1-aa16-d81494ef14ef None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:09.211504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca930edb-e68d-4bb1-aa16-d81494ef14ef None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:09.282117 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174565ad-4626-4d10-9b6f-a634ced77481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:09.282944 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174565ad-4626-4d10-9b6f-a634ced77481 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:09.283277 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174565ad-4626-4d10-9b6f-a634ced77481 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:09.283557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174565ad-4626-4d10-9b6f-a634ced77481 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:09.313731 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174565ad-4626-4d10-9b6f-a634ced77481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:09.321840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-174565ad-4626-4d10-9b6f-a634ced77481 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:20:09.321840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:09.321840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:09.321840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:09.321840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:09.321840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:09.321840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:09.321840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:09.321840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:09.321840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:09.321840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:09.321840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:09.321840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:09.321840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:09.321840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:09.321840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:09.322810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:09.322810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:09.322810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:09.322810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:09.322810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:09.322810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:09.322810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:09.322810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:09.322810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:09.322810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:09.322810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:09.322810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:09.322810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:09.322810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:09.322810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:09.322810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:09.324230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:09.324230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:09.324230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:09.324230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:09.324230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:09.324230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:09.324230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:09.324230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:09.324230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:09.324230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:09.324230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 06 23:20:09.324230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:09.324230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 242/479] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:20:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:09.333722 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c8812-5ce6-480b-a5d6-4a97a0b13b76 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:09.464996 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c8812-5ce6-480b-a5d6-4a97a0b13b76 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:09.503980 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ece32-48ad-4bcc-bc3a-4f7907795dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:09.504681 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ece32-48ad-4bcc-bc3a-4f7907795dc2 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:09.504971 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ece32-48ad-4bcc-bc3a-4f7907795dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:09.505253 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ece32-48ad-4bcc-bc3a-4f7907795dc2 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:09.506015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ece32-48ad-4bcc-bc3a-4f7907795dc2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:09.506327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ece32-48ad-4bcc-bc3a-4f7907795dc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:09.507714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ece32-48ad-4bcc-bc3a-4f7907795dc2 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:09.516332 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 238/480] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:10.559816 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7543f-86c9-4434-8ffb-d9c01b285266 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:10.560333 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7543f-86c9-4434-8ffb-d9c01b285266 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:10.560438 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7543f-86c9-4434-8ffb-d9c01b285266 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:10.561954 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 243/481] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:10.570077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dbe79-eacc-460b-96de-8d44a4734869 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:10.570531 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dbe79-eacc-460b-96de-8d44a4734869 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:10.570604 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dbe79-eacc-460b-96de-8d44a4734869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:10.594963 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-995dbe79-eacc-460b-96de-8d44a4734869 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:10.596145 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-995dbe79-eacc-460b-96de-8d44a4734869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:10.665177 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 239/482] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:10.698785 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7543f-86c9-4434-8ffb-d9c01b285266 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:10.832529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7543f-86c9-4434-8ffb-d9c01b285266 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:10.865979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa71cb1-63a5-484a-99fc-19f693ec78bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:10.866770 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa71cb1-63a5-484a-99fc-19f693ec78bd None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:10.867048 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa71cb1-63a5-484a-99fc-19f693ec78bd None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:10.867316 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa71cb1-63a5-484a-99fc-19f693ec78bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:10.877900 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa71cb1-63a5-484a-99fc-19f693ec78bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:10.885565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-bfa71cb1-63a5-484a-99fc-19f693ec78bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:10.885565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:10.885565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:10.885565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:10.885565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:10.885565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:10.885565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:10.885565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:10.885565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:10.885565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:10.885565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:10.885565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:10.885565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:10.885565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:10.885565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:10.885565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:10.886431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:10.886431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:10.886431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:10.886431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:10.886431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:10.886431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:10.886431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:10.886431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:10.886431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:10.886431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:10.886431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:10.886431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:10.886431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:10.886431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:10.886431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:10.886431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:10.887223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:10.887223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:10.887223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:10.887223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:10.887223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:10.887223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:10.887223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:10.887223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:10.887223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:10.887223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:10.887223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:10.887223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:10.887223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 244/483] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:10.894285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dbe79-eacc-460b-96de-8d44a4734869 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:11.009088 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b524965-050a-40bd-8a97-fa23bf1b9cc6 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:11.009441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b524965-050a-40bd-8a97-fa23bf1b9cc6 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:11.009671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b524965-050a-40bd-8a97-fa23bf1b9cc6 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:11.012384 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 245/484] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:20:11.016956 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a113bfc-3f23-41f7-8f04-76ab4627b921 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:11.017242 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a113bfc-3f23-41f7-8f04-76ab4627b921 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:11.017814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a113bfc-3f23-41f7-8f04-76ab4627b921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:11.050829 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-4a113bfc-3f23-41f7-8f04-76ab4627b921 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:11.052029 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-4a113bfc-3f23-41f7-8f04-76ab4627b921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:11.074443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dbe79-eacc-460b-96de-8d44a4734869 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:11.140080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78583f24-2b4e-48db-ba0e-3be9711acf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:11.140703 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78583f24-2b4e-48db-ba0e-3be9711acf1f None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:11.140987 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78583f24-2b4e-48db-ba0e-3be9711acf1f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:11.141264 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78583f24-2b4e-48db-ba0e-3be9711acf1f None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:11.142019 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78583f24-2b4e-48db-ba0e-3be9711acf1f None admin] RBAC: Adding query filter params (name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:11.142327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78583f24-2b4e-48db-ba0e-3be9711acf1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:11.143702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78583f24-2b4e-48db-ba0e-3be9711acf1f None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:11.152913 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 240/485] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:20:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:11.161915 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78583f24-2b4e-48db-ba0e-3be9711acf1f None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:11.171407 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 246/486] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:11.191530 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a113bfc-3f23-41f7-8f04-76ab4627b921 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:11.273702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78583f24-2b4e-48db-ba0e-3be9711acf1f None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:11.307692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a113bfc-3f23-41f7-8f04-76ab4627b921 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:11.321791 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed204d1-fd2c-41fb-a314-927f64eaa7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:11.322629 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed204d1-fd2c-41fb-a314-927f64eaa7e4 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:11.322910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed204d1-fd2c-41fb-a314-927f64eaa7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:11.323187 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed204d1-fd2c-41fb-a314-927f64eaa7e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:11.341514 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f898f-47f6-4843-ae85-28425e31707c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:11.342305 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f898f-47f6-4843-ae85-28425e31707c None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:11.342585 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f898f-47f6-4843-ae85-28425e31707c None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:11.342853 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f898f-47f6-4843-ae85-28425e31707c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:11.345733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed204d1-fd2c-41fb-a314-927f64eaa7e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:11.347202 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed204d1-fd2c-41fb-a314-927f64eaa7e4 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:11.353062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f898f-47f6-4843-ae85-28425e31707c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:11.361113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-f65f898f-47f6-4843-ae85-28425e31707c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:11.361113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:11.361113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:11.361113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:11.361113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:11.361113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:11.361113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:11.361113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:11.361113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:11.361113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:11.361113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:11.361113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:11.361113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:11.361113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:11.361113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:11.361113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:11.362013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:11.362013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:11.362013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:11.362013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:11.362013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:11.362013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:11.362013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:11.362013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:11.362013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:11.362013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:11.362013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:11.362013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:11.362013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:11.362013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:11.362013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:11.362013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:11.362802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:11.362802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:11.362802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:11.362802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:11.362802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:11.362802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:11.362802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:11.362802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:11.362802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:11.362802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:11.362802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:11.362802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:11.367008 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 247/487] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:11.368154 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f898f-47f6-4843-ae85-28425e31707c None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:11.370735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-2ed204d1-fd2c-41fb-a314-927f64eaa7e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:11.370735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:11.370735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:11.370735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:11.370735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:11.370735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:11.370735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:11.370735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:11.370735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:11.370735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:11.370735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:11.370735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:11.370735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:11.370735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:11.370735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:11.372690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:11.372690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:11.372690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:11.372690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:11.372690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:11.372690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:11.372690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:11.372690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:11.372690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:11.372690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:11.372690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:11.372690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:11.372690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:11.372690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:11.372690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:11.372690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:11.372690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:11.374719 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:11.374719 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:11.374719 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:11.374719 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:11.374719 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 241/488] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:11.380601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed204d1-fd2c-41fb-a314-927f64eaa7e4 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:11.488644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed204d1-fd2c-41fb-a314-927f64eaa7e4 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:11.514734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f898f-47f6-4843-ae85-28425e31707c None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:11.528036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364a272-2a3a-4341-8488-86c35de36858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:11.528776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364a272-2a3a-4341-8488-86c35de36858 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:11.529060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364a272-2a3a-4341-8488-86c35de36858 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:11.529521 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364a272-2a3a-4341-8488-86c35de36858 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:11.530767 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364a272-2a3a-4341-8488-86c35de36858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:11.531085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364a272-2a3a-4341-8488-86c35de36858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:11.533049 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364a272-2a3a-4341-8488-86c35de36858 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:11.550191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 242/489] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:11.551614 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462b692-5603-493e-8217-2b944f4d5be7 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:11.551905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462b692-5603-493e-8217-2b944f4d5be7 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:11.552182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462b692-5603-493e-8217-2b944f4d5be7 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:11.553166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908bd07-9268-4488-a1e4-b3756b338e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:11.554077 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908bd07-9268-4488-a1e4-b3756b338e2d None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:11.554561 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908bd07-9268-4488-a1e4-b3756b338e2d None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:11.555085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908bd07-9268-4488-a1e4-b3756b338e2d None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:11.556081 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908bd07-9268-4488-a1e4-b3756b338e2d None admin] RBAC: Adding query filter params (name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:11.557198 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908bd07-9268-4488-a1e4-b3756b338e2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:11.558322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 243/490] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:11.559135 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908bd07-9268-4488-a1e4-b3756b338e2d None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:11.559329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462b692-5603-493e-8217-2b944f4d5be7 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:11.568917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 248/491] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:20:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:11.570890 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab51208-ddc7-439e-b0fb-eeb229c852ca None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:11.571390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab51208-ddc7-439e-b0fb-eeb229c852ca None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:11.571854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab51208-ddc7-439e-b0fb-eeb229c852ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:11.589706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-5ab51208-ddc7-439e-b0fb-eeb229c852ca None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:11.591275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-5ab51208-ddc7-439e-b0fb-eeb229c852ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:11.668619 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 249/492] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:11.669801 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab51208-ddc7-439e-b0fb-eeb229c852ca None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:11.685516 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462b692-5603-493e-8217-2b944f4d5be7 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:11.729434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc05c6-092f-4a10-8b24-39bf435b6725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:11.730315 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc05c6-092f-4a10-8b24-39bf435b6725 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:11.730914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc05c6-092f-4a10-8b24-39bf435b6725 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:11.731419 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc05c6-092f-4a10-8b24-39bf435b6725 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:11.739567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc05c6-092f-4a10-8b24-39bf435b6725 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:11.740958 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc05c6-092f-4a10-8b24-39bf435b6725 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:11.757119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-97cc05c6-092f-4a10-8b24-39bf435b6725 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 06 23:20:11.757119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:11.757119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:11.757119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:11.757119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:11.757119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:11.757119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:11.757119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:11.757119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:11.757119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:11.757119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:11.757119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:11.757119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:11.757119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:11.757119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:11.757119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:11.758002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:11.758002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:11.758002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:11.758002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:11.758002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:11.758002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:11.758002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:11.758002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:11.758002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:11.758002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:11.758002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:11.758002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:11.758002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:11.758002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:11.758002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:11.758002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:11.758002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:11.758002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:11.758907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:11.758907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:11.758907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:11.758907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:11.758907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:11.758907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:11.758907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:11.758907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:11.758907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 06 23:20:11.758907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:11.758907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 244/493] 10.222.0.60 () {56 vars in 1093 bytes} [Fri May 6 23:20:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:11.759561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc05c6-092f-4a10-8b24-39bf435b6725 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:11.796881 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab51208-ddc7-439e-b0fb-eeb229c852ca None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:11.831986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177936c3-c744-4b5b-a1b1-f301ce0009be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:11.832801 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177936c3-c744-4b5b-a1b1-f301ce0009be None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:11.833086 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177936c3-c744-4b5b-a1b1-f301ce0009be None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:11.833358 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177936c3-c744-4b5b-a1b1-f301ce0009be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:11.844047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177936c3-c744-4b5b-a1b1-f301ce0009be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:11.845610 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177936c3-c744-4b5b-a1b1-f301ce0009be None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:11.861609 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc05c6-092f-4a10-8b24-39bf435b6725 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:11.863759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-177936c3-c744-4b5b-a1b1-f301ce0009be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:11.863759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:11.863759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:11.863759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:11.863759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:11.863759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:11.863759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:11.863759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:11.863759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:11.863759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:11.863759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:11.863759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:11.863759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:11.863759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:11.863759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:11.864789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:11.864789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:11.864789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:11.864789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:11.864789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:11.864789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:11.864789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:11.864789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:11.864789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:11.864789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:11.864789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:11.864789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:11.864789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:11.864789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:11.864789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:11.864789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:11.864789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:11.865718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:11.865718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:11.865718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:11.865718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:11.865718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 250/494] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:11.866363 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7033d3-99e1-459f-9ce8-8920ac0fe0a6 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:11.866647 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7033d3-99e1-459f-9ce8-8920ac0fe0a6 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:11.866915 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7033d3-99e1-459f-9ce8-8920ac0fe0a6 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:11.868284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 251/495] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:11.872580 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7033d3-99e1-459f-9ce8-8920ac0fe0a6 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:11.901486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bbb9c-ec2c-49ce-b102-6e5d41b27fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:11.902264 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bbb9c-ec2c-49ce-b102-6e5d41b27fac None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:11.902541 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bbb9c-ec2c-49ce-b102-6e5d41b27fac None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:11.902808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bbb9c-ec2c-49ce-b102-6e5d41b27fac None admin] PATH_INFO: `/v3/roles/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:11.912495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861bbb9c-ec2c-49ce-b102-6e5d41b27fac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:11.920597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-861bbb9c-ec2c-49ce-b102-6e5d41b27fac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:11.920597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:11.920597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:11.920597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:11.920597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:11.920597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:11.920597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:11.920597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:11.920597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:11.920597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:11.920597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:11.920597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:11.920597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:11.920597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:11.920597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:11.920597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:11.921471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:11.921471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:11.921471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:11.921471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:11.921471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:11.921471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:11.921471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:11.921471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:11.921471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:11.921471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:11.921471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:11.921471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:11.921471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:11.921471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:11.921471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:11.921471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:11.922289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:11.922289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:11.922289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:11.922289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:11.922289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:11.922289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:11.922289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:11.922289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:11.922289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:11.922289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:11.922289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:11.922289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:11.922289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 245/496] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:11.922929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bbb9c-ec2c-49ce-b102-6e5d41b27fac None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:11.971252 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7033d3-99e1-459f-9ce8-8920ac0fe0a6 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:12.003626 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f256adb-6e7c-439c-83f4-503c93d1e828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:12.004207 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f256adb-6e7c-439c-83f4-503c93d1e828 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:12.004487 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f256adb-6e7c-439c-83f4-503c93d1e828 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:12.004786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f256adb-6e7c-439c-83f4-503c93d1e828 None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:12.005610 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f256adb-6e7c-439c-83f4-503c93d1e828 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:12.005965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f256adb-6e7c-439c-83f4-503c93d1e828 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:12.007392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f256adb-6e7c-439c-83f4-503c93d1e828 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:12.020086 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bbb9c-ec2c-49ce-b102-6e5d41b27fac None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:12.052068 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 252/497] 10.222.0.60 () {56 vars in 1133 bytes} [Fri May 6 23:20:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:12.052068 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf4f0e-989a-49f0-af00-400f7d37daf1 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:12.052068 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf4f0e-989a-49f0-af00-400f7d37daf1 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:12.052068 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf4f0e-989a-49f0-af00-400f7d37daf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:12.065278 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408fbdb-2da7-4116-8b5a-ac9adf5e066f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:12.065941 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408fbdb-2da7-4116-8b5a-ac9adf5e066f None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:12.066255 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408fbdb-2da7-4116-8b5a-ac9adf5e066f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:12.066493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408fbdb-2da7-4116-8b5a-ac9adf5e066f None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:12.067222 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408fbdb-2da7-4116-8b5a-ac9adf5e066f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:12.067319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-a1cf4f0e-989a-49f0-af00-400f7d37daf1 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:12.067531 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408fbdb-2da7-4116-8b5a-ac9adf5e066f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:12.068477 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-a1cf4f0e-989a-49f0-af00-400f7d37daf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:12.068962 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408fbdb-2da7-4116-8b5a-ac9adf5e066f None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:12.085629 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 246/498] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:12.085629 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408fbdb-2da7-4116-8b5a-ac9adf5e066f None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:12.139260 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 253/499] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:12.140261 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf4f0e-989a-49f0-af00-400f7d37daf1 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:12.194106 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408fbdb-2da7-4116-8b5a-ac9adf5e066f None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:12.226620 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e1749-bfe4-453c-9020-13aad8c8973c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:12.227285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e1749-bfe4-453c-9020-13aad8c8973c None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:12.227566 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e1749-bfe4-453c-9020-13aad8c8973c None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:12.228719 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e1749-bfe4-453c-9020-13aad8c8973c None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:12.229152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e1749-bfe4-453c-9020-13aad8c8973c None admin] RBAC: Adding query filter params (name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:12.229459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e1749-bfe4-453c-9020-13aad8c8973c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:12.230905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e1749-bfe4-453c-9020-13aad8c8973c None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:12.243350 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 247/500] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:20:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:12.243490 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf4f0e-989a-49f0-af00-400f7d37daf1 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:12.243588 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e1749-bfe4-453c-9020-13aad8c8973c None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:12.272769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e20f0-04ab-465b-8e94-7471d578f397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:12.273426 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e20f0-04ab-465b-8e94-7471d578f397 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:12.273707 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e20f0-04ab-465b-8e94-7471d578f397 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:12.273977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e20f0-04ab-465b-8e94-7471d578f397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:12.339814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e20f0-04ab-465b-8e94-7471d578f397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:12.341319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e20f0-04ab-465b-8e94-7471d578f397 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:12.346297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e1749-bfe4-453c-9020-13aad8c8973c None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:12.389094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7181551-09ac-41ec-a7cf-e546d667d2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:12.389952 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7181551-09ac-41ec-a7cf-e546d667d2e8 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:12.390235 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7181551-09ac-41ec-a7cf-e546d667d2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:12.390513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7181551-09ac-41ec-a7cf-e546d667d2e8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:12.398915 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7181551-09ac-41ec-a7cf-e546d667d2e8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:12.400971 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7181551-09ac-41ec-a7cf-e546d667d2e8 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:12.415594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-f7181551-09ac-41ec-a7cf-e546d667d2e8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 06 23:20:12.415594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:12.415594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:12.415594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:12.415594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:12.415594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:12.415594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:12.415594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:12.415594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:12.415594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:12.415594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:12.415594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:12.415594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:12.415594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:12.415594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:12.415594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:12.417335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:12.417335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:12.417335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:12.417335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:12.417335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:12.417335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:12.417335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:12.417335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:12.417335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:12.417335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:12.417335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:12.417335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:12.417335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:12.417335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:12.417335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:12.417335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:12.417335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:12.417335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:12.423032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:12.423032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:12.423032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:12.423032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:12.423032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:12.423032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:12.423032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:12.423032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:12.423032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 06 23:20:12.423032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:12.423032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 248/501] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:20:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:12.423032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7181551-09ac-41ec-a7cf-e546d667d2e8 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:12.452596 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 254/502] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:20:12.452596 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e20f0-04ab-465b-8e94-7471d578f397 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:12.520046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7181551-09ac-41ec-a7cf-e546d667d2e8 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:12.550075 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e20f0-04ab-465b-8e94-7471d578f397 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:12.555866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390ad66-9cee-4be3-8959-37e6d526bc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:12.557206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390ad66-9cee-4be3-8959-37e6d526bc30 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:12.557489 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390ad66-9cee-4be3-8959-37e6d526bc30 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:12.557762 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390ad66-9cee-4be3-8959-37e6d526bc30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:12.569516 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390ad66-9cee-4be3-8959-37e6d526bc30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:12.580098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-8390ad66-9cee-4be3-8959-37e6d526bc30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:12.580098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:12.580098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:12.580098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:12.580098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:12.580098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:12.580098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:12.580098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:12.580098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:12.580098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:12.580098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:12.580098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:12.580098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:12.580098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:12.580098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:12.580098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:12.581229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:12.581229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:12.581229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:12.581229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:12.581229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:12.581229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:12.581229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:12.581229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:12.581229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:12.581229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:12.581229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:12.581229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:12.581229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:12.581229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:12.581229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:12.581229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:12.582081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:12.582081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:12.582081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:12.582081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:12.582081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:12.582081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:12.582081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:12.582081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:12.582081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:12.582081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:12.582081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:12.582081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:12.582081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 249/503] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:12.582859 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390ad66-9cee-4be3-8959-37e6d526bc30 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:12.587960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2c2d7-cc9a-4a38-ac09-291c47ee4978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:12.589025 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2c2d7-cc9a-4a38-ac09-291c47ee4978 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:12.589304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2c2d7-cc9a-4a38-ac09-291c47ee4978 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:12.589575 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2c2d7-cc9a-4a38-ac09-291c47ee4978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:12.599322 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2c2d7-cc9a-4a38-ac09-291c47ee4978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:12.600799 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2c2d7-cc9a-4a38-ac09-291c47ee4978 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:12.617758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-14d2c2d7-cc9a-4a38-ac09-291c47ee4978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:12.617758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:12.617758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:12.617758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:12.617758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:12.617758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:12.617758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:12.617758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:12.617758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:12.617758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:12.617758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:12.617758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:12.617758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:12.617758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:12.617758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:12.618769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:12.618769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:12.618769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:12.618769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:12.618769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:12.618769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:12.618769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:12.618769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:12.618769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:12.618769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:12.618769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:12.618769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:12.618769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:12.618769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:12.618769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:12.618769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:12.618769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:12.620638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:12.620638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:12.620638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:12.620638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:12.623958 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 255/504] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:12.624678 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2c2d7-cc9a-4a38-ac09-291c47ee4978 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:12.680487 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390ad66-9cee-4be3-8959-37e6d526bc30 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:12.711415 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d74af-ead4-46bc-ac5b-9d4b951dfa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:12.712068 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d74af-ead4-46bc-ac5b-9d4b951dfa1c None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:12.712345 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d74af-ead4-46bc-ac5b-9d4b951dfa1c None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:12.712676 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d74af-ead4-46bc-ac5b-9d4b951dfa1c None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:12.713499 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d74af-ead4-46bc-ac5b-9d4b951dfa1c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:12.714071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d74af-ead4-46bc-ac5b-9d4b951dfa1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:12.715246 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2c2d7-cc9a-4a38-ac09-291c47ee4978 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:12.715481 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d74af-ead4-46bc-ac5b-9d4b951dfa1c None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:12.746791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06f66f-486c-4501-aeb6-ddf772a69a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:12.747617 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06f66f-486c-4501-aeb6-ddf772a69a69 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:12.747902 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06f66f-486c-4501-aeb6-ddf772a69a69 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:12.748172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06f66f-486c-4501-aeb6-ddf772a69a69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:12.751245 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 250/505] 10.222.0.60 () {56 vars in 1137 bytes} [Fri May 6 23:20:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:12.752452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2c138-4e84-4354-9361-e0ad62e8330f None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:12.752773 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2c138-4e84-4354-9361-e0ad62e8330f None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:12.753047 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2c138-4e84-4354-9361-e0ad62e8330f None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:12.754392 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 251/506] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:12.756576 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2c138-4e84-4354-9361-e0ad62e8330f None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:12.758929 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06f66f-486c-4501-aeb6-ddf772a69a69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:12.760509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06f66f-486c-4501-aeb6-ddf772a69a69 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:12.777271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-8d06f66f-486c-4501-aeb6-ddf772a69a69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:12.777271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:12.777271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:12.777271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:12.777271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:12.777271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:12.777271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:12.777271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:12.777271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:12.777271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:12.777271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:12.777271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:12.777271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:12.777271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:12.777271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:12.778329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:12.778329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:12.778329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:12.778329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:12.778329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:12.778329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:12.778329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:12.778329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:12.778329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:12.778329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:12.778329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:12.778329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:12.778329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:12.778329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:12.778329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:12.778329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:12.778329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:12.779383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:12.779383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:12.779383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:12.779383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:12.779383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 256/507] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:12.779383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06f66f-486c-4501-aeb6-ddf772a69a69 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:12.855188 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2c138-4e84-4354-9361-e0ad62e8330f None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:12.872986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06f66f-486c-4501-aeb6-ddf772a69a69 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:12.887273 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321200f7-23af-4959-8e14-1ed17c1f2784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:12.887930 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321200f7-23af-4959-8e14-1ed17c1f2784 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:12.888212 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321200f7-23af-4959-8e14-1ed17c1f2784 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:12.888490 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321200f7-23af-4959-8e14-1ed17c1f2784 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:12.889334 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321200f7-23af-4959-8e14-1ed17c1f2784 None admin] RBAC: Adding query filter params (name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:12.889639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321200f7-23af-4959-8e14-1ed17c1f2784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:12.891027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321200f7-23af-4959-8e14-1ed17c1f2784 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:12.898543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 252/508] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:20:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:12.899320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321200f7-23af-4959-8e14-1ed17c1f2784 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:12.904982 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb3f31-ff0d-4c91-b049-75473c4f9c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:12.905641 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb3f31-ff0d-4c91-b049-75473c4f9c76 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:12.905923 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb3f31-ff0d-4c91-b049-75473c4f9c76 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:12.906197 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb3f31-ff0d-4c91-b049-75473c4f9c76 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:12.906910 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb3f31-ff0d-4c91-b049-75473c4f9c76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:12.907216 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb3f31-ff0d-4c91-b049-75473c4f9c76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:12.908621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb3f31-ff0d-4c91-b049-75473c4f9c76 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:12.920520 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 257/509] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:12.921731 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e4f1f-9276-4413-944a-286de126b217 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:12.921994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e4f1f-9276-4413-944a-286de126b217 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:12.922268 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e4f1f-9276-4413-944a-286de126b217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:12.937417 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-ae9e4f1f-9276-4413-944a-286de126b217 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:12.938594 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-ae9e4f1f-9276-4413-944a-286de126b217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:12.992121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321200f7-23af-4959-8e14-1ed17c1f2784 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:13.002249 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 258/510] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:13.003053 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e4f1f-9276-4413-944a-286de126b217 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:13.027075 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6e240-f407-4034-b3ad-0ed14b4355e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:13.027716 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6e240-f407-4034-b3ad-0ed14b4355e4 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:13.027994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6e240-f407-4034-b3ad-0ed14b4355e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:13.028268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6e240-f407-4034-b3ad-0ed14b4355e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:13.091252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6e240-f407-4034-b3ad-0ed14b4355e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:13.092723 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6e240-f407-4034-b3ad-0ed14b4355e4 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:13.094418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e4f1f-9276-4413-944a-286de126b217 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:13.126728 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab00084-71c1-4372-a71a-e7c14dade09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:13.127374 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab00084-71c1-4372-a71a-e7c14dade09a None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:13.127653 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab00084-71c1-4372-a71a-e7c14dade09a None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:13.127923 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab00084-71c1-4372-a71a-e7c14dade09a None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:13.128662 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab00084-71c1-4372-a71a-e7c14dade09a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:13.128962 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab00084-71c1-4372-a71a-e7c14dade09a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:13.130322 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab00084-71c1-4372-a71a-e7c14dade09a None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:13.141358 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 259/511] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:13.142131 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab00084-71c1-4372-a71a-e7c14dade09a None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:13.184971 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 253/512] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:20:13.185792 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6e240-f407-4034-b3ad-0ed14b4355e4 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:13.233339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab00084-71c1-4372-a71a-e7c14dade09a None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:13.264779 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91615b3-fb4b-472b-80ee-9563e906e7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:13.265552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91615b3-fb4b-472b-80ee-9563e906e7b2 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:13.265828 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91615b3-fb4b-472b-80ee-9563e906e7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:13.266096 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91615b3-fb4b-472b-80ee-9563e906e7b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:13.276461 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91615b3-fb4b-472b-80ee-9563e906e7b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:13.277918 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91615b3-fb4b-472b-80ee-9563e906e7b2 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:13.280169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6e240-f407-4034-b3ad-0ed14b4355e4 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:13.294362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-f91615b3-fb4b-472b-80ee-9563e906e7b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:13.294362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:13.294362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:13.294362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:13.294362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:13.294362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:13.294362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:13.294362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:13.294362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:13.294362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:13.294362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:13.294362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:13.294362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:13.294362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:13.294362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:13.295218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:13.295218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:13.295218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:13.295218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:13.295218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:13.295218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:13.295218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:13.295218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:13.295218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:13.295218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:13.295218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:13.295218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:13.295218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:13.295218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:13.295218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:13.295218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:13.295218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:13.300770 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:13.300770 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:13.300770 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:13.300770 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:13.300770 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 260/513] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:13.300770 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91615b3-fb4b-472b-80ee-9563e906e7b2 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:13.312731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b627a-a78e-469b-879d-465fca2ff500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:13.313515 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b627a-a78e-469b-879d-465fca2ff500 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:13.313796 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b627a-a78e-469b-879d-465fca2ff500 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:13.314067 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b627a-a78e-469b-879d-465fca2ff500 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:13.320828 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b627a-a78e-469b-879d-465fca2ff500 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:13.322326 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b627a-a78e-469b-879d-465fca2ff500 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:13.337406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-8a6b627a-a78e-469b-879d-465fca2ff500 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 06 23:20:13.337406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:13.337406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:13.337406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:13.337406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:13.337406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:13.337406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:13.337406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:13.337406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:13.337406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:13.337406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:13.337406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:13.337406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:13.337406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:13.337406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:13.337406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:13.339383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:13.339383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:13.339383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:13.339383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:13.339383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:13.339383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:13.339383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:13.339383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:13.339383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:13.339383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:13.339383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:13.339383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:13.339383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:13.339383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:13.339383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:13.339383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:13.339383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:13.339383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:13.340829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:13.340829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:13.340829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:13.340829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:13.340829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:13.340829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:13.340829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:13.340829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:13.340829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 06 23:20:13.340829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:13.340829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 254/514] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:20:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:13.340829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b627a-a78e-469b-879d-465fca2ff500 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:13.391312 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91615b3-fb4b-472b-80ee-9563e906e7b2 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:13.422552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abc6a9-b48b-41e8-ba6f-1cc1b094dcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:13.423326 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abc6a9-b48b-41e8-ba6f-1cc1b094dcb1 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:13.423604 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abc6a9-b48b-41e8-ba6f-1cc1b094dcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:13.423874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abc6a9-b48b-41e8-ba6f-1cc1b094dcb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:13.432814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b627a-a78e-469b-879d-465fca2ff500 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:13.433806 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7abc6a9-b48b-41e8-ba6f-1cc1b094dcb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:13.435251 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7abc6a9-b48b-41e8-ba6f-1cc1b094dcb1 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:13.451861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-f7abc6a9-b48b-41e8-ba6f-1cc1b094dcb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:13.451861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:13.451861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:13.451861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:13.451861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:13.451861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:13.451861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:13.451861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:13.451861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:13.451861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:13.451861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:13.451861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:13.451861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:13.451861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:13.451861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:13.452886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:13.452886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:13.452886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:13.452886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:13.452886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:13.452886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:13.452886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:13.452886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:13.452886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:13.452886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:13.452886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:13.452886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:13.452886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:13.452886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:13.452886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:13.452886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:13.452886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:13.453725 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:13.453725 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:13.453725 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:13.453725 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:13.453725 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 261/515] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:13.453990 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abc6a9-b48b-41e8-ba6f-1cc1b094dcb1 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:13.465477 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088ca6c-7c1d-44f2-9401-9b90c2270c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:13.466261 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088ca6c-7c1d-44f2-9401-9b90c2270c2d None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:13.466534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088ca6c-7c1d-44f2-9401-9b90c2270c2d None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:13.466802 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088ca6c-7c1d-44f2-9401-9b90c2270c2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:13.473382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088ca6c-7c1d-44f2-9401-9b90c2270c2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:13.474880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088ca6c-7c1d-44f2-9401-9b90c2270c2d None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:13.489121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-2088ca6c-7c1d-44f2-9401-9b90c2270c2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:13.489121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:13.489121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:13.489121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:13.489121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:13.489121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:13.489121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:13.489121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:13.489121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:13.489121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:13.489121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:13.489121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:13.489121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:13.489121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:13.489121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:13.489949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:13.489949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:13.489949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:13.489949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:13.489949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:13.489949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:13.489949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:13.489949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:13.489949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:13.489949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:13.489949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:13.489949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:13.489949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:13.489949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:13.489949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:13.489949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:13.489949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:13.490814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:13.490814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:13.490814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:13.490814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:13.490814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:13.490814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:13.490814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:13.490814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:13.490814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 255/516] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:13.491271 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088ca6c-7c1d-44f2-9401-9b90c2270c2d None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:13.551767 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abc6a9-b48b-41e8-ba6f-1cc1b094dcb1 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:13.582134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088ca6c-7c1d-44f2-9401-9b90c2270c2d None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:13.582935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87d11e-d628-41d9-a263-dd3059b9697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:13.583711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87d11e-d628-41d9-a263-dd3059b9697a None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:13.583995 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87d11e-d628-41d9-a263-dd3059b9697a None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:13.584270 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87d11e-d628-41d9-a263-dd3059b9697a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:13.594817 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87d11e-d628-41d9-a263-dd3059b9697a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:13.596288 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87d11e-d628-41d9-a263-dd3059b9697a None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:13.612867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-7f87d11e-d628-41d9-a263-dd3059b9697a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:13.612867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:13.612867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:13.612867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:13.612867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:13.612867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:13.612867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:13.612867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:13.612867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:13.612867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:13.612867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:13.612867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:13.612867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:13.612867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:13.612867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:13.613690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:13.613690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:13.613690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:13.613690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:13.613690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:13.613690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:13.613690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:13.613690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:13.613690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:13.613690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:13.613690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:13.613690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:13.613690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:13.613690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:13.613690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:13.613690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:13.613690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:13.614510 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:13.614510 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:13.614510 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:13.614510 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:13.614722 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e0977-810e-4425-b04d-92bb5ac71f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:13.614722 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e0977-810e-4425-b04d-92bb5ac71f52 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:13.614860 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 262/517] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:13.614924 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e0977-810e-4425-b04d-92bb5ac71f52 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:13.614924 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e0977-810e-4425-b04d-92bb5ac71f52 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:13.615047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87d11e-d628-41d9-a263-dd3059b9697a None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:13.615713 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e0977-810e-4425-b04d-92bb5ac71f52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:13.615713 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e0977-810e-4425-b04d-92bb5ac71f52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:13.616913 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e0977-810e-4425-b04d-92bb5ac71f52 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:13.629218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 256/518] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:13.630001 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e0977-810e-4425-b04d-92bb5ac71f52 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:13.706416 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87d11e-d628-41d9-a263-dd3059b9697a None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:13.721777 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e0977-810e-4425-b04d-92bb5ac71f52 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:13.737967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7cb68-eca4-4908-abef-ef3489c34e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:13.738617 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7cb68-eca4-4908-abef-ef3489c34e63 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:13.738895 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7cb68-eca4-4908-abef-ef3489c34e63 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:13.739162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7cb68-eca4-4908-abef-ef3489c34e63 None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:13.739980 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7cb68-eca4-4908-abef-ef3489c34e63 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:13.740282 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7cb68-eca4-4908-abef-ef3489c34e63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:13.741743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7cb68-eca4-4908-abef-ef3489c34e63 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:13.754043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d99848-44a7-4911-a5c1-7bdf2b69780a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:13.754692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d99848-44a7-4911-a5c1-7bdf2b69780a None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:13.754970 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d99848-44a7-4911-a5c1-7bdf2b69780a None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:13.755242 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d99848-44a7-4911-a5c1-7bdf2b69780a None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:13.755953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d99848-44a7-4911-a5c1-7bdf2b69780a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:13.756260 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d99848-44a7-4911-a5c1-7bdf2b69780a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:13.757657 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d99848-44a7-4911-a5c1-7bdf2b69780a None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:13.759239 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 263/519] 10.222.0.60 () {56 vars in 1137 bytes} [Fri May 6 23:20:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:13.760620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7cb68-eca4-4908-abef-ef3489c34e63 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:13.769247 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 257/520] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:13.770169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d99848-44a7-4911-a5c1-7bdf2b69780a None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:13.853710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7cb68-eca4-4908-abef-ef3489c34e63 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:13.863042 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d99848-44a7-4911-a5c1-7bdf2b69780a None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:13.889507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c71c99-6bc5-41c8-9413-d732dae6f72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:13.890156 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c71c99-6bc5-41c8-9413-d732dae6f72d None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:13.890437 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c71c99-6bc5-41c8-9413-d732dae6f72d None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:13.890711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c71c99-6bc5-41c8-9413-d732dae6f72d None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:13.891518 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c71c99-6bc5-41c8-9413-d732dae6f72d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:13.891824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c71c99-6bc5-41c8-9413-d732dae6f72d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:13.893297 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c71c99-6bc5-41c8-9413-d732dae6f72d None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:13.895263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53649e1c-b769-4389-b2d5-93cf3038c57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:13.895906 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53649e1c-b769-4389-b2d5-93cf3038c57c None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:13.896185 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53649e1c-b769-4389-b2d5-93cf3038c57c None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:13.896458 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53649e1c-b769-4389-b2d5-93cf3038c57c None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:13.897201 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53649e1c-b769-4389-b2d5-93cf3038c57c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:13.897498 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53649e1c-b769-4389-b2d5-93cf3038c57c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:13.898854 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53649e1c-b769-4389-b2d5-93cf3038c57c None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:13.909454 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 258/521] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:13.914481 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 264/522] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:13.914644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53649e1c-b769-4389-b2d5-93cf3038c57c None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:13.914737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c71c99-6bc5-41c8-9413-d732dae6f72d None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:14.001746 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c71c99-6bc5-41c8-9413-d732dae6f72d None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:14.007106 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53649e1c-b769-4389-b2d5-93cf3038c57c None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:14.032952 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b45f85-f465-4cd2-a9bb-264c54e58952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:14.033589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b45f85-f465-4cd2-a9bb-264c54e58952 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:14.033870 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b45f85-f465-4cd2-a9bb-264c54e58952 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:14.034144 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b45f85-f465-4cd2-a9bb-264c54e58952 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:14.038425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a7d0c-2883-4fe6-af7b-0cfddb0eab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:14.039199 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a7d0c-2883-4fe6-af7b-0cfddb0eab28 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:14.039480 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a7d0c-2883-4fe6-af7b-0cfddb0eab28 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:14.039755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a7d0c-2883-4fe6-af7b-0cfddb0eab28 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:14.047085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a7d0c-2883-4fe6-af7b-0cfddb0eab28 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:14.048565 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a7d0c-2883-4fe6-af7b-0cfddb0eab28 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:14.062705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-4f3a7d0c-2883-4fe6-af7b-0cfddb0eab28 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 06 23:20:14.062705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:14.062705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:14.062705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:14.062705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:14.062705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:14.062705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:14.062705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:14.062705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:14.062705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:14.062705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:14.062705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:14.062705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:14.062705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:14.062705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:14.062705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:14.063601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:14.063601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:14.063601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:14.063601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:14.063601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:14.063601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:14.063601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:14.063601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:14.063601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:14.063601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:14.063601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:14.063601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:14.063601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:14.063601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:14.063601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:14.063601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:14.063601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:14.063601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:14.064500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:14.064500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:14.064500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:14.064500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:14.064500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:14.064500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:14.064500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:14.064500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:14.064500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 06 23:20:14.064500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:14.064500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 259/523] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:14.065680 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a7d0c-2883-4fe6-af7b-0cfddb0eab28 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:14.100811 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b45f85-f465-4cd2-a9bb-264c54e58952 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:14.102258 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b45f85-f465-4cd2-a9bb-264c54e58952 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:14.157912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a7d0c-2883-4fe6-af7b-0cfddb0eab28 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:14.188720 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf45e8f-51e3-48e8-b9e7-9cfaab2f65bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:14.189387 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf45e8f-51e3-48e8-b9e7-9cfaab2f65bd None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:14.189669 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf45e8f-51e3-48e8-b9e7-9cfaab2f65bd None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:14.189946 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf45e8f-51e3-48e8-b9e7-9cfaab2f65bd None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:14.190644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf45e8f-51e3-48e8-b9e7-9cfaab2f65bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:14.192069 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf45e8f-51e3-48e8-b9e7-9cfaab2f65bd None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:14.192483 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 265/524] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:20:14.193321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b45f85-f465-4cd2-a9bb-264c54e58952 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:14.220611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 260/525] 10.222.0.60 () {60 vars in 1132 bytes} [Fri May 6 23:20:14 2022] POST /identity/v3/users => generated 247 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:20:14.220611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf45e8f-51e3-48e8-b9e7-9cfaab2f65bd None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:14.302557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b45f85-f465-4cd2-a9bb-264c54e58952 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:14.320090 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf45e8f-51e3-48e8-b9e7-9cfaab2f65bd None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:14.338315 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5598a1-04ba-4e37-aeb1-722b495aab7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:14.339377 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5598a1-04ba-4e37-aeb1-722b495aab7a None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:14.339653 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5598a1-04ba-4e37-aeb1-722b495aab7a None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:14.339920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5598a1-04ba-4e37-aeb1-722b495aab7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:14.347171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5598a1-04ba-4e37-aeb1-722b495aab7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:14.348715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5598a1-04ba-4e37-aeb1-722b495aab7a None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:14.356773 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7aa1e7-ce6e-4b33-ac79-713583182baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:14.357435 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7aa1e7-ce6e-4b33-ac79-713583182baa None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:14.357716 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7aa1e7-ce6e-4b33-ac79-713583182baa None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:14.357991 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7aa1e7-ce6e-4b33-ac79-713583182baa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:14.358831 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7aa1e7-ce6e-4b33-ac79-713583182baa None admin] RBAC: Adding query filter params (role.id=71050e310414462b8d07f901fef201ad, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=9b74631c6e1547d991753a65c41bc7e7) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:14.359143 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7aa1e7-ce6e-4b33-ac79-713583182baa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:14.360632 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7aa1e7-ce6e-4b33-ac79-713583182baa None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:14.363967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-8f5598a1-04ba-4e37-aeb1-722b495aab7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:14.363967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:14.363967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:14.363967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:14.363967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:14.363967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:14.363967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:14.363967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:14.363967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:14.363967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:14.363967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:14.363967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:14.363967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:14.363967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:14.363967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:14.364836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:14.364836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:14.364836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:14.364836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:14.364836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:14.364836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:14.364836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:14.364836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:14.364836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:14.364836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:14.364836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:14.364836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:14.364836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:14.364836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:14.364836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:14.364836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:14.364836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:14.371512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:14.371512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:14.371512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:14.371512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:14.371512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:14.371512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:14.371512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:14.371512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:14.371512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 266/526] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:14.371512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5598a1-04ba-4e37-aeb1-722b495aab7a None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:14.376897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 261/527] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:20:14 2022] GET /identity/v3/role_assignments?user.id=9b74631c6e1547d991753a65c41bc7e7&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=71050e310414462b8d07f901fef201ad => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:14.377751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7aa1e7-ce6e-4b33-ac79-713583182baa None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:14.486906 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7aa1e7-ce6e-4b33-ac79-713583182baa None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:14.498744 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5598a1-04ba-4e37-aeb1-722b495aab7a None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:14.524529 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad44836-15cc-4057-acf5-4ddd80bd9df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:14.525905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad44836-15cc-4057-acf5-4ddd80bd9df1 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:14.526185 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad44836-15cc-4057-acf5-4ddd80bd9df1 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:14.526456 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad44836-15cc-4057-acf5-4ddd80bd9df1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:14.538487 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad44836-15cc-4057-acf5-4ddd80bd9df1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:14.539988 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad44836-15cc-4057-acf5-4ddd80bd9df1 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:14.567459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-4ad44836-15cc-4057-acf5-4ddd80bd9df1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:14.567459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:14.567459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:14.567459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:14.567459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:14.567459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:14.567459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:14.567459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:14.567459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:14.567459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:14.567459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:14.567459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:14.567459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:14.567459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:14.567459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:14.568316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:14.568316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:14.568316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:14.568316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:14.568316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:14.568316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:14.568316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:14.568316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:14.568316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:14.568316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:14.568316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:14.568316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:14.568316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:14.568316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:14.568316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:14.568316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:14.568316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:14.569174 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:14.569174 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:14.569174 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:14.569174 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:14.575144 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 262/528] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:14.575144 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad44836-15cc-4057-acf5-4ddd80bd9df1 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:14.581528 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28005dda-f356-4e8f-8767-c4e985fafce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:14.582034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28005dda-f356-4e8f-8767-c4e985fafce0 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:14.582321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28005dda-f356-4e8f-8767-c4e985fafce0 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:14.582593 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28005dda-f356-4e8f-8767-c4e985fafce0 None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:14.583876 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28005dda-f356-4e8f-8767-c4e985fafce0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:14.584194 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28005dda-f356-4e8f-8767-c4e985fafce0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:14.585688 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28005dda-f356-4e8f-8767-c4e985fafce0 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:14.607249 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 267/529] 10.222.0.60 () {56 vars in 1139 bytes} [Fri May 6 23:20:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:14.608039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28005dda-f356-4e8f-8767-c4e985fafce0 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:14.711673 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad44836-15cc-4057-acf5-4ddd80bd9df1 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:14.733583 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28005dda-f356-4e8f-8767-c4e985fafce0 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:14.768742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f3d25-f052-451c-a57b-b3d715fc142e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:14.770193 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f3d25-f052-451c-a57b-b3d715fc142e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:14.770689 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f3d25-f052-451c-a57b-b3d715fc142e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:14.771150 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f3d25-f052-451c-a57b-b3d715fc142e None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:14.772129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f3d25-f052-451c-a57b-b3d715fc142e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:14.772654 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f3d25-f052-451c-a57b-b3d715fc142e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:14.776470 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f3d25-f052-451c-a57b-b3d715fc142e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:14.777559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9c075-6175-4908-a017-b63bdae12d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:14.778225 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9c075-6175-4908-a017-b63bdae12d38 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:14.778507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9c075-6175-4908-a017-b63bdae12d38 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:14.778784 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9c075-6175-4908-a017-b63bdae12d38 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:14.779510 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9c075-6175-4908-a017-b63bdae12d38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:14.779817 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9c075-6175-4908-a017-b63bdae12d38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:14.781225 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9c075-6175-4908-a017-b63bdae12d38 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:14.797407 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 268/530] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:14.798655 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9c075-6175-4908-a017-b63bdae12d38 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:14.818610 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 263/531] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:14.819930 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f3d25-f052-451c-a57b-b3d715fc142e None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:14.937185 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f3d25-f052-451c-a57b-b3d715fc142e None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:14.973094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86444c2-11af-4cb1-aa23-ea791412a329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:14.974231 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86444c2-11af-4cb1-aa23-ea791412a329 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:14.974850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86444c2-11af-4cb1-aa23-ea791412a329 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:14.975321 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86444c2-11af-4cb1-aa23-ea791412a329 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:14.983231 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86444c2-11af-4cb1-aa23-ea791412a329 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:14.985061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86444c2-11af-4cb1-aa23-ea791412a329 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:14.999919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-c86444c2-11af-4cb1-aa23-ea791412a329 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:14.999919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:14.999919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:14.999919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:14.999919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:14.999919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:14.999919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:14.999919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:14.999919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:14.999919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:14.999919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:14.999919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:14.999919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:14.999919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:14.999919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:15.000848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:15.000848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:15.000848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:15.000848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:15.000848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:15.000848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:15.000848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:15.000848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:15.000848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:15.000848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:15.000848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:15.000848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:15.000848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:15.000848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:15.000848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:15.000848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:15.000848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:15.001677 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:15.001677 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:15.001677 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:15.001677 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:15.001677 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:15.001677 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:15.001677 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:15.001677 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:15.008392 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 264/532] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:15.010087 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86444c2-11af-4cb1-aa23-ea791412a329 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:15.022085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9c075-6175-4908-a017-b63bdae12d38 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:15.102088 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61eadd-8dfe-4d8a-a27f-608a8cae5d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:15.102513 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61eadd-8dfe-4d8a-a27f-608a8cae5d08 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:15.102800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61eadd-8dfe-4d8a-a27f-608a8cae5d08 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:15.103596 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61eadd-8dfe-4d8a-a27f-608a8cae5d08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:15.130285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86444c2-11af-4cb1-aa23-ea791412a329 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:15.168633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c152b45-ce4f-4a8e-b776-0a35d2554439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:15.169619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c152b45-ce4f-4a8e-b776-0a35d2554439 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:15.170112 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c152b45-ce4f-4a8e-b776-0a35d2554439 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:15.170600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c152b45-ce4f-4a8e-b776-0a35d2554439 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:15.171709 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c152b45-ce4f-4a8e-b776-0a35d2554439 None admin] RBAC: Adding query filter params (role.id=71050e310414462b8d07f901fef201ad, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=a63ecc7210574058aad75a3114b57202) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:15.172211 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c152b45-ce4f-4a8e-b776-0a35d2554439 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:15.173911 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c152b45-ce4f-4a8e-b776-0a35d2554439 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:15.189182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 265/533] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:20:15 2022] GET /identity/v3/role_assignments?user.id=a63ecc7210574058aad75a3114b57202&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=71050e310414462b8d07f901fef201ad => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:15.190580 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c152b45-ce4f-4a8e-b776-0a35d2554439 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:15.212568 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61eadd-8dfe-4d8a-a27f-608a8cae5d08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:15.212568 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61eadd-8dfe-4d8a-a27f-608a8cae5d08 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:15.310092 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 269/534] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:20:15.315799 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61eadd-8dfe-4d8a-a27f-608a8cae5d08 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:15.356221 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c152b45-ce4f-4a8e-b776-0a35d2554439 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:15.401262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15311d6-cb2a-47dc-93ed-29b2e021045e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:15.402284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15311d6-cb2a-47dc-93ed-29b2e021045e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:15.402760 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15311d6-cb2a-47dc-93ed-29b2e021045e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:15.403250 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15311d6-cb2a-47dc-93ed-29b2e021045e None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:15.404228 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15311d6-cb2a-47dc-93ed-29b2e021045e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:15.404763 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15311d6-cb2a-47dc-93ed-29b2e021045e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:15.406425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15311d6-cb2a-47dc-93ed-29b2e021045e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:15.417856 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61eadd-8dfe-4d8a-a27f-608a8cae5d08 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:15.424587 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 266/535] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:15.426140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15311d6-cb2a-47dc-93ed-29b2e021045e None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:15.460761 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb37d2-8c01-492a-b010-08a6689dd1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:15.461397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb37d2-8c01-492a-b010-08a6689dd1a9 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:15.461683 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb37d2-8c01-492a-b010-08a6689dd1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:15.461962 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb37d2-8c01-492a-b010-08a6689dd1a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:15.474993 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb37d2-8c01-492a-b010-08a6689dd1a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:15.475622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb37d2-8c01-492a-b010-08a6689dd1a9 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:15.494932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-c3eb37d2-8c01-492a-b010-08a6689dd1a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:15.494932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:15.494932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:15.494932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:15.494932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:15.494932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:15.494932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:15.494932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:15.494932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:15.494932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:15.494932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:15.494932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:15.494932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:15.494932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:15.494932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:15.496279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:15.496279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:15.496279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:15.496279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:15.496279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:15.496279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:15.496279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:15.496279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:15.496279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:15.496279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:15.496279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:15.496279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:15.496279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:15.496279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:15.496279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:15.496279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:15.496279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:15.498541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:15.498541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:15.498541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:15.498541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:15.498541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 270/536] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:15.506158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb37d2-8c01-492a-b010-08a6689dd1a9 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:15.602276 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15311d6-cb2a-47dc-93ed-29b2e021045e None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:15.679646 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fbffd-dfd7-4bec-9d15-fd3ecc82e0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:15.680684 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fbffd-dfd7-4bec-9d15-fd3ecc82e0f3 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:15.684252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fbffd-dfd7-4bec-9d15-fd3ecc82e0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:15.684791 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fbffd-dfd7-4bec-9d15-fd3ecc82e0f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:15.685844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fbffd-dfd7-4bec-9d15-fd3ecc82e0f3 None admin] RBAC: Adding query filter params (role.id=71050e310414462b8d07f901fef201ad, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=36d2df2ca106409995e139652ee995e4) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:15.686398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fbffd-dfd7-4bec-9d15-fd3ecc82e0f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:15.689253 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fbffd-dfd7-4bec-9d15-fd3ecc82e0f3 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:15.704158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb37d2-8c01-492a-b010-08a6689dd1a9 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:15.712561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 267/537] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:20:15 2022] GET /identity/v3/role_assignments?user.id=36d2df2ca106409995e139652ee995e4&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=71050e310414462b8d07f901fef201ad => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:15.760726 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ed74b-1a30-489a-bea4-d07e4fdd1373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:15.761753 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ed74b-1a30-489a-bea4-d07e4fdd1373 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:15.762256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ed74b-1a30-489a-bea4-d07e4fdd1373 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:15.762720 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ed74b-1a30-489a-bea4-d07e4fdd1373 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:15.763635 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ed74b-1a30-489a-bea4-d07e4fdd1373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:15.764131 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ed74b-1a30-489a-bea4-d07e4fdd1373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:15.765738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ed74b-1a30-489a-bea4-d07e4fdd1373 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:15.779230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 271/538] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:15.784370 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fbffd-dfd7-4bec-9d15-fd3ecc82e0f3 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:15.972209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fbffd-dfd7-4bec-9d15-fd3ecc82e0f3 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:16.007438 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859786a7-2df0-4129-ab73-529585889041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:16.008232 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859786a7-2df0-4129-ab73-529585889041 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:16.008511 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859786a7-2df0-4129-ab73-529585889041 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:16.008812 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859786a7-2df0-4129-ab73-529585889041 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:16.015440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859786a7-2df0-4129-ab73-529585889041 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:16.016903 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859786a7-2df0-4129-ab73-529585889041 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:16.031021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-859786a7-2df0-4129-ab73-529585889041 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:16.031021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:16.031021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:16.031021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:16.031021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:16.031021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:16.031021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:16.031021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:16.031021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:16.031021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:16.031021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:16.031021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:16.031021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:16.031021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:16.031021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:16.031852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:16.031852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:16.031852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:16.031852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:16.031852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:16.031852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:16.031852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:16.031852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:16.031852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:16.031852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:16.031852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:16.031852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:16.031852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:16.031852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:16.031852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:16.031852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:16.031852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:16.032876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:16.032876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:16.032876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:16.032876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:16.032876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:16.032876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:16.032876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:16.032876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:16.032876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 268/539] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:16.037753 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ed74b-1a30-489a-bea4-d07e4fdd1373 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:16.141598 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ed74b-1a30-489a-bea4-d07e4fdd1373 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:16.176284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa1c03-ecc2-45cd-ada9-746bcd62e7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:16.177320 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa1c03-ecc2-45cd-ada9-746bcd62e7bc None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:16.177818 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa1c03-ecc2-45cd-ada9-746bcd62e7bc None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:16.178266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa1c03-ecc2-45cd-ada9-746bcd62e7bc None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:16.179269 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa1c03-ecc2-45cd-ada9-746bcd62e7bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:16.179750 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa1c03-ecc2-45cd-ada9-746bcd62e7bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:16.181409 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa1c03-ecc2-45cd-ada9-746bcd62e7bc None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:16.194502 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 272/540] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:16.201606 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859786a7-2df0-4129-ab73-529585889041 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:16.322306 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859786a7-2df0-4129-ab73-529585889041 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:16.362094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646bd89-5b8f-467c-b194-2ee088f3840e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:16.362755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646bd89-5b8f-467c-b194-2ee088f3840e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:16.363038 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646bd89-5b8f-467c-b194-2ee088f3840e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:16.363312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646bd89-5b8f-467c-b194-2ee088f3840e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:16.364148 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646bd89-5b8f-467c-b194-2ee088f3840e None admin] RBAC: Adding query filter params (role.id=71050e310414462b8d07f901fef201ad, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=046352b8553c4f23b6dda151f6f7ce00) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:16.364458 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646bd89-5b8f-467c-b194-2ee088f3840e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:16.365932 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646bd89-5b8f-467c-b194-2ee088f3840e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:16.376402 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 269/541] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:20:16 2022] GET /identity/v3/role_assignments?user.id=046352b8553c4f23b6dda151f6f7ce00&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=71050e310414462b8d07f901fef201ad => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:16.814041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723eff7-03d1-48fe-883a-635619808571 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:16.814552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723eff7-03d1-48fe-883a-635619808571 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:16.814649 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723eff7-03d1-48fe-883a-635619808571 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:16.816208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 273/542] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:16.821279 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f04b95-0e02-439b-9080-b15d0c3c1e26 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:16.821690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f04b95-0e02-439b-9080-b15d0c3c1e26 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:16.821902 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f04b95-0e02-439b-9080-b15d0c3c1e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:16.848759 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-65f04b95-0e02-439b-9080-b15d0c3c1e26 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:16.849970 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-65f04b95-0e02-439b-9080-b15d0c3c1e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:16.954377 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 270/543] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:16.986380 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723eff7-03d1-48fe-883a-635619808571 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:16.991414 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752a060-0214-45d2-a6f6-38f93f183542 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:16.991791 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752a060-0214-45d2-a6f6-38f93f183542 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:16.991966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752a060-0214-45d2-a6f6-38f93f183542 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:16.993651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 271/544] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:20:17.010012 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f238b-0d75-4aca-9ca8-47d3cfe104b0 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:17.010297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f238b-0d75-4aca-9ca8-47d3cfe104b0 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:17.010575 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f238b-0d75-4aca-9ca8-47d3cfe104b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:17.052563 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-c57f238b-0d75-4aca-9ca8-47d3cfe104b0 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:17.052563 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c57f238b-0d75-4aca-9ca8-47d3cfe104b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:17.099206 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723eff7-03d1-48fe-883a-635619808571 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:17.138281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1faee-a127-44b5-b589-7e4e1eac30c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:17.139400 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1faee-a127-44b5-b589-7e4e1eac30c2 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:17.139684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1faee-a127-44b5-b589-7e4e1eac30c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:17.140069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1faee-a127-44b5-b589-7e4e1eac30c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:17.148607 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 272/545] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 06 23:20:17.165337 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1faee-a127-44b5-b589-7e4e1eac30c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:17.175248 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f238b-0d75-4aca-9ca8-47d3cfe104b0 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:17.175427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-a5d1faee-a127-44b5-b589-7e4e1eac30c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:17.175427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:17.175427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:17.175427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:17.175427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:17.175427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:17.175427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:17.175427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:17.175427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:17.175427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:17.175427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:17.175427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:17.175427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:17.175427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:17.175427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:17.175427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:17.176232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:17.176232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:17.176232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:17.176232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:17.176232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:17.176232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:17.176232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:17.176232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:17.176232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:17.176232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:17.176232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:17.176232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:17.176232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:17.176232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:17.176232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:17.176232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:17.177281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:17.177281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:17.177281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:17.177281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:17.177281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:17.177281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:17.177281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:17.177281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:17.177281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:17.177281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:17.177281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:17.177281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:17.177281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 274/546] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:17.182362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1faee-a127-44b5-b589-7e4e1eac30c2 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:17.291670 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1faee-a127-44b5-b589-7e4e1eac30c2 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:17.342715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84759e9e-b3aa-4553-8f8a-1e9431a6eabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:17.343433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84759e9e-b3aa-4553-8f8a-1e9431a6eabf None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:17.343715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84759e9e-b3aa-4553-8f8a-1e9431a6eabf None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:17.343986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84759e9e-b3aa-4553-8f8a-1e9431a6eabf None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:17.344762 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84759e9e-b3aa-4553-8f8a-1e9431a6eabf None admin] RBAC: Adding query filter params (name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:17.345073 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84759e9e-b3aa-4553-8f8a-1e9431a6eabf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:17.346454 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84759e9e-b3aa-4553-8f8a-1e9431a6eabf None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:17.363489 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 275/547] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:20:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:17.370900 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84759e9e-b3aa-4553-8f8a-1e9431a6eabf None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:17.408122 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f238b-0d75-4aca-9ca8-47d3cfe104b0 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:17.468505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97227d31-bcbf-4001-893c-4d4ac1c67caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:17.469440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97227d31-bcbf-4001-893c-4d4ac1c67caf None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:17.469723 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97227d31-bcbf-4001-893c-4d4ac1c67caf None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:17.470043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97227d31-bcbf-4001-893c-4d4ac1c67caf None admin] PATH_INFO: `/v3/roles/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:17.491018 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97227d31-bcbf-4001-893c-4d4ac1c67caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:17.504191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-97227d31-bcbf-4001-893c-4d4ac1c67caf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:17.504191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:17.504191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:17.504191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:17.504191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:17.504191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:17.504191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:17.504191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:17.504191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:17.504191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:17.504191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:17.504191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:17.504191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:17.504191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:17.504191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:17.504191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:17.505078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:17.505078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:17.505078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:17.505078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:17.505078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:17.505078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:17.505078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:17.505078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:17.505078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:17.505078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:17.505078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:17.505078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:17.505078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:17.505078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:17.505078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:17.505078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:17.505856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:17.505856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:17.505856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:17.505856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:17.505856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:17.505856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:17.505856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:17.505856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:17.505856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:17.505856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:17.505856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:17.505856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:17.511789 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 273/548] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:17.513684 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97227d31-bcbf-4001-893c-4d4ac1c67caf None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:17.545591 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84759e9e-b3aa-4553-8f8a-1e9431a6eabf None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:17.629627 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd7b2f-f409-42be-bbaf-55ccbd270085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:17.630337 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7b2f-f409-42be-bbaf-55ccbd270085 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:17.630624 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7b2f-f409-42be-bbaf-55ccbd270085 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:17.630899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7b2f-f409-42be-bbaf-55ccbd270085 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:17.657637 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97227d31-bcbf-4001-893c-4d4ac1c67caf None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:17.661623 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd7b2f-f409-42be-bbaf-55ccbd270085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:17.663119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd7b2f-f409-42be-bbaf-55ccbd270085 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:17.689024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-b1cd7b2f-f409-42be-bbaf-55ccbd270085 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:17.689024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:17.689024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:17.689024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:17.689024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:17.689024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:17.689024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:17.689024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:17.689024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:17.689024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:17.689024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:17.689024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:17.689024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:17.689024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:17.689024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:17.691132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:17.691132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:17.691132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:17.691132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:17.691132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:17.691132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:17.691132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:17.691132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:17.691132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:17.691132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:17.691132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:17.691132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:17.691132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:17.691132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:17.691132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:17.691132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:17.691132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:17.693350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:17.693350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:17.693350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:17.693350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:17.693350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 276/549] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:17.697802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd7b2f-f409-42be-bbaf-55ccbd270085 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:17.710692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f640d-f96b-4cfa-b8dd-d6e0e7fa198e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:17.711831 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f640d-f96b-4cfa-b8dd-d6e0e7fa198e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:17.712114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f640d-f96b-4cfa-b8dd-d6e0e7fa198e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:17.712424 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f640d-f96b-4cfa-b8dd-d6e0e7fa198e None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:17.713580 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f640d-f96b-4cfa-b8dd-d6e0e7fa198e None admin] RBAC: Adding query filter params (name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:17.714147 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f640d-f96b-4cfa-b8dd-d6e0e7fa198e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:17.715581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f640d-f96b-4cfa-b8dd-d6e0e7fa198e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:17.727127 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 274/550] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:20:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:17.734078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f640d-f96b-4cfa-b8dd-d6e0e7fa198e None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:17.870424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd7b2f-f409-42be-bbaf-55ccbd270085 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:17.880088 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f640d-f96b-4cfa-b8dd-d6e0e7fa198e None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:17.904037 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa2276-43bd-454e-babc-36dd3e001f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:17.904726 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa2276-43bd-454e-babc-36dd3e001f0a None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:17.905004 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa2276-43bd-454e-babc-36dd3e001f0a None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:17.905272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa2276-43bd-454e-babc-36dd3e001f0a None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:17.905986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa2276-43bd-454e-babc-36dd3e001f0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:17.906288 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa2276-43bd-454e-babc-36dd3e001f0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:17.907658 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa2276-43bd-454e-babc-36dd3e001f0a None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:17.914637 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3f77e-cede-436a-bf4d-2747ed5cb060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:17.915434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3f77e-cede-436a-bf4d-2747ed5cb060 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:17.916324 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3f77e-cede-436a-bf4d-2747ed5cb060 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:17.916629 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3f77e-cede-436a-bf4d-2747ed5cb060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:17.921503 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 277/551] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:17.923672 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69a4eb-6ae0-464a-96ed-42c50df71768 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:17.924135 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69a4eb-6ae0-464a-96ed-42c50df71768 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:17.924447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69a4eb-6ae0-464a-96ed-42c50df71768 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:17.926170 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 278/552] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:17.927708 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3f77e-cede-436a-bf4d-2747ed5cb060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:17.927944 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69a4eb-6ae0-464a-96ed-42c50df71768 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:17.929344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3f77e-cede-436a-bf4d-2747ed5cb060 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:17.947322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-eac3f77e-cede-436a-bf4d-2747ed5cb060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:17.947322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:17.947322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:17.947322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:17.947322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:17.947322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:17.947322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:17.947322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:17.947322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:17.947322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:17.947322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:17.947322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:17.947322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:17.947322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:17.947322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:17.949376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:17.949376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:17.949376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:17.949376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:17.949376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:17.949376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:17.949376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:17.949376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:17.949376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:17.949376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:17.949376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:17.949376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:17.949376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:17.949376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:17.949376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:17.949376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:17.949376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:17.951355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:17.951355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:17.951355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:17.951355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:17.951355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 275/553] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:17.951355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce53cd-09f5-4413-b1a8-a65b4fe8c8bf None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:17.951355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce53cd-09f5-4413-b1a8-a65b4fe8c8bf None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:17.951355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce53cd-09f5-4413-b1a8-a65b4fe8c8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:17.971765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-1fce53cd-09f5-4413-b1a8-a65b4fe8c8bf None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:17.972981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-1fce53cd-09f5-4413-b1a8-a65b4fe8c8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:18.030057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69a4eb-6ae0-464a-96ed-42c50df71768 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:18.042200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 276/554] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:18.043122 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce53cd-09f5-4413-b1a8-a65b4fe8c8bf None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:18.065380 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22ef8d-7d09-4955-8e32-d5c1ad306b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:18.066167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22ef8d-7d09-4955-8e32-d5c1ad306b76 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:18.066446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22ef8d-7d09-4955-8e32-d5c1ad306b76 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:18.066715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22ef8d-7d09-4955-8e32-d5c1ad306b76 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:18.078284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22ef8d-7d09-4955-8e32-d5c1ad306b76 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:18.080742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22ef8d-7d09-4955-8e32-d5c1ad306b76 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:18.101455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-0c22ef8d-7d09-4955-8e32-d5c1ad306b76 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 06 23:20:18.101455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:18.101455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:18.101455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:18.101455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:18.101455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:18.101455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:18.101455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:18.101455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:18.101455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:18.101455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:18.101455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:18.101455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:18.101455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:18.101455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:18.101455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:18.103466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:18.103466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:18.103466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:18.103466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:18.103466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:18.103466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:18.103466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:18.103466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:18.103466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:18.103466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:18.103466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:18.103466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:18.103466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:18.103466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:18.103466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:18.103466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:18.103466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:18.103466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:18.105526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:18.105526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:18.105526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:18.105526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:18.105526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:18.105526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:18.105526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:18.105526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:18.105526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 06 23:20:18.105526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:18.105526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 279/555] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:20:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:18.105526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22ef8d-7d09-4955-8e32-d5c1ad306b76 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:18.148145 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce53cd-09f5-4413-b1a8-a65b4fe8c8bf None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:18.182263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff7f78-6529-4d05-bd4c-08a80c52f2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:18.182925 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff7f78-6529-4d05-bd4c-08a80c52f2c3 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:18.183201 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff7f78-6529-4d05-bd4c-08a80c52f2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:18.183467 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff7f78-6529-4d05-bd4c-08a80c52f2c3 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:18.184187 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff7f78-6529-4d05-bd4c-08a80c52f2c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:18.184487 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff7f78-6529-4d05-bd4c-08a80c52f2c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:18.185886 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff7f78-6529-4d05-bd4c-08a80c52f2c3 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:18.198218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 277/556] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:18.199111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff7f78-6529-4d05-bd4c-08a80c52f2c3 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:18.219333 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22ef8d-7d09-4955-8e32-d5c1ad306b76 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:18.263773 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252e5b2-e078-4057-9587-bc15f06b613a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:18.264898 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252e5b2-e078-4057-9587-bc15f06b613a None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:18.265180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252e5b2-e078-4057-9587-bc15f06b613a None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:18.265451 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252e5b2-e078-4057-9587-bc15f06b613a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:18.278006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252e5b2-e078-4057-9587-bc15f06b613a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:18.286579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-c252e5b2-e078-4057-9587-bc15f06b613a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:18.286579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:18.286579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:18.286579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:18.286579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:18.286579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:18.286579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:18.286579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:18.286579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:18.286579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:18.286579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:18.286579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:18.286579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:18.286579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:18.286579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:18.286579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:18.287457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:18.287457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:18.287457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:18.287457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:18.287457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:18.287457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:18.287457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:18.287457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:18.287457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:18.287457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:18.287457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:18.287457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:18.287457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:18.287457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:18.287457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:18.287457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:18.288234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:18.288234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:18.288234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:18.288234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:18.288234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:18.288234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:18.288234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:18.288234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:18.288234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:18.288234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:18.288234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:18.288234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:18.290849 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 280/557] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:18.291868 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252e5b2-e078-4057-9587-bc15f06b613a None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:18.319408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff7f78-6529-4d05-bd4c-08a80c52f2c3 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:18.353356 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68b64d-930c-4623-bcb1-ccbeafb23abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:18.354335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68b64d-930c-4623-bcb1-ccbeafb23abb None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:18.354619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68b64d-930c-4623-bcb1-ccbeafb23abb None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:18.354942 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68b64d-930c-4623-bcb1-ccbeafb23abb None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:18.355779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68b64d-930c-4623-bcb1-ccbeafb23abb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:18.356081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68b64d-930c-4623-bcb1-ccbeafb23abb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:18.357687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68b64d-930c-4623-bcb1-ccbeafb23abb None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:18.384396 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 278/558] 10.222.0.60 () {56 vars in 1135 bytes} [Fri May 6 23:20:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:18.384396 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68b64d-930c-4623-bcb1-ccbeafb23abb None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:18.405973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252e5b2-e078-4057-9587-bc15f06b613a None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:18.450653 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935eb2fc-55e8-420a-9af3-9ea2d47b2f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:18.451452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935eb2fc-55e8-420a-9af3-9ea2d47b2f8b None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:18.451854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935eb2fc-55e8-420a-9af3-9ea2d47b2f8b None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:18.452128 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935eb2fc-55e8-420a-9af3-9ea2d47b2f8b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:18.462982 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935eb2fc-55e8-420a-9af3-9ea2d47b2f8b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:18.464725 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935eb2fc-55e8-420a-9af3-9ea2d47b2f8b None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:18.482465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-935eb2fc-55e8-420a-9af3-9ea2d47b2f8b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 06 23:20:18.482465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:18.482465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:18.482465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:18.482465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:18.482465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:18.482465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:18.482465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:18.482465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:18.482465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:18.482465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:18.482465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:18.482465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:18.482465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:18.482465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:18.482465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:18.483399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:18.483399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:18.483399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:18.483399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:18.483399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:18.483399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:18.483399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:18.483399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:18.483399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:18.483399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:18.483399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:18.483399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:18.483399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:18.483399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:18.483399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:18.483399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:18.483399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:18.483399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:18.484294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:18.484294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:18.484294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:18.484294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:18.484294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:18.484294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:18.484294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:18.484294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:18.484294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 06 23:20:18.484294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:18.484294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 281/559] 10.222.0.60 () {56 vars in 1093 bytes} [Fri May 6 23:20:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:18.485036 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935eb2fc-55e8-420a-9af3-9ea2d47b2f8b None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:18.494367 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68b64d-930c-4623-bcb1-ccbeafb23abb None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:18.536463 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4d94f-c4a9-4e7f-8987-3d16aa02fedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:18.537157 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4d94f-c4a9-4e7f-8987-3d16aa02fedb None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:18.537432 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4d94f-c4a9-4e7f-8987-3d16aa02fedb None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:18.537709 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4d94f-c4a9-4e7f-8987-3d16aa02fedb None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:18.538622 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4d94f-c4a9-4e7f-8987-3d16aa02fedb None admin] RBAC: Adding query filter params (name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:18.538927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4d94f-c4a9-4e7f-8987-3d16aa02fedb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:18.540689 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4d94f-c4a9-4e7f-8987-3d16aa02fedb None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:18.551622 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 279/560] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:20:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:18.553367 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4d94f-c4a9-4e7f-8987-3d16aa02fedb None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:18.604576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935eb2fc-55e8-420a-9af3-9ea2d47b2f8b None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:18.636934 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb4dda-1813-41a4-92e2-5aa021eba64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:18.637576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb4dda-1813-41a4-92e2-5aa021eba64a None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:18.637851 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb4dda-1813-41a4-92e2-5aa021eba64a None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:18.638121 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb4dda-1813-41a4-92e2-5aa021eba64a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:18.664711 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4d94f-c4a9-4e7f-8987-3d16aa02fedb None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:18.699361 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7d041-eb1b-4057-8474-a744b940cb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:18.700024 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7d041-eb1b-4057-8474-a744b940cb54 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:18.700302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7d041-eb1b-4057-8474-a744b940cb54 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:18.701009 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7d041-eb1b-4057-8474-a744b940cb54 None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:18.701425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7d041-eb1b-4057-8474-a744b940cb54 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:18.701730 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7d041-eb1b-4057-8474-a744b940cb54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:18.702880 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb4dda-1813-41a4-92e2-5aa021eba64a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:18.703158 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7d041-eb1b-4057-8474-a744b940cb54 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:18.704329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb4dda-1813-41a4-92e2-5aa021eba64a None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:18.722487 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 280/561] 10.222.0.60 () {56 vars in 1133 bytes} [Fri May 6 23:20:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:18.723623 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7d041-eb1b-4057-8474-a744b940cb54 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:18.804295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 282/562] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:20:18.804295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f17a00-d402-498e-a4ac-25d8ad4646da None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:18.804295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f17a00-d402-498e-a4ac-25d8ad4646da None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:18.804295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f17a00-d402-498e-a4ac-25d8ad4646da None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:18.804295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 283/563] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:18.804295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f17a00-d402-498e-a4ac-25d8ad4646da None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:18.837223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7d041-eb1b-4057-8474-a744b940cb54 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:18.871861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66eee6-930f-495f-951f-f5e19d8e29d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:18.872689 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66eee6-930f-495f-951f-f5e19d8e29d9 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:18.872966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66eee6-930f-495f-951f-f5e19d8e29d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:18.873514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66eee6-930f-495f-951f-f5e19d8e29d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:18.883433 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66eee6-930f-495f-951f-f5e19d8e29d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:18.885518 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66eee6-930f-495f-951f-f5e19d8e29d9 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:18.902750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-0e66eee6-930f-495f-951f-f5e19d8e29d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:18.902750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:18.902750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:18.902750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:18.902750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:18.902750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:18.902750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:18.902750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:18.902750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:18.902750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:18.902750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:18.902750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:18.902750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:18.902750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:18.902750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:18.903692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:18.903692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:18.903692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:18.903692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:18.903692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:18.903692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:18.903692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:18.903692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:18.903692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:18.903692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:18.903692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:18.903692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:18.903692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:18.903692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:18.903692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:18.903692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:18.903692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:18.905383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:18.905383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:18.905383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:18.905383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:18.905383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 281/564] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:18.905383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66eee6-930f-495f-951f-f5e19d8e29d9 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:18.909764 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f17a00-d402-498e-a4ac-25d8ad4646da None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:18.942002 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611ff00-e894-4a51-a250-13d7081d9688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:18.942707 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611ff00-e894-4a51-a250-13d7081d9688 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:18.942983 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611ff00-e894-4a51-a250-13d7081d9688 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:18.943249 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611ff00-e894-4a51-a250-13d7081d9688 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:18.957459 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611ff00-e894-4a51-a250-13d7081d9688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:18.959750 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611ff00-e894-4a51-a250-13d7081d9688 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:18.979710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-0611ff00-e894-4a51-a250-13d7081d9688 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:18.979710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:18.979710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:18.979710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:18.979710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:18.979710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:18.979710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:18.979710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:18.979710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:18.979710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:18.979710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:18.979710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:18.979710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:18.979710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:18.979710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:18.980734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:18.980734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:18.980734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:18.980734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:18.980734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:18.980734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:18.980734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:18.980734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:18.980734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:18.980734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:18.980734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:18.980734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:18.980734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:18.980734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:18.980734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:18.980734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:18.980734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:18.981779 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:18.981779 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:18.981779 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:18.981779 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:18.981779 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 284/565] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:18.983310 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10ec9e-1819-4dbc-b9af-a3d8c73f536c None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:18.983310 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10ec9e-1819-4dbc-b9af-a3d8c73f536c None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:18.983310 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10ec9e-1819-4dbc-b9af-a3d8c73f536c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:19.006762 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-6e10ec9e-1819-4dbc-b9af-a3d8c73f536c None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:19.008738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-6e10ec9e-1819-4dbc-b9af-a3d8c73f536c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:19.018502 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66eee6-930f-495f-951f-f5e19d8e29d9 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:19.050617 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90e481-b75f-458c-bf9c-071622efcc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:19.051404 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90e481-b75f-458c-bf9c-071622efcc01 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:19.051684 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90e481-b75f-458c-bf9c-071622efcc01 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:19.052018 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90e481-b75f-458c-bf9c-071622efcc01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:19.062932 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90e481-b75f-458c-bf9c-071622efcc01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:19.064392 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90e481-b75f-458c-bf9c-071622efcc01 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:19.081885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-0b90e481-b75f-458c-bf9c-071622efcc01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:19.081885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:19.081885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:19.081885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:19.081885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:19.081885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:19.081885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:19.081885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:19.081885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:19.081885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:19.081885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:19.081885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:19.081885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:19.081885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:19.081885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:19.082764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:19.082764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:19.082764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:19.082764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:19.082764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:19.082764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:19.082764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:19.082764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:19.082764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:19.082764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:19.082764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:19.082764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:19.082764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:19.082764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:19.082764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:19.082764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:19.082764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:19.083611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:19.083611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:19.083611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:19.083611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:19.083611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 282/566] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:19.083886 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90e481-b75f-458c-bf9c-071622efcc01 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:19.096033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 285/567] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:19.096033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10ec9e-1819-4dbc-b9af-a3d8c73f536c None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:19.188218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90e481-b75f-458c-bf9c-071622efcc01 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:19.190437 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10ec9e-1819-4dbc-b9af-a3d8c73f536c None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:19.219735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5b59c-710b-4291-9422-77545c4a0e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:19.220312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5b59c-710b-4291-9422-77545c4a0e73 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:19.220619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5b59c-710b-4291-9422-77545c4a0e73 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:19.220892 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5b59c-710b-4291-9422-77545c4a0e73 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:19.221601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5b59c-710b-4291-9422-77545c4a0e73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:19.221901 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5b59c-710b-4291-9422-77545c4a0e73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:19.222548 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b2ee4-f53a-4f1c-8d5f-1233414c25b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:19.223199 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b2ee4-f53a-4f1c-8d5f-1233414c25b8 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:19.223301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5b59c-710b-4291-9422-77545c4a0e73 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:19.223480 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b2ee4-f53a-4f1c-8d5f-1233414c25b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:19.223759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b2ee4-f53a-4f1c-8d5f-1233414c25b8 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:19.224471 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b2ee4-f53a-4f1c-8d5f-1233414c25b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:19.224809 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b2ee4-f53a-4f1c-8d5f-1233414c25b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:19.226179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b2ee4-f53a-4f1c-8d5f-1233414c25b8 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:19.234275 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 283/568] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:19.235057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5b59c-710b-4291-9422-77545c4a0e73 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:19.236822 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 286/569] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:19.237610 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b2ee4-f53a-4f1c-8d5f-1233414c25b8 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:19.336418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b2ee4-f53a-4f1c-8d5f-1233414c25b8 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:19.338546 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5b59c-710b-4291-9422-77545c4a0e73 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:19.368053 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c5ec3-d809-4f53-928f-36d5effdffe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:19.368895 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c5ec3-d809-4f53-928f-36d5effdffe6 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:19.369172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c5ec3-d809-4f53-928f-36d5effdffe6 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:19.369441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c5ec3-d809-4f53-928f-36d5effdffe6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:19.371550 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366b48c-ff9d-485c-a50d-327d288772cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:19.372197 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366b48c-ff9d-485c-a50d-327d288772cf None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:19.372477 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366b48c-ff9d-485c-a50d-327d288772cf None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:19.372783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366b48c-ff9d-485c-a50d-327d288772cf None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:19.373503 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366b48c-ff9d-485c-a50d-327d288772cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:19.373811 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366b48c-ff9d-485c-a50d-327d288772cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:19.375172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366b48c-ff9d-485c-a50d-327d288772cf None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:19.378905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c5ec3-d809-4f53-928f-36d5effdffe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:19.386397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 284/570] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:19.386917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-798c5ec3-d809-4f53-928f-36d5effdffe6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:19.386917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:19.386917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:19.386917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:19.386917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:19.386917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:19.386917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:19.386917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:19.386917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:19.386917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:19.386917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:19.386917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:19.386917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:19.386917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:19.386917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:19.386917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:19.387861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:19.387861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:19.387861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:19.387861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:19.387861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:19.387861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:19.387861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:19.387861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:19.387861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:19.387861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:19.387861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:19.387861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:19.387861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:19.387861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:19.387861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:19.387861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:19.392636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:19.392636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:19.392636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:19.392636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:19.392636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:19.392636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:19.392636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:19.392636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:19.392636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:19.392636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:19.392636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:19.392636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:19.393253 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce557a47-21ba-44a6-872a-444fdb776790 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:19.393253 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce557a47-21ba-44a6-872a-444fdb776790 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:19.393385 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 287/571] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:19.393453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce557a47-21ba-44a6-872a-444fdb776790 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:19.393519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c5ec3-d809-4f53-928f-36d5effdffe6 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:19.393584 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 285/572] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:19.393584 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce557a47-21ba-44a6-872a-444fdb776790 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:19.486528 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c5ec3-d809-4f53-928f-36d5effdffe6 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:19.487893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce557a47-21ba-44a6-872a-444fdb776790 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:19.517497 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cdd9a-b5c0-4c08-b05d-40e007463b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:19.518266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cdd9a-b5c0-4c08-b05d-40e007463b13 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:19.518541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cdd9a-b5c0-4c08-b05d-40e007463b13 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:19.518811 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cdd9a-b5c0-4c08-b05d-40e007463b13 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:19.519661 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef783e-a30b-44a4-bee3-badbbfec8824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:19.520438 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef783e-a30b-44a4-bee3-badbbfec8824 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:19.520764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef783e-a30b-44a4-bee3-badbbfec8824 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:19.521038 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef783e-a30b-44a4-bee3-badbbfec8824 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:19.525851 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cdd9a-b5c0-4c08-b05d-40e007463b13 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:19.527294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cdd9a-b5c0-4c08-b05d-40e007463b13 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:19.527657 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef783e-a30b-44a4-bee3-badbbfec8824 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:19.529045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef783e-a30b-44a4-bee3-badbbfec8824 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:19.541180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-5e5cdd9a-b5c0-4c08-b05d-40e007463b13 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 06 23:20:19.541180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:19.541180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:19.541180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:19.541180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:19.541180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:19.541180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:19.541180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:19.541180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:19.541180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:19.541180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:19.541180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:19.541180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:19.541180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:19.541180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:19.541180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:19.542271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:19.542271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:19.542271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:19.542271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:19.542271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:19.542271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:19.542271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:19.542271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:19.542271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:19.542271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:19.542271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:19.542271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:19.542271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:19.542271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:19.542271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:19.542271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:19.542271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:19.542271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:19.543501 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:19.543501 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:19.543501 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:19.543501 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:19.543501 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:19.543501 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:19.543501 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:19.543501 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:19.543501 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 06 23:20:19.543501 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:19.544135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-72ef783e-a30b-44a4-bee3-badbbfec8824 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:19.544135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:19.544135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:19.544135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:19.544135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:19.544135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:19.544135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:19.544135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:19.544135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:19.544135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:19.544135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:19.544135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:19.544135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:19.544135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:19.544135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:19.545512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:19.545512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:19.545512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:19.545512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:19.545512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:19.545512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:19.545512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:19.545512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:19.545512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:19.545512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:19.545512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:19.545512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:19.545512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:19.545512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:19.545512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:19.545512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:19.545512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:19.546908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:19.546908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:19.546908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:19.546908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:19.546908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:19.546908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:19.546908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:19.546908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:19.546908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 286/573] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:19.546908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef783e-a30b-44a4-bee3-badbbfec8824 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:19.547563 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 288/574] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:20:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:19.547773 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cdd9a-b5c0-4c08-b05d-40e007463b13 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:19.645387 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cdd9a-b5c0-4c08-b05d-40e007463b13 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:19.649638 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef783e-a30b-44a4-bee3-badbbfec8824 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:19.676844 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63601a20-0e98-4484-8734-55e0097fe49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:19.677503 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63601a20-0e98-4484-8734-55e0097fe49c None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:19.677783 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63601a20-0e98-4484-8734-55e0097fe49c None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:19.678062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63601a20-0e98-4484-8734-55e0097fe49c None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:19.678797 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63601a20-0e98-4484-8734-55e0097fe49c None admin] RBAC: Adding query filter params (name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:19.679100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63601a20-0e98-4484-8734-55e0097fe49c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:19.680468 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63601a20-0e98-4484-8734-55e0097fe49c None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:19.681405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec943ac2-f26e-4c21-bbc7-70423f0a724c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:19.682192 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec943ac2-f26e-4c21-bbc7-70423f0a724c None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:19.682477 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec943ac2-f26e-4c21-bbc7-70423f0a724c None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:19.682754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec943ac2-f26e-4c21-bbc7-70423f0a724c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:19.688214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 289/575] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:20:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:19.689410 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e482bb3-7ed4-4f38-8911-be9192051553 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:19.689531 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec943ac2-f26e-4c21-bbc7-70423f0a724c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:19.689696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e482bb3-7ed4-4f38-8911-be9192051553 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:19.689967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e482bb3-7ed4-4f38-8911-be9192051553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:19.690866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec943ac2-f26e-4c21-bbc7-70423f0a724c None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:19.705611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-ec943ac2-f26e-4c21-bbc7-70423f0a724c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:19.705611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:19.705611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:19.705611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:19.705611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:19.705611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:19.705611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:19.705611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:19.705611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:19.705611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:19.705611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:19.705611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:19.705611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:19.705611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:19.705611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:19.706526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:19.706526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:19.706526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:19.706526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:19.706526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:19.706526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:19.706526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:19.706526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:19.706526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:19.706526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:19.706526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:19.706526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:19.706526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:19.706526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:19.706526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:19.706526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:19.706526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:19.707443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:19.707443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:19.707443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:19.707443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:19.707443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:19.707443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:19.707443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:19.707443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:19.707895 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-6e482bb3-7ed4-4f38-8911-be9192051553 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:19.707965 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 287/576] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:19.708031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-6e482bb3-7ed4-4f38-8911-be9192051553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:19.708098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec943ac2-f26e-4c21-bbc7-70423f0a724c None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:19.775404 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 290/577] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:19.776322 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e482bb3-7ed4-4f38-8911-be9192051553 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:19.805225 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec943ac2-f26e-4c21-bbc7-70423f0a724c None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:19.836370 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e052d2a-760f-404b-8df0-b4357dadb31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:19.837056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e052d2a-760f-404b-8df0-b4357dadb31e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:19.837824 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e052d2a-760f-404b-8df0-b4357dadb31e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:19.838103 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e052d2a-760f-404b-8df0-b4357dadb31e None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:19.839204 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e052d2a-760f-404b-8df0-b4357dadb31e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:19.839509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e052d2a-760f-404b-8df0-b4357dadb31e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:19.840958 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e052d2a-760f-404b-8df0-b4357dadb31e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:19.857952 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 288/578] 10.222.0.60 () {56 vars in 1137 bytes} [Fri May 6 23:20:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:19.858743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e052d2a-760f-404b-8df0-b4357dadb31e None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:19.873452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e482bb3-7ed4-4f38-8911-be9192051553 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:19.905524 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7b7fd-0d86-49b7-a885-535d55fbd38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:19.906181 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7b7fd-0d86-49b7-a885-535d55fbd38a None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:19.906462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7b7fd-0d86-49b7-a885-535d55fbd38a None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:19.906739 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7b7fd-0d86-49b7-a885-535d55fbd38a None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:19.907524 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7b7fd-0d86-49b7-a885-535d55fbd38a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:19.907834 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7b7fd-0d86-49b7-a885-535d55fbd38a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:19.909301 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7b7fd-0d86-49b7-a885-535d55fbd38a None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:19.925950 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 291/579] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:19.925950 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7b7fd-0d86-49b7-a885-535d55fbd38a None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:19.959459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e052d2a-760f-404b-8df0-b4357dadb31e None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:19.991850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e976f6-a951-4905-b6c0-61e1f54febb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:19.992662 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e976f6-a951-4905-b6c0-61e1f54febb4 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:19.992940 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e976f6-a951-4905-b6c0-61e1f54febb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:19.993207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e976f6-a951-4905-b6c0-61e1f54febb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:20.002885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e976f6-a951-4905-b6c0-61e1f54febb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:20.004312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e976f6-a951-4905-b6c0-61e1f54febb4 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:20.018361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7b7fd-0d86-49b7-a885-535d55fbd38a None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:20.021465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-41e976f6-a951-4905-b6c0-61e1f54febb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:20.021465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:20.021465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:20.021465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:20.021465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:20.021465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:20.021465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:20.021465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:20.021465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:20.021465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:20.021465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:20.021465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:20.021465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:20.021465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:20.021465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:20.022526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:20.022526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:20.022526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:20.022526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:20.022526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:20.022526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:20.022526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:20.022526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:20.022526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:20.022526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:20.022526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:20.022526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:20.022526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:20.022526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:20.022526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:20.022526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:20.022526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:20.023443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:20.023443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:20.023443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:20.023443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:20.023443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 289/580] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:20.023443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e976f6-a951-4905-b6c0-61e1f54febb4 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:20.050203 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671d256-9abf-47a1-9499-8617cff59c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:20.050796 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671d256-9abf-47a1-9499-8617cff59c10 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:20.051077 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671d256-9abf-47a1-9499-8617cff59c10 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:20.051349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671d256-9abf-47a1-9499-8617cff59c10 None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:20.052128 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671d256-9abf-47a1-9499-8617cff59c10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:20.052437 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671d256-9abf-47a1-9499-8617cff59c10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:20.053899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671d256-9abf-47a1-9499-8617cff59c10 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:20.066420 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 292/581] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:20.067218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671d256-9abf-47a1-9499-8617cff59c10 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:20.121565 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e976f6-a951-4905-b6c0-61e1f54febb4 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:20.153716 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1e55d-0621-463d-ab71-3bac7ff0063b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:20.154497 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1e55d-0621-463d-ab71-3bac7ff0063b None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:20.154781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1e55d-0621-463d-ab71-3bac7ff0063b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:20.155057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1e55d-0621-463d-ab71-3bac7ff0063b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:20.162765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671d256-9abf-47a1-9499-8617cff59c10 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:20.164781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1e55d-0621-463d-ab71-3bac7ff0063b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:20.172982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-4ff1e55d-0621-463d-ab71-3bac7ff0063b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:20.172982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:20.172982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:20.172982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:20.172982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:20.172982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:20.172982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:20.172982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:20.172982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:20.172982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:20.172982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:20.172982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:20.172982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:20.172982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:20.172982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:20.172982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:20.174060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:20.174060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:20.174060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:20.174060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:20.174060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:20.174060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:20.174060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:20.174060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:20.174060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:20.174060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:20.174060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:20.174060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:20.174060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:20.174060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:20.174060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:20.174060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:20.174875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:20.174875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:20.174875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:20.174875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:20.174875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:20.174875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:20.174875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:20.174875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:20.174875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:20.174875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:20.174875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:20.174875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:20.174875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 290/582] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:20.174875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1e55d-0621-463d-ab71-3bac7ff0063b None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:20.204433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6fc39-7008-43f5-a9a4-ca46cc0d107c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:20.205254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6fc39-7008-43f5-a9a4-ca46cc0d107c None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:20.205532 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6fc39-7008-43f5-a9a4-ca46cc0d107c None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:20.205799 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6fc39-7008-43f5-a9a4-ca46cc0d107c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:20.216327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6fc39-7008-43f5-a9a4-ca46cc0d107c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:20.217805 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6fc39-7008-43f5-a9a4-ca46cc0d107c None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:20.234549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-8fa6fc39-7008-43f5-a9a4-ca46cc0d107c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:20.234549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:20.234549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:20.234549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:20.234549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:20.234549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:20.234549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:20.234549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:20.234549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:20.234549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:20.234549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:20.234549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:20.234549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:20.234549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:20.234549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:20.235606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:20.235606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:20.235606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:20.235606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:20.235606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:20.235606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:20.235606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:20.235606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:20.235606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:20.235606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:20.235606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:20.235606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:20.235606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:20.235606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:20.235606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:20.235606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:20.235606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:20.236492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:20.236492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:20.236492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:20.236492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:20.236492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 293/583] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:20.236492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6fc39-7008-43f5-a9a4-ca46cc0d107c None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:20.272943 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1e55d-0621-463d-ab71-3bac7ff0063b None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:20.304447 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256c866-ff85-4e2a-9bf1-a61d399ff0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:20.305296 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256c866-ff85-4e2a-9bf1-a61d399ff0de None admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:20.305580 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256c866-ff85-4e2a-9bf1-a61d399ff0de None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:20.305856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256c866-ff85-4e2a-9bf1-a61d399ff0de None admin] PATH_INFO: `/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/9b74631c6e1547d991753a65c41bc7e7/roles/71050e310414462b8d07f901fef201ad` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:20.319410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256c866-ff85-4e2a-9bf1-a61d399ff0de None admin] RBAC: Authorizing `identity:create_grant(project_id=4389eb256aba4b7182e33cb3720b1073, user_id=9b74631c6e1547d991753a65c41bc7e7, role_id=71050e310414462b8d07f901fef201ad)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:20.320906 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256c866-ff85-4e2a-9bf1-a61d399ff0de None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:20.330330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6fc39-7008-43f5-a9a4-ca46cc0d107c None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:20.333793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 291/584] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:20:20 2022] PUT /identity/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/9b74631c6e1547d991753a65c41bc7e7/roles/71050e310414462b8d07f901fef201ad => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:20:20.334575 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256c866-ff85-4e2a-9bf1-a61d399ff0de None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:20.367088 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6c794-4125-47ff-a94b-e798095bae27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:20.368036 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6c794-4125-47ff-a94b-e798095bae27 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:20.368316 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6c794-4125-47ff-a94b-e798095bae27 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:20.368612 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6c794-4125-47ff-a94b-e798095bae27 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:20.369910 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6c794-4125-47ff-a94b-e798095bae27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:20.370218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6c794-4125-47ff-a94b-e798095bae27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:20.371638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6c794-4125-47ff-a94b-e798095bae27 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:20.383504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 294/585] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:20.384402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6c794-4125-47ff-a94b-e798095bae27 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:20.446278 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256c866-ff85-4e2a-9bf1-a61d399ff0de None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:20.483240 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788bc8f-50ab-45c6-927e-3c6beeeb8474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:20.483907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788bc8f-50ab-45c6-927e-3c6beeeb8474 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:20.484190 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788bc8f-50ab-45c6-927e-3c6beeeb8474 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:20.484466 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788bc8f-50ab-45c6-927e-3c6beeeb8474 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:20.485341 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788bc8f-50ab-45c6-927e-3c6beeeb8474 None admin] RBAC: Adding query filter params (role.id=71050e310414462b8d07f901fef201ad, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=48b3ec57aee94b87889d578e114fa0db) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:20.485656 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788bc8f-50ab-45c6-927e-3c6beeeb8474 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:20.487139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788bc8f-50ab-45c6-927e-3c6beeeb8474 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:20.493182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 292/586] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:20:20 2022] GET /identity/v3/role_assignments?user.id=48b3ec57aee94b87889d578e114fa0db&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=71050e310414462b8d07f901fef201ad => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:20.494118 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788bc8f-50ab-45c6-927e-3c6beeeb8474 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:20.494432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6c794-4125-47ff-a94b-e798095bae27 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:20.546351 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4387c49-446e-4578-a0ad-9e9b2877bddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:20.547103 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4387c49-446e-4578-a0ad-9e9b2877bddb None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:20.547390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4387c49-446e-4578-a0ad-9e9b2877bddb None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:20.547711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4387c49-446e-4578-a0ad-9e9b2877bddb None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:20.548528 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4387c49-446e-4578-a0ad-9e9b2877bddb None admin] RBAC: Adding query filter params (name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:20.548917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4387c49-446e-4578-a0ad-9e9b2877bddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:20.550881 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4387c49-446e-4578-a0ad-9e9b2877bddb None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:20.559933 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 295/587] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:20:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:20.564909 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4387c49-446e-4578-a0ad-9e9b2877bddb None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:20.615219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788bc8f-50ab-45c6-927e-3c6beeeb8474 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:20.654463 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53810215-5b04-42d9-8d57-06639c7463bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:20.655488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53810215-5b04-42d9-8d57-06639c7463bc None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:20.655964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53810215-5b04-42d9-8d57-06639c7463bc None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:20.656420 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53810215-5b04-42d9-8d57-06639c7463bc None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:20.657373 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53810215-5b04-42d9-8d57-06639c7463bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:20.657870 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53810215-5b04-42d9-8d57-06639c7463bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:20.659488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53810215-5b04-42d9-8d57-06639c7463bc None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:20.675547 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4387c49-446e-4578-a0ad-9e9b2877bddb None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:20.676911 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 293/588] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:20.677781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53810215-5b04-42d9-8d57-06639c7463bc None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:20.722164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b279008-2305-49b1-bf03-2a92276d356f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:20.722956 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b279008-2305-49b1-bf03-2a92276d356f None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:20.723239 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b279008-2305-49b1-bf03-2a92276d356f None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:20.723509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b279008-2305-49b1-bf03-2a92276d356f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:20.734322 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b279008-2305-49b1-bf03-2a92276d356f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:20.736609 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b279008-2305-49b1-bf03-2a92276d356f None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:20.756006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-9b279008-2305-49b1-bf03-2a92276d356f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 06 23:20:20.756006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:20.756006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:20.756006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:20.756006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:20.756006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:20.756006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:20.756006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:20.756006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:20.756006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:20.756006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:20.756006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:20.756006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:20.756006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:20.756006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:20.756006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:20.757006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:20.757006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:20.757006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:20.757006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:20.757006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:20.757006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:20.757006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:20.757006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:20.757006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:20.757006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:20.757006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:20.757006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:20.757006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:20.757006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:20.757006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:20.757006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:20.757006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:20.757006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:20.757945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:20.757945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:20.757945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:20.757945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:20.757945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:20.757945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:20.757945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:20.757945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:20.757945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 06 23:20:20.757945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:20.761037 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 296/589] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:20:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:20.762063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b279008-2305-49b1-bf03-2a92276d356f None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:20.811073 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53810215-5b04-42d9-8d57-06639c7463bc None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:20.850210 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57b845-e764-4592-8997-10d1177d7dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:20.851249 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57b845-e764-4592-8997-10d1177d7dbd None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:20.851677 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57b845-e764-4592-8997-10d1177d7dbd None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:20.852093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57b845-e764-4592-8997-10d1177d7dbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:20.862784 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57b845-e764-4592-8997-10d1177d7dbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:20.864448 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57b845-e764-4592-8997-10d1177d7dbd None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:20.873259 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b279008-2305-49b1-bf03-2a92276d356f None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:20.882448 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-6e57b845-e764-4592-8997-10d1177d7dbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:20.882448 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:20.882448 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:20.882448 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:20.882448 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:20.882448 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:20.882448 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:20.882448 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:20.882448 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:20.882448 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:20.882448 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:20.882448 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:20.882448 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:20.882448 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:20.882448 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:20.883327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:20.883327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:20.883327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:20.883327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:20.883327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:20.883327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:20.883327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:20.883327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:20.883327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:20.883327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:20.883327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:20.883327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:20.883327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:20.883327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:20.883327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:20.883327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:20.883327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:20.884767 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:20.884767 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:20.884767 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:20.884767 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:20.887096 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 294/590] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:20.888119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57b845-e764-4592-8997-10d1177d7dbd None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:20.913763 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2e924-c13a-4008-aded-788532ac896e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:20.914749 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2e924-c13a-4008-aded-788532ac896e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:20.915047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2e924-c13a-4008-aded-788532ac896e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:20.915910 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2e924-c13a-4008-aded-788532ac896e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:20.923038 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2e924-c13a-4008-aded-788532ac896e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:20.924628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2e924-c13a-4008-aded-788532ac896e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:20.939074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-e8b2e924-c13a-4008-aded-788532ac896e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:20.939074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:20.939074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:20.939074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:20.939074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:20.939074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:20.939074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:20.939074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:20.939074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:20.939074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:20.939074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:20.939074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:20.939074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:20.939074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:20.939074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:20.940446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:20.940446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:20.940446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:20.940446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:20.940446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:20.940446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:20.940446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:20.940446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:20.940446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:20.940446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:20.940446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:20.940446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:20.940446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:20.940446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:20.940446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:20.940446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:20.940446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:20.942597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:20.942597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:20.942597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:20.942597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:20.942597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:20.942597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:20.942597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:20.942597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:20.945345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 297/591] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:20.946339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2e924-c13a-4008-aded-788532ac896e None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:21.006081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57b845-e764-4592-8997-10d1177d7dbd None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:21.041499 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2cd4d-e8a5-4a67-90f2-7453ea463b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:21.042482 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2cd4d-e8a5-4a67-90f2-7453ea463b11 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:21.042998 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2cd4d-e8a5-4a67-90f2-7453ea463b11 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:21.043503 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2cd4d-e8a5-4a67-90f2-7453ea463b11 None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:21.044597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2cd4d-e8a5-4a67-90f2-7453ea463b11 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:21.045106 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2cd4d-e8a5-4a67-90f2-7453ea463b11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:21.046725 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2cd4d-e8a5-4a67-90f2-7453ea463b11 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:21.054759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2e924-c13a-4008-aded-788532ac896e None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:21.064733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 295/592] 10.222.0.60 () {56 vars in 1137 bytes} [Fri May 6 23:20:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:21.065898 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2cd4d-e8a5-4a67-90f2-7453ea463b11 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:21.090526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0060de3-bf9d-4194-8243-6f2e5a4eed9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:21.091305 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0060de3-bf9d-4194-8243-6f2e5a4eed9f None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:21.091690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0060de3-bf9d-4194-8243-6f2e5a4eed9f None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:21.091969 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0060de3-bf9d-4194-8243-6f2e5a4eed9f None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:21.092774 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0060de3-bf9d-4194-8243-6f2e5a4eed9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:21.093082 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0060de3-bf9d-4194-8243-6f2e5a4eed9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:21.094523 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0060de3-bf9d-4194-8243-6f2e5a4eed9f None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:21.106260 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 298/593] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:21.111608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0060de3-bf9d-4194-8243-6f2e5a4eed9f None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:21.169086 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2cd4d-e8a5-4a67-90f2-7453ea463b11 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:21.204168 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6c478-cf88-4162-b58c-0cfb020a14e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:21.205237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6c478-cf88-4162-b58c-0cfb020a14e3 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:21.205764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6c478-cf88-4162-b58c-0cfb020a14e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:21.206237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6c478-cf88-4162-b58c-0cfb020a14e3 None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:21.207375 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6c478-cf88-4162-b58c-0cfb020a14e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:21.207882 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6c478-cf88-4162-b58c-0cfb020a14e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:21.209543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6c478-cf88-4162-b58c-0cfb020a14e3 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:21.220526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0060de3-bf9d-4194-8243-6f2e5a4eed9f None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:21.222477 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 296/594] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:21.223565 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6c478-cf88-4162-b58c-0cfb020a14e3 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:21.261201 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105068a-f51a-4090-b39d-79cab5bfccb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:21.262185 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105068a-f51a-4090-b39d-79cab5bfccb1 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:21.262463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105068a-f51a-4090-b39d-79cab5bfccb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:21.262733 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105068a-f51a-4090-b39d-79cab5bfccb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:21.278915 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105068a-f51a-4090-b39d-79cab5bfccb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:21.280569 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105068a-f51a-4090-b39d-79cab5bfccb1 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:21.299070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-9105068a-f51a-4090-b39d-79cab5bfccb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:21.299070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:21.299070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:21.299070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:21.299070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:21.299070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:21.299070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:21.299070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:21.299070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:21.299070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:21.299070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:21.299070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:21.299070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:21.299070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:21.299070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:21.300028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:21.300028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:21.300028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:21.300028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:21.300028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:21.300028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:21.300028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:21.300028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:21.300028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:21.300028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:21.300028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:21.300028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:21.300028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:21.300028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:21.300028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:21.300028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:21.300028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:21.301033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:21.301033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:21.301033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:21.301033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:21.301397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 299/595] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:21.302222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105068a-f51a-4090-b39d-79cab5bfccb1 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:21.333898 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6c478-cf88-4162-b58c-0cfb020a14e3 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:21.368004 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ad551-f029-473a-90c6-9530cc4d19e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:21.369608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ad551-f029-473a-90c6-9530cc4d19e6 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:21.370058 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ad551-f029-473a-90c6-9530cc4d19e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:21.370475 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ad551-f029-473a-90c6-9530cc4d19e6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:21.378078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ad551-f029-473a-90c6-9530cc4d19e6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:21.379712 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ad551-f029-473a-90c6-9530cc4d19e6 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:21.394071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-9d4ad551-f029-473a-90c6-9530cc4d19e6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 06 23:20:21.394071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:21.394071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:21.394071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:21.394071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:21.394071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:21.394071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:21.394071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:21.394071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:21.394071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:21.394071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:21.394071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:21.394071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:21.394071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:21.394071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:21.394071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:21.394985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:21.394985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:21.394985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:21.394985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:21.394985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:21.394985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:21.394985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:21.394985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:21.394985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:21.394985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:21.394985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:21.394985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:21.394985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:21.394985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:21.394985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:21.394985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:21.394985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:21.394985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:21.395923 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:21.395923 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:21.395923 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:21.395923 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:21.395923 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:21.395923 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:21.395923 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:21.395923 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:21.395923 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 06 23:20:21.395923 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:21.398538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 297/596] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:21.399498 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ad551-f029-473a-90c6-9530cc4d19e6 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:21.407327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105068a-f51a-4090-b39d-79cab5bfccb1 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:21.441268 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbf22f-c9c0-4f64-b741-d44113b52de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:21.442225 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbf22f-c9c0-4f64-b741-d44113b52de6 None admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:21.442550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbf22f-c9c0-4f64-b741-d44113b52de6 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:21.442830 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbf22f-c9c0-4f64-b741-d44113b52de6 None admin] PATH_INFO: `/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/a63ecc7210574058aad75a3114b57202/roles/71050e310414462b8d07f901fef201ad` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:21.457606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbf22f-c9c0-4f64-b741-d44113b52de6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4389eb256aba4b7182e33cb3720b1073, user_id=a63ecc7210574058aad75a3114b57202, role_id=71050e310414462b8d07f901fef201ad)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:21.459055 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbf22f-c9c0-4f64-b741-d44113b52de6 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:21.480322 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 300/597] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:20:21 2022] PUT /identity/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/a63ecc7210574058aad75a3114b57202/roles/71050e310414462b8d07f901fef201ad => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:20:21.485404 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbf22f-c9c0-4f64-b741-d44113b52de6 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:21.530904 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ad551-f029-473a-90c6-9530cc4d19e6 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:21.595140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04019c4-ac44-4daa-b0c7-83461d9de6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:21.596914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04019c4-ac44-4daa-b0c7-83461d9de6ed None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:21.597570 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04019c4-ac44-4daa-b0c7-83461d9de6ed None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:21.599275 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04019c4-ac44-4daa-b0c7-83461d9de6ed None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:21.600304 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04019c4-ac44-4daa-b0c7-83461d9de6ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:21.601548 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04019c4-ac44-4daa-b0c7-83461d9de6ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:21.603916 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04019c4-ac44-4daa-b0c7-83461d9de6ed None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:21.632101 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 298/598] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:21.636820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04019c4-ac44-4daa-b0c7-83461d9de6ed None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:21.669337 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbf22f-c9c0-4f64-b741-d44113b52de6 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:21.737294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8a964-7983-4a02-b061-b09bc1813bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:21.737994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8a964-7983-4a02-b061-b09bc1813bca None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:21.738275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8a964-7983-4a02-b061-b09bc1813bca None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:21.738547 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8a964-7983-4a02-b061-b09bc1813bca None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:21.739397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8a964-7983-4a02-b061-b09bc1813bca None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:21.739729 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8a964-7983-4a02-b061-b09bc1813bca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:21.741277 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8a964-7983-4a02-b061-b09bc1813bca None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:21.761491 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 301/599] 10.222.0.60 () {56 vars in 1139 bytes} [Fri May 6 23:20:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:21.766993 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8a964-7983-4a02-b061-b09bc1813bca None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:21.786572 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04019c4-ac44-4daa-b0c7-83461d9de6ed None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:21.822999 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46419c02-1f8a-4e68-90e8-1483169fa146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:21.824152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46419c02-1f8a-4e68-90e8-1483169fa146 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:21.824701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46419c02-1f8a-4e68-90e8-1483169fa146 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:21.825305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46419c02-1f8a-4e68-90e8-1483169fa146 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:21.832691 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46419c02-1f8a-4e68-90e8-1483169fa146 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:21.834481 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46419c02-1f8a-4e68-90e8-1483169fa146 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:21.849978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-46419c02-1f8a-4e68-90e8-1483169fa146 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:21.849978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:21.849978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:21.849978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:21.849978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:21.849978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:21.849978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:21.849978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:21.849978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:21.849978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:21.849978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:21.849978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:21.849978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:21.849978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:21.849978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:21.850825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:21.850825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:21.850825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:21.850825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:21.850825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:21.850825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:21.850825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:21.850825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:21.850825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:21.850825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:21.850825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:21.850825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:21.850825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:21.850825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:21.850825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:21.850825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:21.850825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:21.851701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:21.851701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:21.851701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:21.851701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:21.851701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:21.851701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:21.851701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:21.851701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:21.851701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 299/600] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:21.861472 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46419c02-1f8a-4e68-90e8-1483169fa146 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:21.867212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8a964-7983-4a02-b061-b09bc1813bca None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:21.901686 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a957d-6047-4e0c-b189-e707372cb041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:21.902478 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a957d-6047-4e0c-b189-e707372cb041 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:21.902757 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a957d-6047-4e0c-b189-e707372cb041 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:21.903026 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a957d-6047-4e0c-b189-e707372cb041 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:21.913147 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a957d-6047-4e0c-b189-e707372cb041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:21.914594 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a957d-6047-4e0c-b189-e707372cb041 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:21.932138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-d79a957d-6047-4e0c-b189-e707372cb041 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:21.932138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:21.932138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:21.932138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:21.932138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:21.932138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:21.932138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:21.932138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:21.932138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:21.932138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:21.932138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:21.932138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:21.932138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:21.932138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:21.932138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:21.934257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:21.934257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:21.934257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:21.934257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:21.934257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:21.934257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:21.934257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:21.934257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:21.934257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:21.934257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:21.934257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:21.934257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:21.934257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:21.934257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:21.934257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:21.934257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:21.934257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:21.936327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:21.936327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:21.936327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:21.936327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:21.936327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 302/601] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:21.942923 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a957d-6047-4e0c-b189-e707372cb041 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:22.015985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46419c02-1f8a-4e68-90e8-1483169fa146 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:22.049347 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042284f6-4f7f-4692-9931-47088ffcbfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:22.050024 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042284f6-4f7f-4692-9931-47088ffcbfdb None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:22.050305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042284f6-4f7f-4692-9931-47088ffcbfdb None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:22.050583 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042284f6-4f7f-4692-9931-47088ffcbfdb None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:22.051374 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042284f6-4f7f-4692-9931-47088ffcbfdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:22.051687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042284f6-4f7f-4692-9931-47088ffcbfdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:22.053166 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042284f6-4f7f-4692-9931-47088ffcbfdb None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:22.066439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 300/602] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:22.073503 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042284f6-4f7f-4692-9931-47088ffcbfdb None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:22.080465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a957d-6047-4e0c-b189-e707372cb041 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:22.123264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0c145-32db-41f7-8b26-0b60a8de0c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:22.123849 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0c145-32db-41f7-8b26-0b60a8de0c41 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:22.124828 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0c145-32db-41f7-8b26-0b60a8de0c41 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:22.125307 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0c145-32db-41f7-8b26-0b60a8de0c41 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:22.126036 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0c145-32db-41f7-8b26-0b60a8de0c41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:22.126345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0c145-32db-41f7-8b26-0b60a8de0c41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:22.127724 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0c145-32db-41f7-8b26-0b60a8de0c41 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:22.151694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 303/603] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:22.157206 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0c145-32db-41f7-8b26-0b60a8de0c41 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:22.269534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042284f6-4f7f-4692-9931-47088ffcbfdb None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:22.298851 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0c145-32db-41f7-8b26-0b60a8de0c41 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:22.341263 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1a6cf-06c6-4ac8-ab84-fcda1db3450e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:22.342243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125186c-810d-47a8-b17e-c3973ff447ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:22.343388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125186c-810d-47a8-b17e-c3973ff447ab None admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:22.344401 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1a6cf-06c6-4ac8-ab84-fcda1db3450e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:22.344919 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1a6cf-06c6-4ac8-ab84-fcda1db3450e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:22.345407 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125186c-810d-47a8-b17e-c3973ff447ab None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:22.345901 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1a6cf-06c6-4ac8-ab84-fcda1db3450e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:22.346396 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125186c-810d-47a8-b17e-c3973ff447ab None admin] PATH_INFO: `/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/36d2df2ca106409995e139652ee995e4/roles/71050e310414462b8d07f901fef201ad` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:22.361039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1a6cf-06c6-4ac8-ab84-fcda1db3450e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:22.362836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1a6cf-06c6-4ac8-ab84-fcda1db3450e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:22.381794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-5cc1a6cf-06c6-4ac8-ab84-fcda1db3450e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:22.381794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:22.381794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:22.381794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:22.381794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:22.381794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:22.381794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:22.381794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:22.381794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:22.381794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:22.381794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:22.381794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:22.381794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:22.381794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:22.381794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:22.382689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:22.382689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:22.382689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:22.382689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:22.382689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:22.382689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:22.382689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:22.382689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:22.382689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:22.382689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:22.382689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:22.382689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:22.382689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:22.382689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:22.382689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:22.382689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:22.382689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:22.383563 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:22.383563 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:22.383563 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:22.383563 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:22.383563 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:22.383563 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:22.383563 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:22.383563 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:22.386365 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125186c-810d-47a8-b17e-c3973ff447ab None admin] RBAC: Authorizing `identity:create_grant(project_id=4389eb256aba4b7182e33cb3720b1073, user_id=36d2df2ca106409995e139652ee995e4, role_id=71050e310414462b8d07f901fef201ad)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:22.388040 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125186c-810d-47a8-b17e-c3973ff447ab None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:22.392700 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 304/604] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:22.398412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1a6cf-06c6-4ac8-ab84-fcda1db3450e None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:22.409371 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 301/605] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:20:22 2022] PUT /identity/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/36d2df2ca106409995e139652ee995e4/roles/71050e310414462b8d07f901fef201ad => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:20:22.522032 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1a6cf-06c6-4ac8-ab84-fcda1db3450e None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:22.563258 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb3b3a-fb56-4aed-b631-ab18feab05cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:22.563927 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb3b3a-fb56-4aed-b631-ab18feab05cf None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:22.564202 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb3b3a-fb56-4aed-b631-ab18feab05cf None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:22.564471 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb3b3a-fb56-4aed-b631-ab18feab05cf None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:22.565295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb3b3a-fb56-4aed-b631-ab18feab05cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:22.565600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb3b3a-fb56-4aed-b631-ab18feab05cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:22.567075 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb3b3a-fb56-4aed-b631-ab18feab05cf None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:22.583764 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 305/606] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:22.589755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125186c-810d-47a8-b17e-c3973ff447ab None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:22.741148 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125186c-810d-47a8-b17e-c3973ff447ab None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:22.787865 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773d870-acab-43be-abb7-89c93da3fa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:22.788797 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773d870-acab-43be-abb7-89c93da3fa81 None admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:22.789084 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773d870-acab-43be-abb7-89c93da3fa81 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:22.789356 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773d870-acab-43be-abb7-89c93da3fa81 None admin] PATH_INFO: `/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/046352b8553c4f23b6dda151f6f7ce00/roles/71050e310414462b8d07f901fef201ad` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:22.812176 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773d870-acab-43be-abb7-89c93da3fa81 None admin] RBAC: Authorizing `identity:create_grant(project_id=4389eb256aba4b7182e33cb3720b1073, user_id=046352b8553c4f23b6dda151f6f7ce00, role_id=71050e310414462b8d07f901fef201ad)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:22.813773 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773d870-acab-43be-abb7-89c93da3fa81 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:22.832592 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 302/607] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:20:22 2022] PUT /identity/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/046352b8553c4f23b6dda151f6f7ce00/roles/71050e310414462b8d07f901fef201ad => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:20:22.851734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19160908-9a13-424d-8ef2-5b3076318bde None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:22.852046 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19160908-9a13-424d-8ef2-5b3076318bde None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:22.852271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19160908-9a13-424d-8ef2-5b3076318bde None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:22.854604 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 306/608] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:22.860237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af477b56-e823-4c8f-b077-bc90a4e2e041 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:22.860523 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af477b56-e823-4c8f-b077-bc90a4e2e041 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:22.860821 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af477b56-e823-4c8f-b077-bc90a4e2e041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:22.880445 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-af477b56-e823-4c8f-b077-bc90a4e2e041 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:22.881760 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-af477b56-e823-4c8f-b077-bc90a4e2e041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:22.953020 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 303/609] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:22.997985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19160908-9a13-424d-8ef2-5b3076318bde None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:23.032419 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4824f-5eb6-444d-9d2a-65c02f1d1540 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:23.032968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4824f-5eb6-444d-9d2a-65c02f1d1540 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:23.033043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4824f-5eb6-444d-9d2a-65c02f1d1540 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:23.034623 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 304/610] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:23.047425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a076512-eb0b-44f9-a832-dd0bcbdf217a None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:23.047818 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a076512-eb0b-44f9-a832-dd0bcbdf217a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:23.048100 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a076512-eb0b-44f9-a832-dd0bcbdf217a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:23.078905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-9a076512-eb0b-44f9-a832-dd0bcbdf217a None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:23.080106 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-9a076512-eb0b-44f9-a832-dd0bcbdf217a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:23.117478 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19160908-9a13-424d-8ef2-5b3076318bde None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:23.158399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3820ad-ff49-4598-a13a-fcb223d6d7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:23.159283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3820ad-ff49-4598-a13a-fcb223d6d7bc None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:23.159563 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3820ad-ff49-4598-a13a-fcb223d6d7bc None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:23.159832 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3820ad-ff49-4598-a13a-fcb223d6d7bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:23.160907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 305/611] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:23.174985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3820ad-ff49-4598-a13a-fcb223d6d7bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:23.183547 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a076512-eb0b-44f9-a832-dd0bcbdf217a None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:23.185220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-4b3820ad-ff49-4598-a13a-fcb223d6d7bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:23.185220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:23.185220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:23.185220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:23.185220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:23.185220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:23.185220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:23.185220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:23.185220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:23.185220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:23.185220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:23.185220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:23.185220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:23.185220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:23.185220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:23.185220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:23.186138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:23.186138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:23.186138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:23.186138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:23.186138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:23.186138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:23.186138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:23.186138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:23.186138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:23.186138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:23.186138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:23.186138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:23.186138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:23.186138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:23.186138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:23.186138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:23.186973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:23.186973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:23.186973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:23.186973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:23.186973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:23.186973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:23.186973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:23.186973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:23.186973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:23.186973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:23.186973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:23.186973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:23.187966 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 307/612] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:23.193135 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3820ad-ff49-4598-a13a-fcb223d6d7bc None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:23.330584 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a076512-eb0b-44f9-a832-dd0bcbdf217a None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:23.364458 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a057c-33de-4ed8-8f4f-f39eee09479b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:23.365413 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a057c-33de-4ed8-8f4f-f39eee09479b None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:23.365697 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a057c-33de-4ed8-8f4f-f39eee09479b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:23.365967 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a057c-33de-4ed8-8f4f-f39eee09479b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:23.366973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3820ad-ff49-4598-a13a-fcb223d6d7bc None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:23.376174 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a057c-33de-4ed8-8f4f-f39eee09479b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:23.383953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-9a2a057c-33de-4ed8-8f4f-f39eee09479b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:23.383953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:23.383953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:23.383953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:23.383953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:23.383953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:23.383953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:23.383953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:23.383953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:23.383953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:23.383953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:23.383953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:23.383953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:23.383953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:23.383953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:23.383953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:23.385406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:23.385406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:23.385406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:23.385406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:23.385406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:23.385406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:23.385406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:23.385406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:23.385406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:23.385406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:23.385406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:23.385406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:23.385406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:23.385406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:23.385406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:23.385406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:23.386647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:23.386647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:23.386647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:23.386647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:23.386647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:23.386647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:23.386647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:23.386647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:23.386647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:23.386647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:23.386647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:23.386647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:23.386647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 306/613] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:23.391783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a057c-33de-4ed8-8f4f-f39eee09479b None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:23.451915 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e992f-ce9d-417a-b7b0-3fab2d2362f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:23.452614 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e992f-ce9d-417a-b7b0-3fab2d2362f7 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:23.452897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e992f-ce9d-417a-b7b0-3fab2d2362f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:23.453169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e992f-ce9d-417a-b7b0-3fab2d2362f7 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:23.453919 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e992f-ce9d-417a-b7b0-3fab2d2362f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:23.454220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e992f-ce9d-417a-b7b0-3fab2d2362f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:23.455602 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e992f-ce9d-417a-b7b0-3fab2d2362f7 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:23.476097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 308/614] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:20:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:23.481656 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e992f-ce9d-417a-b7b0-3fab2d2362f7 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:23.494086 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a057c-33de-4ed8-8f4f-f39eee09479b None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:23.528178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b7e94-e4e1-4d71-b241-ffd2d7877485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:23.528927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b7e94-e4e1-4d71-b241-ffd2d7877485 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:23.529209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b7e94-e4e1-4d71-b241-ffd2d7877485 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:23.529491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b7e94-e4e1-4d71-b241-ffd2d7877485 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:23.530285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b7e94-e4e1-4d71-b241-ffd2d7877485 None admin] RBAC: Adding query filter params (name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:23.530586 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b7e94-e4e1-4d71-b241-ffd2d7877485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:23.532013 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b7e94-e4e1-4d71-b241-ffd2d7877485 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:23.544983 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 307/615] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:20:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:23.546853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b7e94-e4e1-4d71-b241-ffd2d7877485 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:23.646636 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b7e94-e4e1-4d71-b241-ffd2d7877485 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:23.691821 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957627d-226b-409c-b27a-eb61ee2d471b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:23.692237 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e992f-ce9d-417a-b7b0-3fab2d2362f7 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:23.692637 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957627d-226b-409c-b27a-eb61ee2d471b None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:23.692918 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957627d-226b-409c-b27a-eb61ee2d471b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:23.693189 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957627d-226b-409c-b27a-eb61ee2d471b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:23.710942 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957627d-226b-409c-b27a-eb61ee2d471b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:23.712944 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957627d-226b-409c-b27a-eb61ee2d471b None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:23.734382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-4957627d-226b-409c-b27a-eb61ee2d471b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:23.734382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:23.734382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:23.734382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:23.734382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:23.734382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:23.734382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:23.734382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:23.734382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:23.734382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:23.734382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:23.734382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:23.734382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:23.734382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:23.734382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:23.735295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:23.735295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:23.735295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:23.735295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:23.735295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:23.735295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:23.735295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:23.735295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:23.735295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:23.735295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:23.735295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:23.735295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:23.735295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:23.735295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:23.735295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:23.735295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:23.735295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:23.736631 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:23.736631 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:23.736631 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:23.736631 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:23.736631 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 308/616] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:23.740777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f63349-b78e-426c-9a27-96a965ee0e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:23.741328 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957627d-226b-409c-b27a-eb61ee2d471b None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:23.742028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f63349-b78e-426c-9a27-96a965ee0e18 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:23.742507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f63349-b78e-426c-9a27-96a965ee0e18 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:23.742991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f63349-b78e-426c-9a27-96a965ee0e18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:23.765762 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f63349-b78e-426c-9a27-96a965ee0e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:23.767560 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f63349-b78e-426c-9a27-96a965ee0e18 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:23.800573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-b8f63349-b78e-426c-9a27-96a965ee0e18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:23.800573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:23.800573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:23.800573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:23.800573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:23.800573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:23.800573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:23.800573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:23.800573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:23.800573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:23.800573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:23.800573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:23.800573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:23.800573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:23.800573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:23.801506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:23.801506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:23.801506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:23.801506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:23.801506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:23.801506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:23.801506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:23.801506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:23.801506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:23.801506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:23.801506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:23.801506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:23.801506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:23.801506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:23.801506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:23.801506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:23.801506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:23.802364 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:23.802364 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:23.802364 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:23.802364 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:23.804680 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 309/617] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:23.809666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f63349-b78e-426c-9a27-96a965ee0e18 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:23.842369 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957627d-226b-409c-b27a-eb61ee2d471b None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:23.879995 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a38fb-724f-4467-9335-a200bf046fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:23.880684 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a38fb-724f-4467-9335-a200bf046fd6 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:23.880963 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a38fb-724f-4467-9335-a200bf046fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:23.881233 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a38fb-724f-4467-9335-a200bf046fd6 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:23.882008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a38fb-724f-4467-9335-a200bf046fd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:23.882309 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a38fb-724f-4467-9335-a200bf046fd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:23.883724 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a38fb-724f-4467-9335-a200bf046fd6 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:23.897023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 309/618] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:23.902297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a38fb-724f-4467-9335-a200bf046fd6 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:24.000166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f63349-b78e-426c-9a27-96a965ee0e18 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:24.003208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a38fb-724f-4467-9335-a200bf046fd6 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:24.037376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25296f-412d-497b-bd23-f4df5fa9ec47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:24.038157 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25296f-412d-497b-bd23-f4df5fa9ec47 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:24.038433 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25296f-412d-497b-bd23-f4df5fa9ec47 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:24.038702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25296f-412d-497b-bd23-f4df5fa9ec47 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:24.046651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25296f-412d-497b-bd23-f4df5fa9ec47 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:24.048089 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25296f-412d-497b-bd23-f4df5fa9ec47 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:24.063312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-1d25296f-412d-497b-bd23-f4df5fa9ec47 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 06 23:20:24.063312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:24.063312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:24.063312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:24.063312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:24.063312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:24.063312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:24.063312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:24.063312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:24.063312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:24.063312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:24.063312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:24.063312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:24.063312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:24.063312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:24.063312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:24.064272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:24.064272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:24.064272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:24.064272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:24.064272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:24.064272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:24.064272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:24.064272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:24.064272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:24.064272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:24.064272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:24.064272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:24.064272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:24.064272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:24.064272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:24.064272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:24.064272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:24.064272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:24.065252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:24.065252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:24.065252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:24.065252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:24.065252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:24.065252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:24.065252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:24.065252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:24.065252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 06 23:20:24.065252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:24.068896 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 310/619] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:20:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:24.070169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25296f-412d-497b-bd23-f4df5fa9ec47 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:24.083013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be60bc-0dd7-490f-bcf1-0a80b6548d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:24.083722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be60bc-0dd7-490f-bcf1-0a80b6548d3d None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:24.083997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be60bc-0dd7-490f-bcf1-0a80b6548d3d None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:24.084263 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be60bc-0dd7-490f-bcf1-0a80b6548d3d None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:24.085062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be60bc-0dd7-490f-bcf1-0a80b6548d3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:24.085465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be60bc-0dd7-490f-bcf1-0a80b6548d3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:24.086829 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be60bc-0dd7-490f-bcf1-0a80b6548d3d None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:24.120219 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 310/620] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:24.126033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be60bc-0dd7-490f-bcf1-0a80b6548d3d None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:24.271773 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25296f-412d-497b-bd23-f4df5fa9ec47 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:24.302766 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be60bc-0dd7-490f-bcf1-0a80b6548d3d None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:24.346467 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa42806-76b4-4416-8b6a-0a449c86389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:24.347138 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa42806-76b4-4416-8b6a-0a449c86389b None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:24.347874 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa42806-76b4-4416-8b6a-0a449c86389b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:24.348150 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa42806-76b4-4416-8b6a-0a449c86389b None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:24.349012 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa42806-76b4-4416-8b6a-0a449c86389b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:24.349315 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa42806-76b4-4416-8b6a-0a449c86389b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:24.350740 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa42806-76b4-4416-8b6a-0a449c86389b None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:24.354455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b321a-d376-4226-b8e8-a4fd88c369c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:24.355239 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b321a-d376-4226-b8e8-a4fd88c369c2 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:24.355513 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b321a-d376-4226-b8e8-a4fd88c369c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:24.355780 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b321a-d376-4226-b8e8-a4fd88c369c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:24.369229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b321a-d376-4226-b8e8-a4fd88c369c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:24.370735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b321a-d376-4226-b8e8-a4fd88c369c2 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:24.378399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 311/621] 10.222.0.60 () {56 vars in 1135 bytes} [Fri May 6 23:20:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:24.380110 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dc0fe-ce76-498a-ae66-d16f08160637 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:24.380677 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dc0fe-ce76-498a-ae66-d16f08160637 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:24.381162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dc0fe-ce76-498a-ae66-d16f08160637 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:24.387167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 312/622] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:24.388168 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5dc0fe-ce76-498a-ae66-d16f08160637 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:24.390714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-1a8b321a-d376-4226-b8e8-a4fd88c369c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 06 23:20:24.390714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:24.390714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:24.390714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:24.390714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:24.390714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:24.390714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:24.390714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:24.390714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:24.390714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:24.390714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:24.390714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:24.390714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:24.390714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:24.390714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:24.390714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:24.391691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:24.391691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:24.391691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:24.391691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:24.391691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:24.391691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:24.391691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:24.391691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:24.391691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:24.391691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:24.391691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:24.391691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:24.391691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:24.391691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:24.391691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:24.391691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:24.391691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:24.391691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:24.392721 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:24.392721 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:24.392721 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:24.392721 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:24.392721 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:24.392721 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:24.392721 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:24.392721 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:24.392721 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 06 23:20:24.392721 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:24.393305 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 311/623] 10.222.0.60 () {56 vars in 1093 bytes} [Fri May 6 23:20:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:24.398326 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0676517-3ff0-40dd-9d93-b747c79a2a5f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:24.398326 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0676517-3ff0-40dd-9d93-b747c79a2a5f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:24.398326 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0676517-3ff0-40dd-9d93-b747c79a2a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:24.418514 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-c0676517-3ff0-40dd-9d93-b747c79a2a5f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:24.419750 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c0676517-3ff0-40dd-9d93-b747c79a2a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:24.508559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 312/624] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:24.508559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0676517-3ff0-40dd-9d93-b747c79a2a5f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:24.526262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5dc0fe-ce76-498a-ae66-d16f08160637 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:24.568785 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f535d7-9580-4ebc-bbfa-a0102583c5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:24.570241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f535d7-9580-4ebc-bbfa-a0102583c5d5 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:24.570850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f535d7-9580-4ebc-bbfa-a0102583c5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:24.571352 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f535d7-9580-4ebc-bbfa-a0102583c5d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:24.584695 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f535d7-9580-4ebc-bbfa-a0102583c5d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:24.587068 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f535d7-9580-4ebc-bbfa-a0102583c5d5 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:24.611443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-e1f535d7-9580-4ebc-bbfa-a0102583c5d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:24.611443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:24.611443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:24.611443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:24.611443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:24.611443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:24.611443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:24.611443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:24.611443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:24.611443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:24.611443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:24.611443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:24.611443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:24.611443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:24.611443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:24.612406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:24.612406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:24.612406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:24.612406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:24.612406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:24.612406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:24.612406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:24.612406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:24.612406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:24.612406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:24.612406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:24.612406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:24.612406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:24.612406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:24.612406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:24.612406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:24.612406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:24.613319 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:24.613319 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:24.613319 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:24.613319 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:24.615853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 313/625] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:24.616881 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f535d7-9580-4ebc-bbfa-a0102583c5d5 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:24.629067 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0676517-3ff0-40dd-9d93-b747c79a2a5f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:24.670427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ad79a-e11f-49b1-b088-c30e5364547c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:24.671613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ad79a-e11f-49b1-b088-c30e5364547c None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:24.672024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ad79a-e11f-49b1-b088-c30e5364547c None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:24.672395 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ad79a-e11f-49b1-b088-c30e5364547c None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:24.673657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ad79a-e11f-49b1-b088-c30e5364547c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:24.674081 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ad79a-e11f-49b1-b088-c30e5364547c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:24.676091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ad79a-e11f-49b1-b088-c30e5364547c None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:24.702667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 313/626] 10.222.0.60 () {56 vars in 1133 bytes} [Fri May 6 23:20:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:24.702667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ad79a-e11f-49b1-b088-c30e5364547c None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:24.740686 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f535d7-9580-4ebc-bbfa-a0102583c5d5 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:24.775035 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c2603-de16-459d-93cf-78b32e351ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:24.775981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c2603-de16-459d-93cf-78b32e351ea7 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:24.776405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c2603-de16-459d-93cf-78b32e351ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:24.776753 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c2603-de16-459d-93cf-78b32e351ea7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:24.787191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c2603-de16-459d-93cf-78b32e351ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:24.795733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-881c2603-de16-459d-93cf-78b32e351ea7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:24.795733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:24.795733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:24.795733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:24.795733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:24.795733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:24.795733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:24.795733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:24.795733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:24.795733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:24.795733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:24.795733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:24.795733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:24.795733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:24.795733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:24.795733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:24.796920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:24.796920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:24.796920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:24.796920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:24.796920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:24.796920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:24.796920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:24.796920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:24.796920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:24.796920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:24.796920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:24.796920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:24.796920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:24.796920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:24.796920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:24.796920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:24.797884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:24.797884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:24.797884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:24.797884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:24.797884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:24.797884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:24.797884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:24.797884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:24.797884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:24.797884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:24.797884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:24.797884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:24.803554 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 314/627] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:24.804492 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c2603-de16-459d-93cf-78b32e351ea7 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:24.807733 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ad79a-e11f-49b1-b088-c30e5364547c None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:24.854075 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46a68e-9ee3-4dbb-98c5-25e8cb1420a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:24.855009 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46a68e-9ee3-4dbb-98c5-25e8cb1420a8 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:24.855480 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46a68e-9ee3-4dbb-98c5-25e8cb1420a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:24.855935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46a68e-9ee3-4dbb-98c5-25e8cb1420a8 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:24.856914 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46a68e-9ee3-4dbb-98c5-25e8cb1420a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:24.857448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46a68e-9ee3-4dbb-98c5-25e8cb1420a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:24.859040 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46a68e-9ee3-4dbb-98c5-25e8cb1420a8 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:24.871167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 314/628] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:24.872300 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46a68e-9ee3-4dbb-98c5-25e8cb1420a8 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:24.912257 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c2603-de16-459d-93cf-78b32e351ea7 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:24.950016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d0e7d-f9ce-480c-818c-d9a2ddbf03ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:24.950672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d0e7d-f9ce-480c-818c-d9a2ddbf03ed None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:24.950947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d0e7d-f9ce-480c-818c-d9a2ddbf03ed None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:24.951216 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d0e7d-f9ce-480c-818c-d9a2ddbf03ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:24.978660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46a68e-9ee3-4dbb-98c5-25e8cb1420a8 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:25.013166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba06b0-213d-40cb-a73c-35a3935813ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:25.014651 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba06b0-213d-40cb-a73c-35a3935813ec None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:25.015150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba06b0-213d-40cb-a73c-35a3935813ec None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:25.015628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba06b0-213d-40cb-a73c-35a3935813ec None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:25.016603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba06b0-213d-40cb-a73c-35a3935813ec None admin] RBAC: Adding query filter params (name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:25.017143 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba06b0-213d-40cb-a73c-35a3935813ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:25.018722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba06b0-213d-40cb-a73c-35a3935813ec None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:25.020786 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d0e7d-f9ce-480c-818c-d9a2ddbf03ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:25.022301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d0e7d-f9ce-480c-818c-d9a2ddbf03ed None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:25.028670 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 315/629] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:20:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:25.029751 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba06b0-213d-40cb-a73c-35a3935813ec None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:25.126751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 315/630] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:20:25.128149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d0e7d-f9ce-480c-818c-d9a2ddbf03ed None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:25.132252 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba06b0-213d-40cb-a73c-35a3935813ec None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:25.165655 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8e192-1dcd-41db-bbec-77e792f1621f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:25.166438 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8e192-1dcd-41db-bbec-77e792f1621f None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:25.166724 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8e192-1dcd-41db-bbec-77e792f1621f None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:25.167002 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8e192-1dcd-41db-bbec-77e792f1621f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:25.173566 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8e192-1dcd-41db-bbec-77e792f1621f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:25.175031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8e192-1dcd-41db-bbec-77e792f1621f None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:25.189289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-cde8e192-1dcd-41db-bbec-77e792f1621f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:25.189289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:25.189289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:25.189289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:25.189289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:25.189289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:25.189289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:25.189289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:25.189289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:25.189289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:25.189289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:25.189289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:25.189289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:25.189289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:25.189289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:25.190182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:25.190182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:25.190182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:25.190182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:25.190182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:25.190182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:25.190182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:25.190182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:25.190182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:25.190182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:25.190182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:25.190182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:25.190182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:25.190182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:25.190182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:25.190182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:25.190182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:25.195810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:25.195810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:25.195810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:25.195810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:25.195810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:25.195810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:25.195810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:25.195810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:25.195810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 316/631] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:25.195810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829cb7d-6c08-4172-9248-8f31127b153c None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:25.195810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829cb7d-6c08-4172-9248-8f31127b153c None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:25.196461 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829cb7d-6c08-4172-9248-8f31127b153c None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:25.196461 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 317/632] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:25.196461 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829cb7d-6c08-4172-9248-8f31127b153c None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:25.235948 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d0e7d-f9ce-480c-818c-d9a2ddbf03ed None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:25.276248 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5183b0a-b331-49e8-bc94-dae0604ffac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:25.277425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5183b0a-b331-49e8-bc94-dae0604ffac4 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:25.277706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5183b0a-b331-49e8-bc94-dae0604ffac4 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:25.277974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5183b0a-b331-49e8-bc94-dae0604ffac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:25.288810 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5183b0a-b331-49e8-bc94-dae0604ffac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:25.290232 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5183b0a-b331-49e8-bc94-dae0604ffac4 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:25.298848 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829cb7d-6c08-4172-9248-8f31127b153c None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:25.308574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-d5183b0a-b331-49e8-bc94-dae0604ffac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:25.308574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:25.308574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:25.308574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:25.308574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:25.308574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:25.308574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:25.308574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:25.308574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:25.308574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:25.308574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:25.308574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:25.308574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:25.308574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:25.308574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:25.309478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:25.309478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:25.309478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:25.309478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:25.309478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:25.309478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:25.309478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:25.309478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:25.309478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:25.309478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:25.309478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:25.309478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:25.309478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:25.309478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:25.309478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:25.309478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:25.309478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:25.310432 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:25.310432 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:25.310432 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:25.310432 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:25.310432 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 316/633] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:25.311295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5183b0a-b331-49e8-bc94-dae0604ffac4 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:25.340838 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8cd52-8a2b-4a53-bd18-6434257f64b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:25.342458 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8cd52-8a2b-4a53-bd18-6434257f64b3 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:25.342922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8cd52-8a2b-4a53-bd18-6434257f64b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:25.343371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8cd52-8a2b-4a53-bd18-6434257f64b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:25.356409 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8cd52-8a2b-4a53-bd18-6434257f64b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:25.358501 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8cd52-8a2b-4a53-bd18-6434257f64b3 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:25.385241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-17f8cd52-8a2b-4a53-bd18-6434257f64b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:25.385241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:25.385241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:25.385241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:25.385241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:25.385241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:25.385241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:25.385241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:25.385241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:25.385241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:25.385241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:25.385241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:25.385241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:25.385241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:25.385241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:25.386213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:25.386213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:25.386213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:25.386213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:25.386213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:25.386213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:25.386213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:25.386213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:25.386213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:25.386213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:25.386213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:25.386213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:25.386213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:25.386213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:25.386213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:25.386213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:25.386213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:25.387122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:25.387122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:25.387122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:25.387122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:25.387122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 318/634] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:25.388276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549e889-f3bb-4c9f-b289-4479dfefb447 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:25.388276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549e889-f3bb-4c9f-b289-4479dfefb447 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:25.388276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549e889-f3bb-4c9f-b289-4479dfefb447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:25.405110 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-4549e889-f3bb-4c9f-b289-4479dfefb447 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:25.406283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-4549e889-f3bb-4c9f-b289-4479dfefb447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:25.414157 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5183b0a-b331-49e8-bc94-dae0604ffac4 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:25.446929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecbf7b-c939-4fad-9248-11555406813f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:25.447581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecbf7b-c939-4fad-9248-11555406813f None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:25.447862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecbf7b-c939-4fad-9248-11555406813f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:25.448134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecbf7b-c939-4fad-9248-11555406813f None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:25.448958 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ecbf7b-c939-4fad-9248-11555406813f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:25.449264 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ecbf7b-c939-4fad-9248-11555406813f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:25.450710 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ecbf7b-c939-4fad-9248-11555406813f None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:25.462787 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 317/635] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:25.463564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecbf7b-c939-4fad-9248-11555406813f None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:25.469852 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 319/636] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:25.470706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549e889-f3bb-4c9f-b289-4479dfefb447 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:25.557459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecbf7b-c939-4fad-9248-11555406813f None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:25.562378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549e889-f3bb-4c9f-b289-4479dfefb447 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:25.589134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a996e-ffd5-4e05-ab28-ed933a92fd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:25.589785 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a996e-ffd5-4e05-ab28-ed933a92fd2f None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:25.590068 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a996e-ffd5-4e05-ab28-ed933a92fd2f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:25.590346 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a996e-ffd5-4e05-ab28-ed933a92fd2f None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:25.591066 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a996e-ffd5-4e05-ab28-ed933a92fd2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:25.591390 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a996e-ffd5-4e05-ab28-ed933a92fd2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:25.592777 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a996e-ffd5-4e05-ab28-ed933a92fd2f None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:25.593649 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e7cd0-008d-4885-ba36-e21a02a93869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:25.594296 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e7cd0-008d-4885-ba36-e21a02a93869 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:25.594569 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e7cd0-008d-4885-ba36-e21a02a93869 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:25.594841 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e7cd0-008d-4885-ba36-e21a02a93869 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:25.595550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e7cd0-008d-4885-ba36-e21a02a93869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:25.595849 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e7cd0-008d-4885-ba36-e21a02a93869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:25.597216 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e7cd0-008d-4885-ba36-e21a02a93869 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:25.604065 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 318/637] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:25.605428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e443f0-6310-46c7-bfa6-b645aa774f9f None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:25.605715 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e443f0-6310-46c7-bfa6-b645aa774f9f None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:25.605993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e443f0-6310-46c7-bfa6-b645aa774f9f None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:25.611098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 319/638] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:25.611098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e443f0-6310-46c7-bfa6-b645aa774f9f None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:25.611686 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 320/639] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:25.612678 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e7cd0-008d-4885-ba36-e21a02a93869 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:25.703300 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e443f0-6310-46c7-bfa6-b645aa774f9f None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:25.703695 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e7cd0-008d-4885-ba36-e21a02a93869 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:25.737892 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85421e0-7130-4d23-a201-6ecda39feda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:25.738710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85421e0-7130-4d23-a201-6ecda39feda9 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:25.739018 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85421e0-7130-4d23-a201-6ecda39feda9 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:25.739288 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85421e0-7130-4d23-a201-6ecda39feda9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:25.745276 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c88e5-c428-4e79-94c6-bf33401d93e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:25.746159 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c88e5-c428-4e79-94c6-bf33401d93e7 None admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:25.746439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c88e5-c428-4e79-94c6-bf33401d93e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:25.746720 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c88e5-c428-4e79-94c6-bf33401d93e7 None admin] PATH_INFO: `/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/48b3ec57aee94b87889d578e114fa0db/roles/71050e310414462b8d07f901fef201ad` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:25.749957 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85421e0-7130-4d23-a201-6ecda39feda9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:25.757427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-f85421e0-7130-4d23-a201-6ecda39feda9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:25.757427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:25.757427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:25.757427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:25.757427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:25.757427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:25.757427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:25.757427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:25.757427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:25.757427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:25.757427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:25.757427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:25.757427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:25.757427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:25.757427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:25.757427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:25.758321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:25.758321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:25.758321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:25.758321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:25.758321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:25.758321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:25.758321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:25.758321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:25.758321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:25.758321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:25.758321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:25.758321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:25.758321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:25.758321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:25.758321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:25.758321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:25.759213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:25.759213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:25.759213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:25.759213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:25.759213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:25.759213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:25.759213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:25.759213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:25.759213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:25.759213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:25.759213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:25.759213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:25.759213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 321/640] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:25.760449 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85421e0-7130-4d23-a201-6ecda39feda9 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:25.766148 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c88e5-c428-4e79-94c6-bf33401d93e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4389eb256aba4b7182e33cb3720b1073, user_id=48b3ec57aee94b87889d578e114fa0db, role_id=71050e310414462b8d07f901fef201ad)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:25.767593 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c88e5-c428-4e79-94c6-bf33401d93e7 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:25.779381 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 320/641] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:20:25 2022] PUT /identity/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/48b3ec57aee94b87889d578e114fa0db/roles/71050e310414462b8d07f901fef201ad => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:20:25.780883 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d002fb1-13a7-4089-a01c-605667aa6632 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:25.781177 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d002fb1-13a7-4089-a01c-605667aa6632 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:25.781457 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d002fb1-13a7-4089-a01c-605667aa6632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:25.798321 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-4d002fb1-13a7-4089-a01c-605667aa6632 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:25.799597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-4d002fb1-13a7-4089-a01c-605667aa6632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:25.876710 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 321/642] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:25.877930 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d002fb1-13a7-4089-a01c-605667aa6632 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:25.880524 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85421e0-7130-4d23-a201-6ecda39feda9 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:25.915901 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0303d5f-221e-4ef8-82e4-64b5664ed1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:25.916804 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0303d5f-221e-4ef8-82e4-64b5664ed1fa None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:25.917136 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0303d5f-221e-4ef8-82e4-64b5664ed1fa None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:25.917410 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0303d5f-221e-4ef8-82e4-64b5664ed1fa None admin] PATH_INFO: `/v3/users/glance` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:25.925727 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0303d5f-221e-4ef8-82e4-64b5664ed1fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:25.927329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0303d5f-221e-4ef8-82e4-64b5664ed1fa None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:25.942846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-e0303d5f-221e-4ef8-82e4-64b5664ed1fa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 06 23:20:25.942846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:25.942846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:25.942846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:25.942846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:25.942846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:25.942846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:25.942846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:25.942846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:25.942846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:25.942846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:25.942846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:25.942846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:25.942846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:25.942846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:25.942846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:25.944130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:25.944130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:25.944130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:25.944130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:25.944130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:25.944130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:25.944130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:25.944130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:25.944130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:25.944130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:25.944130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:25.944130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:25.944130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:25.944130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:25.944130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:25.944130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:25.944130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:25.944130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:25.945414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:25.945414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:25.945414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:25.945414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:25.945414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:25.945414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:25.945414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:25.945414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:25.945414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 06 23:20:25.945414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:25.945414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 322/643] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:20:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:25.945414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0303d5f-221e-4ef8-82e4-64b5664ed1fa None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:25.995331 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d002fb1-13a7-4089-a01c-605667aa6632 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:26.035903 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6e7a8-e480-464b-bb01-fb572c325910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:26.036725 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6e7a8-e480-464b-bb01-fb572c325910 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:26.037007 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6e7a8-e480-464b-bb01-fb572c325910 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:26.037276 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6e7a8-e480-464b-bb01-fb572c325910 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:26.044562 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6e7a8-e480-464b-bb01-fb572c325910 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:26.046052 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6e7a8-e480-464b-bb01-fb572c325910 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:26.054283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0303d5f-221e-4ef8-82e4-64b5664ed1fa None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:26.059513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-b5e6e7a8-e480-464b-bb01-fb572c325910 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:26.059513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:26.059513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:26.059513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:26.059513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:26.059513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:26.059513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:26.059513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:26.059513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:26.059513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:26.059513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:26.059513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:26.059513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:26.059513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:26.059513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:26.060408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:26.060408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:26.060408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:26.060408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:26.060408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:26.060408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:26.060408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:26.060408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:26.060408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:26.060408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:26.060408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:26.060408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:26.060408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:26.060408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:26.060408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:26.060408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:26.060408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:26.061418 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:26.061418 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:26.061418 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:26.061418 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:26.061418 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:26.061418 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:26.061418 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:26.061418 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:26.061418 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 322/644] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:26.061900 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6e7a8-e480-464b-bb01-fb572c325910 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:26.092872 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d28b9-7239-409d-a7f3-9eedf8ef9838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:26.093533 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d28b9-7239-409d-a7f3-9eedf8ef9838 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:26.093810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d28b9-7239-409d-a7f3-9eedf8ef9838 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:26.094130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d28b9-7239-409d-a7f3-9eedf8ef9838 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:26.094815 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d28b9-7239-409d-a7f3-9eedf8ef9838 None admin] RBAC: Adding query filter params (name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:26.095120 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d28b9-7239-409d-a7f3-9eedf8ef9838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:26.096485 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d28b9-7239-409d-a7f3-9eedf8ef9838 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:26.108863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 323/645] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:20:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:26.108863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d28b9-7239-409d-a7f3-9eedf8ef9838 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:26.173007 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6e7a8-e480-464b-bb01-fb572c325910 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:26.204553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d28b9-7239-409d-a7f3-9eedf8ef9838 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:26.206214 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce526e-a1d8-442b-a238-944ce62bea3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:26.207010 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce526e-a1d8-442b-a238-944ce62bea3f None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:26.207291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce526e-a1d8-442b-a238-944ce62bea3f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:26.207569 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce526e-a1d8-442b-a238-944ce62bea3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:26.217670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce526e-a1d8-442b-a238-944ce62bea3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:26.225329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-e0ce526e-a1d8-442b-a238-944ce62bea3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:26.225329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:26.225329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:26.225329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:26.225329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:26.225329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:26.225329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:26.225329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:26.225329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:26.225329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:26.225329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:26.225329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:26.225329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:26.225329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:26.225329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:26.225329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:26.226243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:26.226243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:26.226243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:26.226243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:26.226243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:26.226243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:26.226243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:26.226243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:26.226243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:26.226243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:26.226243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:26.226243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:26.226243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:26.226243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:26.226243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:26.226243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:26.227057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:26.227057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:26.227057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:26.227057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:26.227057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:26.227057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:26.227057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:26.227057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:26.227057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:26.227057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:26.227057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:26.227057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:26.227057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 323/646] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:26.228761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce526e-a1d8-442b-a238-944ce62bea3f None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:26.244732 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2b6d6-68c4-4c4c-9a65-7dfa173991a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:26.245903 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2b6d6-68c4-4c4c-9a65-7dfa173991a6 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:26.246450 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2b6d6-68c4-4c4c-9a65-7dfa173991a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:26.246893 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2b6d6-68c4-4c4c-9a65-7dfa173991a6 None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:26.248073 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2b6d6-68c4-4c4c-9a65-7dfa173991a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:26.248522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2b6d6-68c4-4c4c-9a65-7dfa173991a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:26.250843 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2b6d6-68c4-4c4c-9a65-7dfa173991a6 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:26.268320 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 324/647] 10.222.0.60 () {56 vars in 1137 bytes} [Fri May 6 23:20:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:26.272766 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2b6d6-68c4-4c4c-9a65-7dfa173991a6 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:26.336112 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce526e-a1d8-442b-a238-944ce62bea3f None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:26.368256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2b6d6-68c4-4c4c-9a65-7dfa173991a6 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:26.373580 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d63e0-8104-4d2f-9d3a-ccd43553574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:26.374239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d63e0-8104-4d2f-9d3a-ccd43553574b None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:26.374516 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d63e0-8104-4d2f-9d3a-ccd43553574b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:26.374787 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d63e0-8104-4d2f-9d3a-ccd43553574b None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:26.375566 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d63e0-8104-4d2f-9d3a-ccd43553574b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:26.375931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d63e0-8104-4d2f-9d3a-ccd43553574b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:26.377421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d63e0-8104-4d2f-9d3a-ccd43553574b None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:26.389041 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 324/648] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:26.389823 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d63e0-8104-4d2f-9d3a-ccd43553574b None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:26.408599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c42442-410d-403c-bb7a-a89002ff90c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:26.409654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c42442-410d-403c-bb7a-a89002ff90c0 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:26.410525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c42442-410d-403c-bb7a-a89002ff90c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:26.411005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c42442-410d-403c-bb7a-a89002ff90c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:26.424314 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c42442-410d-403c-bb7a-a89002ff90c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:26.425786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c42442-410d-403c-bb7a-a89002ff90c0 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:26.443582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-64c42442-410d-403c-bb7a-a89002ff90c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:26.443582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:26.443582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:26.443582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:26.443582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:26.443582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:26.443582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:26.443582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:26.443582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:26.443582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:26.443582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:26.443582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:26.443582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:26.443582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:26.443582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:26.444737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:26.444737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:26.444737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:26.444737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:26.444737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:26.444737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:26.444737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:26.444737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:26.444737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:26.444737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:26.444737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:26.444737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:26.444737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:26.444737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:26.444737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:26.444737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:26.444737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:26.445789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:26.445789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:26.445789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:26.445789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:26.445789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 325/649] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:26.446083 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c42442-410d-403c-bb7a-a89002ff90c0 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:26.495844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d63e0-8104-4d2f-9d3a-ccd43553574b None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:26.529095 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad0d5b-547f-4e64-a974-b09ffc70c9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:26.529770 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad0d5b-547f-4e64-a974-b09ffc70c9fc None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:26.530049 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad0d5b-547f-4e64-a974-b09ffc70c9fc None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:26.530326 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad0d5b-547f-4e64-a974-b09ffc70c9fc None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:26.531074 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad0d5b-547f-4e64-a974-b09ffc70c9fc None admin] RBAC: Adding query filter params (name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:26.531388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad0d5b-547f-4e64-a974-b09ffc70c9fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:26.532791 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad0d5b-547f-4e64-a974-b09ffc70c9fc None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:26.544950 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 325/650] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:20:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:26.544950 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad0d5b-547f-4e64-a974-b09ffc70c9fc None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:26.548967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c42442-410d-403c-bb7a-a89002ff90c0 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:26.582887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a57e39-4541-4415-8975-56251087b370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:26.583619 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a57e39-4541-4415-8975-56251087b370 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:26.583922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a57e39-4541-4415-8975-56251087b370 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:26.584188 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a57e39-4541-4415-8975-56251087b370 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:26.640314 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad0d5b-547f-4e64-a974-b09ffc70c9fc None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:26.650858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a57e39-4541-4415-8975-56251087b370 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:26.652328 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a57e39-4541-4415-8975-56251087b370 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:26.672702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f94a66-77d5-468d-ad2e-63e59b94eded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:26.673353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f94a66-77d5-468d-ad2e-63e59b94eded None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:26.673636 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f94a66-77d5-468d-ad2e-63e59b94eded None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:26.673915 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f94a66-77d5-468d-ad2e-63e59b94eded None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:26.674743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f94a66-77d5-468d-ad2e-63e59b94eded None admin] RBAC: Adding query filter params (role.id=71050e310414462b8d07f901fef201ad, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=9b74631c6e1547d991753a65c41bc7e7) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:26.675062 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f94a66-77d5-468d-ad2e-63e59b94eded None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:26.676477 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f94a66-77d5-468d-ad2e-63e59b94eded None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:26.691148 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 326/651] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:20:26 2022] GET /identity/v3/role_assignments?user.id=9b74631c6e1547d991753a65c41bc7e7&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=71050e310414462b8d07f901fef201ad => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:26.691148 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f94a66-77d5-468d-ad2e-63e59b94eded None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:26.778670 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 326/652] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:20:26.779942 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a57e39-4541-4415-8975-56251087b370 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:26.795711 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f94a66-77d5-468d-ad2e-63e59b94eded None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:26.835723 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6545b4-f290-4853-97dd-0ed53b3a93be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:26.836550 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6545b4-f290-4853-97dd-0ed53b3a93be None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:26.836908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6545b4-f290-4853-97dd-0ed53b3a93be None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:26.837840 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6545b4-f290-4853-97dd-0ed53b3a93be None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:26.838675 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6545b4-f290-4853-97dd-0ed53b3a93be None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:26.839302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6545b4-f290-4853-97dd-0ed53b3a93be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:26.840866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6545b4-f290-4853-97dd-0ed53b3a93be None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:26.862021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 327/653] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:26.863280 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6545b4-f290-4853-97dd-0ed53b3a93be None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:26.907862 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a57e39-4541-4415-8975-56251087b370 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:26.943462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e405fa-b128-4a0e-80b9-1041343138f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:26.944702 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e405fa-b128-4a0e-80b9-1041343138f1 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:26.945188 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e405fa-b128-4a0e-80b9-1041343138f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:26.945658 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e405fa-b128-4a0e-80b9-1041343138f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:26.957480 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e405fa-b128-4a0e-80b9-1041343138f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:26.958602 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e405fa-b128-4a0e-80b9-1041343138f1 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:26.973411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6545b4-f290-4853-97dd-0ed53b3a93be None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:26.977097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-d4e405fa-b128-4a0e-80b9-1041343138f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:26.977097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:26.977097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:26.977097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:26.977097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:26.977097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:26.977097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:26.977097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:26.977097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:26.977097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:26.977097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:26.977097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:26.977097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:26.977097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:26.977097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:26.978663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:26.978663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:26.978663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:26.978663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:26.978663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:26.978663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:26.978663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:26.978663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:26.978663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:26.978663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:26.978663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:26.978663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:26.978663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:26.978663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:26.978663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:26.978663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:26.978663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:26.979605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:26.979605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:26.979605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:26.979605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:26.979605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 327/654] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:26.979605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e405fa-b128-4a0e-80b9-1041343138f1 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:27.092936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e405fa-b128-4a0e-80b9-1041343138f1 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:27.128057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2dc92-18f1-4fb8-ad6d-97b6f22d3369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:27.128958 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2dc92-18f1-4fb8-ad6d-97b6f22d3369 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:27.129169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2dc92-18f1-4fb8-ad6d-97b6f22d3369 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:27.129499 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2dc92-18f1-4fb8-ad6d-97b6f22d3369 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:27.133522 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f2b38-90a6-4f0d-a7d7-df03d50868b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:27.135032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f2b38-90a6-4f0d-a7d7-df03d50868b0 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:27.135469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f2b38-90a6-4f0d-a7d7-df03d50868b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:27.135899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f2b38-90a6-4f0d-a7d7-df03d50868b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:27.137791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2dc92-18f1-4fb8-ad6d-97b6f22d3369 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:27.139252 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2dc92-18f1-4fb8-ad6d-97b6f22d3369 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:27.146903 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f2b38-90a6-4f0d-a7d7-df03d50868b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:27.148553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f2b38-90a6-4f0d-a7d7-df03d50868b0 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:27.154063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-a4b2dc92-18f1-4fb8-ad6d-97b6f22d3369 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 06 23:20:27.154063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:27.154063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:27.154063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:27.154063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:27.154063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:27.154063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:27.154063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:27.154063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:27.154063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:27.154063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:27.154063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:27.154063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:27.154063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:27.154063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:27.154063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:27.155179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:27.155179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:27.155179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:27.155179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:27.155179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:27.155179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:27.155179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:27.155179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:27.155179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:27.155179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:27.155179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:27.155179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:27.155179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:27.155179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:27.155179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:27.155179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:27.155179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:27.155179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:27.156327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:27.156327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:27.156327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:27.156327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:27.156327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:27.156327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:27.156327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:27.156327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:27.156327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 06 23:20:27.156327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:27.156327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 328/655] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:20:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:27.156327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2dc92-18f1-4fb8-ad6d-97b6f22d3369 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:27.170082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-162f2b38-90a6-4f0d-a7d7-df03d50868b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:27.170082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:27.170082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:27.170082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:27.170082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:27.170082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:27.170082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:27.170082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:27.170082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:27.170082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:27.170082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:27.170082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:27.170082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:27.170082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:27.170082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:27.171169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:27.171169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:27.171169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:27.171169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:27.171169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:27.171169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:27.171169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:27.171169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:27.171169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:27.171169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:27.171169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:27.171169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:27.171169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:27.171169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:27.171169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:27.171169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:27.171169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:27.172259 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:27.172259 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:27.172259 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:27.172259 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:27.174085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 328/656] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:27.175497 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f2b38-90a6-4f0d-a7d7-df03d50868b0 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:27.262736 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2dc92-18f1-4fb8-ad6d-97b6f22d3369 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:27.276163 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f2b38-90a6-4f0d-a7d7-df03d50868b0 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:27.296800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a226f-1aa1-44a1-a1a1-ce3d3df3c998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:27.297467 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a226f-1aa1-44a1-a1a1-ce3d3df3c998 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:27.297734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a226f-1aa1-44a1-a1a1-ce3d3df3c998 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:27.298010 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a226f-1aa1-44a1-a1a1-ce3d3df3c998 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:27.298731 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a226f-1aa1-44a1-a1a1-ce3d3df3c998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:27.299036 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a226f-1aa1-44a1-a1a1-ce3d3df3c998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:27.300689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a226f-1aa1-44a1-a1a1-ce3d3df3c998 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:27.313019 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 329/657] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:27.313970 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a226f-1aa1-44a1-a1a1-ce3d3df3c998 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:27.316655 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a57d17-851c-47b3-b7d8-506477dc1498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:27.317581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a57d17-851c-47b3-b7d8-506477dc1498 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:27.318620 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a57d17-851c-47b3-b7d8-506477dc1498 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:27.319109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a57d17-851c-47b3-b7d8-506477dc1498 None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:27.320179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a57d17-851c-47b3-b7d8-506477dc1498 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:27.320746 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a57d17-851c-47b3-b7d8-506477dc1498 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:27.326063 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a57d17-851c-47b3-b7d8-506477dc1498 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:27.344985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 329/658] 10.222.0.60 () {56 vars in 1137 bytes} [Fri May 6 23:20:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:27.346156 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a57d17-851c-47b3-b7d8-506477dc1498 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:27.415447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a226f-1aa1-44a1-a1a1-ce3d3df3c998 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:27.445198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a57d17-851c-47b3-b7d8-506477dc1498 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:27.451938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9543fd9-dace-4b50-8c58-afb4e37e9e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:27.452635 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9543fd9-dace-4b50-8c58-afb4e37e9e3c None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:27.452925 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9543fd9-dace-4b50-8c58-afb4e37e9e3c None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:27.453202 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9543fd9-dace-4b50-8c58-afb4e37e9e3c None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:27.453992 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9543fd9-dace-4b50-8c58-afb4e37e9e3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:27.454227 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9543fd9-dace-4b50-8c58-afb4e37e9e3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:27.455622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9543fd9-dace-4b50-8c58-afb4e37e9e3c None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:27.468563 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 330/659] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:27.469458 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9543fd9-dace-4b50-8c58-afb4e37e9e3c None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:27.482250 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6c8b7-6abf-4769-8e8a-6749fd1d5a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:27.483368 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6c8b7-6abf-4769-8e8a-6749fd1d5a3f None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:27.483851 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6c8b7-6abf-4769-8e8a-6749fd1d5a3f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:27.484346 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6c8b7-6abf-4769-8e8a-6749fd1d5a3f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:27.491890 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6c8b7-6abf-4769-8e8a-6749fd1d5a3f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:27.494146 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6c8b7-6abf-4769-8e8a-6749fd1d5a3f None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:27.509021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-66e6c8b7-6abf-4769-8e8a-6749fd1d5a3f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 06 23:20:27.509021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:27.509021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:27.509021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:27.509021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:27.509021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:27.509021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:27.509021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:27.509021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:27.509021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:27.509021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:27.509021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:27.509021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:27.509021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:27.509021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:27.509021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:27.510043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:27.510043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:27.510043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:27.510043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:27.510043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:27.510043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:27.510043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:27.510043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:27.510043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:27.510043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:27.510043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:27.510043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:27.510043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:27.510043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:27.510043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:27.510043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:27.510043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:27.510043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:27.510979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:27.510979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:27.510979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:27.510979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:27.510979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:27.510979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:27.510979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:27.510979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:27.510979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 06 23:20:27.510979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:27.513682 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 330/660] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:27.514716 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6c8b7-6abf-4769-8e8a-6749fd1d5a3f None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:27.579567 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9543fd9-dace-4b50-8c58-afb4e37e9e3c None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:27.615103 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46816b25-b461-4c20-aa20-328f264c5e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:27.615737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46816b25-b461-4c20-aa20-328f264c5e76 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:27.616025 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46816b25-b461-4c20-aa20-328f264c5e76 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:27.616299 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46816b25-b461-4c20-aa20-328f264c5e76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:27.626517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6c8b7-6abf-4769-8e8a-6749fd1d5a3f None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:27.664206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6fa62-beb0-4ed7-b018-f7864c8b2d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:27.665440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6fa62-beb0-4ed7-b018-f7864c8b2d1d None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:27.665925 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6fa62-beb0-4ed7-b018-f7864c8b2d1d None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:27.666412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6fa62-beb0-4ed7-b018-f7864c8b2d1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:27.673709 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6fa62-beb0-4ed7-b018-f7864c8b2d1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:27.675453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6fa62-beb0-4ed7-b018-f7864c8b2d1d None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:27.687766 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46816b25-b461-4c20-aa20-328f264c5e76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:27.689292 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46816b25-b461-4c20-aa20-328f264c5e76 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:27.690297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-d0c6fa62-beb0-4ed7-b018-f7864c8b2d1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:27.690297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:27.690297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:27.690297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:27.690297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:27.690297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:27.690297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:27.690297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:27.690297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:27.690297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:27.690297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:27.690297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:27.690297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:27.690297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:27.690297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:27.691162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:27.691162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:27.691162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:27.691162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:27.691162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:27.691162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:27.691162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:27.691162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:27.691162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:27.691162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:27.691162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:27.691162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:27.691162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:27.691162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:27.691162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:27.691162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:27.691162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:27.692070 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:27.692070 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:27.692070 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:27.692070 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:27.692070 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:27.692070 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:27.692070 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:27.692070 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:27.694566 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 331/661] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:27.695641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6fa62-beb0-4ed7-b018-f7864c8b2d1d None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:27.789602 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 331/662] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:20:27.790904 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46816b25-b461-4c20-aa20-328f264c5e76 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:27.795454 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6fa62-beb0-4ed7-b018-f7864c8b2d1d None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:27.831419 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a230319-dee5-4200-b737-0d639b345faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:27.832444 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a230319-dee5-4200-b737-0d639b345faf None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:27.832970 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a230319-dee5-4200-b737-0d639b345faf None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:27.833452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a230319-dee5-4200-b737-0d639b345faf None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:27.834512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a230319-dee5-4200-b737-0d639b345faf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:27.835018 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a230319-dee5-4200-b737-0d639b345faf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:27.836699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a230319-dee5-4200-b737-0d639b345faf None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:27.857745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 332/663] 10.222.0.60 () {56 vars in 1139 bytes} [Fri May 6 23:20:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:27.858850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a230319-dee5-4200-b737-0d639b345faf None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:27.896785 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46816b25-b461-4c20-aa20-328f264c5e76 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:27.933733 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a2bfe-f2fc-413c-badd-6c6c4f9c6d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:27.934396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a2bfe-f2fc-413c-badd-6c6c4f9c6d84 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:27.934679 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a2bfe-f2fc-413c-badd-6c6c4f9c6d84 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:27.934954 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a2bfe-f2fc-413c-badd-6c6c4f9c6d84 None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:27.935745 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a2bfe-f2fc-413c-badd-6c6c4f9c6d84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:27.936052 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a2bfe-f2fc-413c-badd-6c6c4f9c6d84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:27.937660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a2bfe-f2fc-413c-badd-6c6c4f9c6d84 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:27.950292 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 332/664] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:27.951247 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a2bfe-f2fc-413c-badd-6c6c4f9c6d84 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:27.963671 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a230319-dee5-4200-b737-0d639b345faf None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:28.008809 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf60929-63b6-41fd-829c-fded6a0fb619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:28.010595 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf60929-63b6-41fd-829c-fded6a0fb619 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:28.011081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf60929-63b6-41fd-829c-fded6a0fb619 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:28.011561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf60929-63b6-41fd-829c-fded6a0fb619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:28.022161 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf60929-63b6-41fd-829c-fded6a0fb619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:28.023878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf60929-63b6-41fd-829c-fded6a0fb619 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:28.046826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-eaf60929-63b6-41fd-829c-fded6a0fb619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:28.046826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:28.046826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:28.046826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:28.046826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:28.046826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:28.046826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:28.046826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:28.046826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:28.046826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:28.046826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:28.046826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:28.046826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:28.046826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:28.046826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:28.047799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:28.047799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:28.047799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:28.047799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:28.047799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:28.047799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:28.047799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:28.047799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:28.047799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:28.047799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:28.047799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:28.047799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:28.047799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:28.047799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:28.047799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:28.047799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:28.047799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:28.048724 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:28.048724 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:28.048724 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:28.048724 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:28.048724 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 333/665] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:28.048995 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf60929-63b6-41fd-829c-fded6a0fb619 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:28.058852 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a2bfe-f2fc-413c-badd-6c6c4f9c6d84 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:28.102717 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ba6d7-f519-48b4-ac90-eefd99438b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:28.103965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ba6d7-f519-48b4-ac90-eefd99438b2e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:28.104190 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ba6d7-f519-48b4-ac90-eefd99438b2e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:28.104475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ba6d7-f519-48b4-ac90-eefd99438b2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:28.152483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf60929-63b6-41fd-829c-fded6a0fb619 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:28.180065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ba6d7-f519-48b4-ac90-eefd99438b2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:28.181563 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ba6d7-f519-48b4-ac90-eefd99438b2e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:28.185084 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2a994-2d32-47fb-8a10-e47aebe9d182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:28.185734 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2a994-2d32-47fb-8a10-e47aebe9d182 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:28.186013 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2a994-2d32-47fb-8a10-e47aebe9d182 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:28.186284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2a994-2d32-47fb-8a10-e47aebe9d182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:28.187100 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2a994-2d32-47fb-8a10-e47aebe9d182 None admin] RBAC: Adding query filter params (role.id=71050e310414462b8d07f901fef201ad, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=a63ecc7210574058aad75a3114b57202) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:28.187408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2a994-2d32-47fb-8a10-e47aebe9d182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:28.188851 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2a994-2d32-47fb-8a10-e47aebe9d182 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:28.204828 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 334/666] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:20:28 2022] GET /identity/v3/role_assignments?user.id=a63ecc7210574058aad75a3114b57202&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=71050e310414462b8d07f901fef201ad => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:28.204828 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2a994-2d32-47fb-8a10-e47aebe9d182 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:28.310989 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 333/667] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:20:28.312989 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9e3ac-1997-44bb-bc4a-e3665f2bde73 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:28.313535 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9e3ac-1997-44bb-bc4a-e3665f2bde73 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:28.314230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9e3ac-1997-44bb-bc4a-e3665f2bde73 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:28.316316 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 334/668] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:28.321152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9e3ac-1997-44bb-bc4a-e3665f2bde73 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:28.328008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2a994-2d32-47fb-8a10-e47aebe9d182 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:28.364205 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf3612-5dfb-4ff2-8c82-e7cc695c11ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:28.364927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf3612-5dfb-4ff2-8c82-e7cc695c11ff None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:28.365208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf3612-5dfb-4ff2-8c82-e7cc695c11ff None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:28.365484 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf3612-5dfb-4ff2-8c82-e7cc695c11ff None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:28.366217 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf3612-5dfb-4ff2-8c82-e7cc695c11ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:28.366519 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf3612-5dfb-4ff2-8c82-e7cc695c11ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:28.367906 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf3612-5dfb-4ff2-8c82-e7cc695c11ff None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:28.381299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 335/669] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:28.382652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03901aba-5d3e-4c8b-80fa-817674773a54 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:28.382939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03901aba-5d3e-4c8b-80fa-817674773a54 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:28.383267 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03901aba-5d3e-4c8b-80fa-817674773a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:28.404047 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-03901aba-5d3e-4c8b-80fa-817674773a54 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:28.405313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-03901aba-5d3e-4c8b-80fa-817674773a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:28.448038 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9e3ac-1997-44bb-bc4a-e3665f2bde73 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:28.489195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 336/670] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:28.490270 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03901aba-5d3e-4c8b-80fa-817674773a54 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:28.497923 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c4a9e-2932-4fc2-b405-897a40da5690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:28.499469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c4a9e-2932-4fc2-b405-897a40da5690 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:28.499937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c4a9e-2932-4fc2-b405-897a40da5690 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:28.500844 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c4a9e-2932-4fc2-b405-897a40da5690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:28.515238 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c4a9e-2932-4fc2-b405-897a40da5690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:28.516738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c4a9e-2932-4fc2-b405-897a40da5690 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:28.537164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-2e5c4a9e-2932-4fc2-b405-897a40da5690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:28.537164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:28.537164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:28.537164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:28.537164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:28.537164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:28.537164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:28.537164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:28.537164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:28.537164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:28.537164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:28.537164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:28.537164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:28.537164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:28.537164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:28.538279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:28.538279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:28.538279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:28.538279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:28.538279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:28.538279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:28.538279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:28.538279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:28.538279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:28.538279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:28.538279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:28.538279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:28.538279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:28.538279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:28.538279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:28.538279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:28.538279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:28.539219 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:28.539219 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:28.539219 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:28.539219 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:28.539219 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 335/671] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:28.539514 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c4a9e-2932-4fc2-b405-897a40da5690 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:28.619553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03901aba-5d3e-4c8b-80fa-817674773a54 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:28.648709 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c4a9e-2932-4fc2-b405-897a40da5690 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:28.654335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cafec2-4552-4b21-a74e-505c204f939e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:28.655343 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cafec2-4552-4b21-a74e-505c204f939e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:28.655809 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cafec2-4552-4b21-a74e-505c204f939e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:28.656233 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cafec2-4552-4b21-a74e-505c204f939e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:28.663463 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cafec2-4552-4b21-a74e-505c204f939e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:28.665886 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cafec2-4552-4b21-a74e-505c204f939e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:28.679939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-46cafec2-4552-4b21-a74e-505c204f939e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:28.679939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:28.679939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:28.679939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:28.679939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:28.679939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:28.679939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:28.679939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:28.679939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:28.679939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:28.679939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:28.679939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:28.679939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:28.679939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:28.679939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:28.681140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:28.681140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:28.681140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:28.681140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:28.681140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:28.681140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:28.681140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:28.681140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:28.681140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:28.681140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:28.681140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:28.681140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:28.681140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:28.681140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:28.681140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:28.681140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:28.681140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:28.682133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:28.682133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:28.682133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:28.682133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:28.682133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:28.682133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:28.682133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:28.682133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:28.682894 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 337/672] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:28.683587 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cafec2-4552-4b21-a74e-505c204f939e None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:28.691926 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e5232-6057-4005-ba5c-91457d81355e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:28.692807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e5232-6057-4005-ba5c-91457d81355e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:28.693085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e5232-6057-4005-ba5c-91457d81355e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:28.693354 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e5232-6057-4005-ba5c-91457d81355e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:28.706818 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e5232-6057-4005-ba5c-91457d81355e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:28.716972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-176e5232-6057-4005-ba5c-91457d81355e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:28.716972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:28.716972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:28.716972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:28.716972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:28.716972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:28.716972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:28.716972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:28.716972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:28.716972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:28.716972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:28.716972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:28.716972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:28.716972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:28.716972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:28.716972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:28.717976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:28.717976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:28.717976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:28.717976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:28.717976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:28.717976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:28.717976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:28.717976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:28.717976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:28.717976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:28.717976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:28.717976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:28.717976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:28.717976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:28.717976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:28.717976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:28.718824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:28.718824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:28.718824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:28.718824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:28.718824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:28.718824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:28.718824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:28.718824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:28.718824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:28.718824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:28.718824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:28.718824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:28.723397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 336/673] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:28.724440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e5232-6057-4005-ba5c-91457d81355e None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:28.796275 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cafec2-4552-4b21-a74e-505c204f939e None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:28.833279 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b997442-df3d-45f0-b0ba-71360e0eb897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:28.834463 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b997442-df3d-45f0-b0ba-71360e0eb897 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:28.835006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b997442-df3d-45f0-b0ba-71360e0eb897 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:28.835486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b997442-df3d-45f0-b0ba-71360e0eb897 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:28.836439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b997442-df3d-45f0-b0ba-71360e0eb897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:28.837002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b997442-df3d-45f0-b0ba-71360e0eb897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:28.839415 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b997442-df3d-45f0-b0ba-71360e0eb897 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:28.843892 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e5232-6057-4005-ba5c-91457d81355e None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:28.856573 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 338/674] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:28.857742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b997442-df3d-45f0-b0ba-71360e0eb897 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:28.877881 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f3c0f-391f-48de-b449-4002f4a15e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:28.878510 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f3c0f-391f-48de-b449-4002f4a15e43 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:28.878786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f3c0f-391f-48de-b449-4002f4a15e43 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:28.879058 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f3c0f-391f-48de-b449-4002f4a15e43 None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:28.879831 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f3c0f-391f-48de-b449-4002f4a15e43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:28.880137 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f3c0f-391f-48de-b449-4002f4a15e43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:28.881590 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f3c0f-391f-48de-b449-4002f4a15e43 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:28.898345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 337/675] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:28.898345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f3c0f-391f-48de-b449-4002f4a15e43 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:28.971301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b997442-df3d-45f0-b0ba-71360e0eb897 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:29.001817 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f3c0f-391f-48de-b449-4002f4a15e43 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:29.006352 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd715a-9da5-4fc7-a07a-a1a98fa633f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:29.007292 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd715a-9da5-4fc7-a07a-a1a98fa633f5 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:29.007804 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd715a-9da5-4fc7-a07a-a1a98fa633f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:29.008280 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd715a-9da5-4fc7-a07a-a1a98fa633f5 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:29.009335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd715a-9da5-4fc7-a07a-a1a98fa633f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:29.009846 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd715a-9da5-4fc7-a07a-a1a98fa633f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:29.011482 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd715a-9da5-4fc7-a07a-a1a98fa633f5 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:29.020284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 339/676] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:20:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:29.021395 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd715a-9da5-4fc7-a07a-a1a98fa633f5 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:29.041260 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6b760-e977-4b1a-b3d0-8bbc047bf863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:29.042274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6b760-e977-4b1a-b3d0-8bbc047bf863 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:29.042388 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6b760-e977-4b1a-b3d0-8bbc047bf863 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:29.042581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6b760-e977-4b1a-b3d0-8bbc047bf863 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:29.049766 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6b760-e977-4b1a-b3d0-8bbc047bf863 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:29.051249 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6b760-e977-4b1a-b3d0-8bbc047bf863 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:29.065654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-eba6b760-e977-4b1a-b3d0-8bbc047bf863 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:29.065654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:29.065654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:29.065654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:29.065654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:29.065654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:29.065654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:29.065654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:29.065654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:29.065654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:29.065654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:29.065654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:29.065654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:29.065654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:29.065654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:29.066603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:29.066603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:29.066603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:29.066603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:29.066603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:29.066603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:29.066603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:29.066603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:29.066603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:29.066603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:29.066603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:29.066603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:29.066603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:29.066603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:29.066603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:29.066603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:29.066603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:29.067492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:29.067492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:29.067492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:29.067492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:29.067492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:29.067492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:29.067492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:29.067492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:29.067492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 338/677] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:29.068525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6b760-e977-4b1a-b3d0-8bbc047bf863 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:29.130376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd715a-9da5-4fc7-a07a-a1a98fa633f5 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:29.164406 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6b760-e977-4b1a-b3d0-8bbc047bf863 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:29.166619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ec45e-e4d6-4c86-9c84-e3c0b04fae97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:29.167270 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ec45e-e4d6-4c86-9c84-e3c0b04fae97 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:29.167543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ec45e-e4d6-4c86-9c84-e3c0b04fae97 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:29.167809 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ec45e-e4d6-4c86-9c84-e3c0b04fae97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:29.168652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ec45e-e4d6-4c86-9c84-e3c0b04fae97 None admin] RBAC: Adding query filter params (role.id=71050e310414462b8d07f901fef201ad, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=36d2df2ca106409995e139652ee995e4) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:29.168957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ec45e-e4d6-4c86-9c84-e3c0b04fae97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:29.170369 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ec45e-e4d6-4c86-9c84-e3c0b04fae97 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:29.180619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 340/678] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:20:29 2022] GET /identity/v3/role_assignments?user.id=36d2df2ca106409995e139652ee995e4&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=71050e310414462b8d07f901fef201ad => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:29.180619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ec45e-e4d6-4c86-9c84-e3c0b04fae97 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:29.217472 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52b3eb-9e59-4b3b-84b0-4b0146cff5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:29.218283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52b3eb-9e59-4b3b-84b0-4b0146cff5d7 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:29.218566 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52b3eb-9e59-4b3b-84b0-4b0146cff5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:29.218837 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52b3eb-9e59-4b3b-84b0-4b0146cff5d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:29.237601 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52b3eb-9e59-4b3b-84b0-4b0146cff5d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:29.240011 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52b3eb-9e59-4b3b-84b0-4b0146cff5d7 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:29.263622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-7d52b3eb-9e59-4b3b-84b0-4b0146cff5d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:29.263622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:29.263622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:29.263622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:29.263622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:29.263622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:29.263622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:29.263622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:29.263622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:29.263622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:29.263622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:29.263622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:29.263622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:29.263622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:29.263622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:29.264793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:29.264793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:29.264793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:29.264793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:29.264793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:29.264793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:29.264793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:29.264793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:29.264793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:29.264793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:29.264793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:29.264793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:29.264793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:29.264793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:29.264793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:29.264793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:29.264793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:29.265786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:29.265786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:29.265786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:29.265786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:29.265786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 339/679] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:29.267067 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e478113-98f2-4204-bed7-2eb5d6cae284 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:29.267312 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e478113-98f2-4204-bed7-2eb5d6cae284 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:29.267586 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e478113-98f2-4204-bed7-2eb5d6cae284 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:29.272702 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 340/680] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:29.273670 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e478113-98f2-4204-bed7-2eb5d6cae284 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:29.298539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ec45e-e4d6-4c86-9c84-e3c0b04fae97 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:29.334628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd1a51-cd7c-4e74-ab5c-117ac634f7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:29.335270 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd1a51-cd7c-4e74-ab5c-117ac634f7d3 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:29.335669 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd1a51-cd7c-4e74-ab5c-117ac634f7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:29.335978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd1a51-cd7c-4e74-ab5c-117ac634f7d3 None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:29.336819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd1a51-cd7c-4e74-ab5c-117ac634f7d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:29.337228 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd1a51-cd7c-4e74-ab5c-117ac634f7d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:29.338775 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd1a51-cd7c-4e74-ab5c-117ac634f7d3 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:29.352039 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 341/681] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:29.354558 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058a584-52e3-44e8-a78d-de9e595768da None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:29.354981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058a584-52e3-44e8-a78d-de9e595768da None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:29.355256 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058a584-52e3-44e8-a78d-de9e595768da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:29.376645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-d058a584-52e3-44e8-a78d-de9e595768da None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:29.377847 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d058a584-52e3-44e8-a78d-de9e595768da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:29.401425 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e478113-98f2-4204-bed7-2eb5d6cae284 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:29.441797 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ec785-f765-42bc-8799-394119aa07bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:29.442559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ec785-f765-42bc-8799-394119aa07bf None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:29.442843 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ec785-f765-42bc-8799-394119aa07bf None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:29.443114 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ec785-f765-42bc-8799-394119aa07bf None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:29.443833 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ec785-f765-42bc-8799-394119aa07bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:29.444143 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ec785-f765-42bc-8799-394119aa07bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:29.445628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ec785-f765-42bc-8799-394119aa07bf None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:29.459924 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 341/682] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:29.464617 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 342/683] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:29.465430 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ec785-f765-42bc-8799-394119aa07bf None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:29.466353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058a584-52e3-44e8-a78d-de9e595768da None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:29.591296 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ec785-f765-42bc-8799-394119aa07bf None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:29.601680 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058a584-52e3-44e8-a78d-de9e595768da None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:29.637239 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e41fb4-1b53-4208-a2a9-065a9fc51600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:29.638731 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e41fb4-1b53-4208-a2a9-065a9fc51600 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:29.639666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e41fb4-1b53-4208-a2a9-065a9fc51600 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:29.640444 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e41fb4-1b53-4208-a2a9-065a9fc51600 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:29.641982 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e41fb4-1b53-4208-a2a9-065a9fc51600 None admin] RBAC: Adding query filter params (role.id=71050e310414462b8d07f901fef201ad, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=046352b8553c4f23b6dda151f6f7ce00) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:29.642496 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e41fb4-1b53-4208-a2a9-065a9fc51600 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:29.642894 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc118a-e9c4-4acc-b195-3db1794f2407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:29.643806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc118a-e9c4-4acc-b195-3db1794f2407 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:29.644184 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc118a-e9c4-4acc-b195-3db1794f2407 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:29.644576 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc118a-e9c4-4acc-b195-3db1794f2407 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:29.644790 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e41fb4-1b53-4208-a2a9-065a9fc51600 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:29.652185 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 342/684] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:20:29 2022] GET /identity/v3/role_assignments?user.id=046352b8553c4f23b6dda151f6f7ce00&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=71050e310414462b8d07f901fef201ad => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:29.653378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e41fb4-1b53-4208-a2a9-065a9fc51600 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:29.654282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc118a-e9c4-4acc-b195-3db1794f2407 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:29.655849 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc118a-e9c4-4acc-b195-3db1794f2407 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:29.676317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-6cbc118a-e9c4-4acc-b195-3db1794f2407 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 06 23:20:29.676317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:29.676317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:29.676317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:29.676317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:29.676317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:29.676317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:29.676317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:29.676317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:29.676317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:29.676317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:29.676317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:29.676317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:29.676317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:29.676317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:29.676317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:29.677594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:29.677594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:29.677594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:29.677594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:29.677594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:29.677594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:29.677594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:29.677594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:29.677594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:29.677594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:29.677594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:29.677594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:29.677594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:29.677594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:29.677594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:29.677594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:29.677594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:29.677594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:29.678766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:29.678766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:29.678766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:29.678766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:29.678766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:29.678766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:29.678766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:29.678766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:29.678766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 06 23:20:29.678766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:29.681656 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 343/685] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:20:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:29.687684 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc118a-e9c4-4acc-b195-3db1794f2407 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:29.766149 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e41fb4-1b53-4208-a2a9-065a9fc51600 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:29.823532 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ba4f2-9deb-492e-b1cd-187c95f02e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:29.824354 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ba4f2-9deb-492e-b1cd-187c95f02e25 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:29.824729 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ba4f2-9deb-492e-b1cd-187c95f02e25 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:29.825009 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ba4f2-9deb-492e-b1cd-187c95f02e25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:29.847826 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ba4f2-9deb-492e-b1cd-187c95f02e25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:29.859390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-409ba4f2-9deb-492e-b1cd-187c95f02e25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:20:29.859390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:29.859390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:29.859390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:29.859390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:29.859390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:29.859390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:29.859390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:29.859390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:29.859390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:29.859390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:29.859390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:29.859390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:29.859390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:29.859390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:29.859390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:29.860424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:29.860424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:29.860424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:29.860424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:29.860424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:29.860424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:29.860424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:29.860424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:29.860424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:29.860424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:29.860424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:29.860424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:29.860424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:29.860424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:29.860424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:29.860424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:29.861386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:29.861386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:29.861386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:29.861386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:29.861386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:29.861386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:29.861386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:29.861386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:29.861386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:29.861386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:29.861386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:20:29.861386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:29.869056 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 343/686] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:20:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:29.871414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ba4f2-9deb-492e-b1cd-187c95f02e25 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:29.883033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc118a-e9c4-4acc-b195-3db1794f2407 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:29.929750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2609e23-a62e-4162-b8a5-fe9e3b9d37ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:29.930580 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2609e23-a62e-4162-b8a5-fe9e3b9d37ea None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:29.931058 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2609e23-a62e-4162-b8a5-fe9e3b9d37ea None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:29.931427 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2609e23-a62e-4162-b8a5-fe9e3b9d37ea None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:29.932363 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2609e23-a62e-4162-b8a5-fe9e3b9d37ea None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:29.932793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2609e23-a62e-4162-b8a5-fe9e3b9d37ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:29.934323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2609e23-a62e-4162-b8a5-fe9e3b9d37ea None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:29.952520 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 344/687] 10.222.0.60 () {56 vars in 1135 bytes} [Fri May 6 23:20:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:29.959016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2609e23-a62e-4162-b8a5-fe9e3b9d37ea None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:29.993754 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ba4f2-9deb-492e-b1cd-187c95f02e25 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:30.032846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df3634-2450-4627-aba7-a35b7da52e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:30.034207 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df3634-2450-4627-aba7-a35b7da52e8c None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:30.034207 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df3634-2450-4627-aba7-a35b7da52e8c None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:30.034207 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df3634-2450-4627-aba7-a35b7da52e8c None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:30.034783 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df3634-2450-4627-aba7-a35b7da52e8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:30.035084 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df3634-2450-4627-aba7-a35b7da52e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:30.036455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df3634-2450-4627-aba7-a35b7da52e8c None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:30.046048 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 344/688] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:20:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:30.052512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df3634-2450-4627-aba7-a35b7da52e8c None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:30.066803 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2609e23-a62e-4162-b8a5-fe9e3b9d37ea None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:30.108486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8484d37-35c6-4758-aab7-19d02a18a312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:30.109074 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8484d37-35c6-4758-aab7-19d02a18a312 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:30.109937 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8484d37-35c6-4758-aab7-19d02a18a312 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:30.109937 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8484d37-35c6-4758-aab7-19d02a18a312 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:30.184919 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df3634-2450-4627-aba7-a35b7da52e8c None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:30.200814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8484d37-35c6-4758-aab7-19d02a18a312 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:30.202693 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8484d37-35c6-4758-aab7-19d02a18a312 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:30.243762 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d3d8e-ee97-4017-b3f3-309a7b52f2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:30.246141 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d3d8e-ee97-4017-b3f3-309a7b52f2ad None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:30.249074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d3d8e-ee97-4017-b3f3-309a7b52f2ad None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:30.249595 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d3d8e-ee97-4017-b3f3-309a7b52f2ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:30.276260 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d3d8e-ee97-4017-b3f3-309a7b52f2ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:30.278096 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d3d8e-ee97-4017-b3f3-309a7b52f2ad None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:30.313070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-171d3d8e-ee97-4017-b3f3-309a7b52f2ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:30.313070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:30.313070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:30.313070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:30.313070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:30.313070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:30.313070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:30.313070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:30.313070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:30.313070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:30.313070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:30.313070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:30.313070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:30.313070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:30.313070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:30.314022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:30.314022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:30.314022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:30.314022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:30.314022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:30.314022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:30.314022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:30.314022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:30.314022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:30.314022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:30.314022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:30.314022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:30.314022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:30.314022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:30.314022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:30.314022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:30.314022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:30.319541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:30.319541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:30.319541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:30.319541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:30.319541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 345/689] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:30.325870 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d3d8e-ee97-4017-b3f3-309a7b52f2ad None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:30.342352 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 345/690] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 06 23:20:30.349599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8484d37-35c6-4758-aab7-19d02a18a312 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:30.490317 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d3d8e-ee97-4017-b3f3-309a7b52f2ad None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:30.528248 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bfbb6-cd3a-4d89-afd7-1857be6ed2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:30.530299 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bfbb6-cd3a-4d89-afd7-1857be6ed2a8 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:30.532122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bfbb6-cd3a-4d89-afd7-1857be6ed2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:30.533297 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bfbb6-cd3a-4d89-afd7-1857be6ed2a8 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:30.534868 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bfbb6-cd3a-4d89-afd7-1857be6ed2a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:30.535550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bfbb6-cd3a-4d89-afd7-1857be6ed2a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:30.538214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bfbb6-cd3a-4d89-afd7-1857be6ed2a8 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:30.547839 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8484d37-35c6-4758-aab7-19d02a18a312 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:30.567037 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 346/691] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:30.572758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bfbb6-cd3a-4d89-afd7-1857be6ed2a8 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:30.587848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71db08f-90ac-476c-839f-de04a30d7aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:30.589289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71db08f-90ac-476c-839f-de04a30d7aaa None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:30.589775 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71db08f-90ac-476c-839f-de04a30d7aaa None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:30.590246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71db08f-90ac-476c-839f-de04a30d7aaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:30.601774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71db08f-90ac-476c-839f-de04a30d7aaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:30.603618 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71db08f-90ac-476c-839f-de04a30d7aaa None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:30.622056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-a71db08f-90ac-476c-839f-de04a30d7aaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:30.622056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:30.622056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:30.622056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:30.622056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:30.622056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:30.622056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:30.622056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:30.622056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:30.622056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:30.622056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:30.622056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:30.622056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:30.622056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:30.622056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:30.622985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:30.622985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:30.622985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:30.622985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:30.622985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:30.622985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:30.622985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:30.622985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:30.622985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:30.622985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:30.622985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:30.622985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:30.622985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:30.622985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:30.622985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:30.622985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:30.622985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:30.623877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:30.623877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:30.623877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:30.623877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:30.629802 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 346/692] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:30.636215 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71db08f-90ac-476c-839f-de04a30d7aaa None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:30.757002 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bfbb6-cd3a-4d89-afd7-1857be6ed2a8 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:30.793132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556635e-1a5b-4989-a1fd-f5129e56e87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:30.793932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556635e-1a5b-4989-a1fd-f5129e56e87a None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:30.794212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556635e-1a5b-4989-a1fd-f5129e56e87a None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:30.794492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556635e-1a5b-4989-a1fd-f5129e56e87a None admin] PATH_INFO: `/v3/users/nova` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:30.801575 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556635e-1a5b-4989-a1fd-f5129e56e87a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:30.803022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556635e-1a5b-4989-a1fd-f5129e56e87a None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:30.804222 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71db08f-90ac-476c-839f-de04a30d7aaa None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:30.817080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-3556635e-1a5b-4989-a1fd-f5129e56e87a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 06 23:20:30.817080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:30.817080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:30.817080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:30.817080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:30.817080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:30.817080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:30.817080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:30.817080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:30.817080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:30.817080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:30.817080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:30.817080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:30.817080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:30.817080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:30.817080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:30.817991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:30.817991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:30.817991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:30.817991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:30.817991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:30.817991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:30.817991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:30.817991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:30.817991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:30.817991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:30.817991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:30.817991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:30.817991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:30.817991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:30.817991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:30.817991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:30.817991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:30.817991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:30.818922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:30.818922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:30.818922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:30.818922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:30.818922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:30.818922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:30.818922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:30.818922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:30.818922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 06 23:20:30.818922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:30.818922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 347/693] 10.222.0.60 () {56 vars in 1093 bytes} [Fri May 6 23:20:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:30.820055 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a00c52-f29f-4d43-9865-a7dc7901a538 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:30.820055 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a00c52-f29f-4d43-9865-a7dc7901a538 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:30.820328 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a00c52-f29f-4d43-9865-a7dc7901a538 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:30.826737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 348/694] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:30.827612 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a00c52-f29f-4d43-9865-a7dc7901a538 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:30.861172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d141d2-ef45-4c3f-8eee-9ee628d46c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:30.862275 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d141d2-ef45-4c3f-8eee-9ee628d46c93 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:30.863071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d141d2-ef45-4c3f-8eee-9ee628d46c93 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:30.863799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d141d2-ef45-4c3f-8eee-9ee628d46c93 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:30.864773 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d141d2-ef45-4c3f-8eee-9ee628d46c93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:30.865306 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d141d2-ef45-4c3f-8eee-9ee628d46c93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:30.867049 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d141d2-ef45-4c3f-8eee-9ee628d46c93 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:30.883149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 347/695] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:30.885313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f74612-f5ca-40fe-9be1-f2ce807b2aff None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:30.885817 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f74612-f5ca-40fe-9be1-f2ce807b2aff None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:30.886737 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f74612-f5ca-40fe-9be1-f2ce807b2aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:30.907941 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-48f74612-f5ca-40fe-9be1-f2ce807b2aff None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:30.909850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-48f74612-f5ca-40fe-9be1-f2ce807b2aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:30.937990 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a00c52-f29f-4d43-9865-a7dc7901a538 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:30.979638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfa60a-89c7-4a20-b0aa-ae82ac843a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:30.980675 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfa60a-89c7-4a20-b0aa-ae82ac843a14 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:30.980976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfa60a-89c7-4a20-b0aa-ae82ac843a14 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:30.981254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfa60a-89c7-4a20-b0aa-ae82ac843a14 None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:30.982429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfa60a-89c7-4a20-b0aa-ae82ac843a14 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:30.982742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfa60a-89c7-4a20-b0aa-ae82ac843a14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:30.984810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfa60a-89c7-4a20-b0aa-ae82ac843a14 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:31.000561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 348/696] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:31.000561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f74612-f5ca-40fe-9be1-f2ce807b2aff None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:31.015681 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 349/697] 10.222.0.60 () {56 vars in 1133 bytes} [Fri May 6 23:20:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:31.022543 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfa60a-89c7-4a20-b0aa-ae82ac843a14 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:31.128439 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfa60a-89c7-4a20-b0aa-ae82ac843a14 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:31.134292 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f74612-f5ca-40fe-9be1-f2ce807b2aff None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:31.162665 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6dfe7-48bd-491e-bb51-355227891683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:31.163331 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6dfe7-48bd-491e-bb51-355227891683 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:31.163592 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6dfe7-48bd-491e-bb51-355227891683 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:31.163868 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6dfe7-48bd-491e-bb51-355227891683 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:31.177237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930f376-f749-46db-ab6c-b53866a658fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:31.178596 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930f376-f749-46db-ab6c-b53866a658fc None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:31.179062 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930f376-f749-46db-ab6c-b53866a658fc None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:31.179654 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930f376-f749-46db-ab6c-b53866a658fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:31.189265 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930f376-f749-46db-ab6c-b53866a658fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:31.191719 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930f376-f749-46db-ab6c-b53866a658fc None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:31.209850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-e930f376-f749-46db-ab6c-b53866a658fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:31.209850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:31.209850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:31.209850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:31.209850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:31.209850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:31.209850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:31.209850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:31.209850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:31.209850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:31.209850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:31.209850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:31.209850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:31.209850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:31.209850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:31.210813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:31.210813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:31.210813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:31.210813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:31.210813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:31.210813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:31.210813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:31.210813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:31.210813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:31.210813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:31.210813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:31.210813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:31.210813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:31.210813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:31.210813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:31.210813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:31.210813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:31.211710 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:31.211710 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:31.211710 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:31.211710 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:31.211710 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:31.211710 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:31.211710 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:31.211710 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:31.219703 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 349/698] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:31.219703 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930f376-f749-46db-ab6c-b53866a658fc None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:31.242088 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6dfe7-48bd-491e-bb51-355227891683 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:31.244143 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6dfe7-48bd-491e-bb51-355227891683 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:31.338000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930f376-f749-46db-ab6c-b53866a658fc None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:31.360695 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 350/699] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 06 23:20:31.362738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6dfe7-48bd-491e-bb51-355227891683 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:31.378676 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531c9a0-4725-41a9-b43e-103980975763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:31.380518 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531c9a0-4725-41a9-b43e-103980975763 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:31.381037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531c9a0-4725-41a9-b43e-103980975763 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:31.381540 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531c9a0-4725-41a9-b43e-103980975763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:31.396870 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531c9a0-4725-41a9-b43e-103980975763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:31.398300 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531c9a0-4725-41a9-b43e-103980975763 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:31.415927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-0531c9a0-4725-41a9-b43e-103980975763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:31.415927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:31.415927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:31.415927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:31.415927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:31.415927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:31.415927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:31.415927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:31.415927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:31.415927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:31.415927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:31.415927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:31.415927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:31.415927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:31.415927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:31.416893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:31.416893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:31.416893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:31.416893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:31.416893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:31.416893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:31.416893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:31.416893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:31.416893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:31.416893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:31.416893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:31.416893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:31.416893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:31.416893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:31.416893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:31.416893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:31.416893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:31.417765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:31.417765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:31.417765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:31.417765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:31.422151 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 350/700] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:31.423616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531c9a0-4725-41a9-b43e-103980975763 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:31.486349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6dfe7-48bd-491e-bb51-355227891683 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:31.526045 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5113b7-887e-4dd2-8f81-4e8880bf3c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:31.526876 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5113b7-887e-4dd2-8f81-4e8880bf3c77 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:31.527313 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5113b7-887e-4dd2-8f81-4e8880bf3c77 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:31.527661 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5113b7-887e-4dd2-8f81-4e8880bf3c77 None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:31.528516 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5113b7-887e-4dd2-8f81-4e8880bf3c77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:31.528931 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5113b7-887e-4dd2-8f81-4e8880bf3c77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:31.530434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5113b7-887e-4dd2-8f81-4e8880bf3c77 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:31.531560 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531c9a0-4725-41a9-b43e-103980975763 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:31.543319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 351/701] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:31.544727 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5113b7-887e-4dd2-8f81-4e8880bf3c77 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:31.574571 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf4f2f-d008-47b8-ab55-0505fce62786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:31.575397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf4f2f-d008-47b8-ab55-0505fce62786 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:31.575679 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf4f2f-d008-47b8-ab55-0505fce62786 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:31.575950 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf4f2f-d008-47b8-ab55-0505fce62786 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:31.586523 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf4f2f-d008-47b8-ab55-0505fce62786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:31.588224 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf4f2f-d008-47b8-ab55-0505fce62786 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:31.607111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-74cf4f2f-d008-47b8-ab55-0505fce62786 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:31.607111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:31.607111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:31.607111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:31.607111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:31.607111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:31.607111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:31.607111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:31.607111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:31.607111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:31.607111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:31.607111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:31.607111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:31.607111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:31.607111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:31.608026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:31.608026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:31.608026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:31.608026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:31.608026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:31.608026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:31.608026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:31.608026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:31.608026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:31.608026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:31.608026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:31.608026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:31.608026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:31.608026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:31.608026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:31.608026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:31.608026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:31.608947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:31.608947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:31.608947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:31.608947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:31.608947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 351/702] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:31.609681 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf4f2f-d008-47b8-ab55-0505fce62786 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:31.665905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5113b7-887e-4dd2-8f81-4e8880bf3c77 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:31.704194 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fc22d-f429-4ae7-aa61-7a66c89c8db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:31.705117 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fc22d-f429-4ae7-aa61-7a66c89c8db3 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:31.705716 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fc22d-f429-4ae7-aa61-7a66c89c8db3 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:31.706002 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fc22d-f429-4ae7-aa61-7a66c89c8db3 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:31.707027 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9fc22d-f429-4ae7-aa61-7a66c89c8db3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:31.707315 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9fc22d-f429-4ae7-aa61-7a66c89c8db3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:31.708881 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9fc22d-f429-4ae7-aa61-7a66c89c8db3 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:31.713780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf4f2f-d008-47b8-ab55-0505fce62786 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:31.720664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 352/703] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:31.721474 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fc22d-f429-4ae7-aa61-7a66c89c8db3 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:31.757901 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71768029-2c11-452e-931c-611459c800f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:31.758944 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71768029-2c11-452e-931c-611459c800f5 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:31.759543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71768029-2c11-452e-931c-611459c800f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:31.760474 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71768029-2c11-452e-931c-611459c800f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:31.761470 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71768029-2c11-452e-931c-611459c800f5 None admin] RBAC: Adding query filter params (role.id=71050e310414462b8d07f901fef201ad, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=48b3ec57aee94b87889d578e114fa0db) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:31.762264 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71768029-2c11-452e-931c-611459c800f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:31.764472 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71768029-2c11-452e-931c-611459c800f5 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:31.772691 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 352/704] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:20:31 2022] GET /identity/v3/role_assignments?user.id=48b3ec57aee94b87889d578e114fa0db&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=71050e310414462b8d07f901fef201ad => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:31.774097 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1583912-96cf-4f5f-a321-f3c121fe6896 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:31.774459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1583912-96cf-4f5f-a321-f3c121fe6896 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:31.775330 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1583912-96cf-4f5f-a321-f3c121fe6896 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:31.778254 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 353/705] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:31.778254 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1583912-96cf-4f5f-a321-f3c121fe6896 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:31.849686 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fc22d-f429-4ae7-aa61-7a66c89c8db3 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:31.891060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd00c94-d7f8-4de1-872e-b31d10d515ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:31.892141 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd00c94-d7f8-4de1-872e-b31d10d515ea None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:31.892702 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd00c94-d7f8-4de1-872e-b31d10d515ea None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:31.893206 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd00c94-d7f8-4de1-872e-b31d10d515ea None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:31.894293 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd00c94-d7f8-4de1-872e-b31d10d515ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:31.894816 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd00c94-d7f8-4de1-872e-b31d10d515ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:31.896440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd00c94-d7f8-4de1-872e-b31d10d515ea None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:31.905836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1583912-96cf-4f5f-a321-f3c121fe6896 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:31.910618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 353/706] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:31.912284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d962d-9daa-4f8e-a8bd-a2be59fd53f4 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:31.912821 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d962d-9daa-4f8e-a8bd-a2be59fd53f4 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:31.913317 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d962d-9daa-4f8e-a8bd-a2be59fd53f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:31.932855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-cb5d962d-9daa-4f8e-a8bd-a2be59fd53f4 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:31.934528 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-cb5d962d-9daa-4f8e-a8bd-a2be59fd53f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:31.953999 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e9b28-1608-4681-9448-859d29cb23eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:31.956457 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e9b28-1608-4681-9448-859d29cb23eb None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:31.956917 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e9b28-1608-4681-9448-859d29cb23eb None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:31.957361 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e9b28-1608-4681-9448-859d29cb23eb None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:31.958302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e9b28-1608-4681-9448-859d29cb23eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:31.959982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e9b28-1608-4681-9448-859d29cb23eb None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:31.984763 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 354/707] 10.222.0.60 () {60 vars in 1132 bytes} [Fri May 6 23:20:31 2022] POST /identity/v3/users => generated 254 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:20:31.985845 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e9b28-1608-4681-9448-859d29cb23eb None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:32.017539 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 354/708] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:32.041444 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d962d-9daa-4f8e-a8bd-a2be59fd53f4 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:32.116991 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e9b28-1608-4681-9448-859d29cb23eb None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:32.154951 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddedec-a444-4a02-bed9-eef3912dadf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:32.156112 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddedec-a444-4a02-bed9-eef3912dadf6 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:32.156499 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddedec-a444-4a02-bed9-eef3912dadf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:32.157287 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddedec-a444-4a02-bed9-eef3912dadf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:32.165955 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddedec-a444-4a02-bed9-eef3912dadf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:32.167691 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddedec-a444-4a02-bed9-eef3912dadf6 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:32.168210 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d962d-9daa-4f8e-a8bd-a2be59fd53f4 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:32.184016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-85ddedec-a444-4a02-bed9-eef3912dadf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:32.184016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:32.184016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:32.184016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:32.184016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:32.184016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:32.184016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:32.184016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:32.184016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:32.184016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:32.184016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:32.184016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:32.184016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:32.184016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:32.184016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:32.185055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:32.185055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:32.185055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:32.185055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:32.185055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:32.185055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:32.185055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:32.185055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:32.185055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:32.185055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:32.185055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:32.185055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:32.185055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:32.185055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:32.185055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:32.185055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:32.185055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:32.185948 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:32.185948 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:32.185948 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:32.185948 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:32.185948 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:32.185948 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:32.185948 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:32.185948 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:32.185948 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 355/709] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:32.193348 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddedec-a444-4a02-bed9-eef3912dadf6 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:32.215648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1272d1-1ea2-40d8-b7bd-09cc5a334784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:32.216813 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1272d1-1ea2-40d8-b7bd-09cc5a334784 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:32.217287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1272d1-1ea2-40d8-b7bd-09cc5a334784 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:32.217563 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1272d1-1ea2-40d8-b7bd-09cc5a334784 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:32.218224 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1272d1-1ea2-40d8-b7bd-09cc5a334784 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:32.219630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1272d1-1ea2-40d8-b7bd-09cc5a334784 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:32.239164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-1a1272d1-1ea2-40d8-b7bd-09cc5a334784 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 06 23:20:32.239164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:32.239164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:20:32.239164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:20:32.239164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:20:32.239164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:20:32.239164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:20:32.239164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:32.239164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 06 23:20:32.239164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:32.239164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:20:32.239164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:32.239164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:32.239164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:32.239164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:32.239164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:32.240214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:32.240214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:32.240214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:32.240214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:32.240214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:32.240214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:32.240214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:32.240214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:20:32.240214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:20:32.240214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:20:32.240214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:20:32.240214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:32.240214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:32.240214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:32.240214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:32.240214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:32.241106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:32.241106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:32.241106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:32.241106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:32.241106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:32.241106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:32.241106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:32.241106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:32.241106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:32.241106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:32.241106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:32.241106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:20:32.241106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:32.241106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 06 23:20:32.241106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:32.241106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 355/710] 10.222.0.60 () {56 vars in 1129 bytes} [Fri May 6 23:20:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:32.248044 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1272d1-1ea2-40d8-b7bd-09cc5a334784 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:32.331074 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddedec-a444-4a02-bed9-eef3912dadf6 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:32.367976 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c6e44-f1a3-4a09-94e7-1d88f8329524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:32.368634 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c6e44-f1a3-4a09-94e7-1d88f8329524 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:32.368918 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c6e44-f1a3-4a09-94e7-1d88f8329524 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:32.369192 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c6e44-f1a3-4a09-94e7-1d88f8329524 None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:32.369986 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c6e44-f1a3-4a09-94e7-1d88f8329524 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:32.370293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c6e44-f1a3-4a09-94e7-1d88f8329524 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:32.371731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c6e44-f1a3-4a09-94e7-1d88f8329524 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:32.372387 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1272d1-1ea2-40d8-b7bd-09cc5a334784 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:32.384771 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 356/711] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:32.386221 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce73ce6-44d1-480d-b605-e3ae154462ba None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:32.386440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce73ce6-44d1-480d-b605-e3ae154462ba None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:32.386719 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce73ce6-44d1-480d-b605-e3ae154462ba None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:32.392980 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 357/712] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:32.393777 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce73ce6-44d1-480d-b605-e3ae154462ba None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:32.422574 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63423d-ce70-46a3-a3cf-7252a96a164c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:32.424148 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63423d-ce70-46a3-a3cf-7252a96a164c None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:32.424814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63423d-ce70-46a3-a3cf-7252a96a164c None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:32.425334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63423d-ce70-46a3-a3cf-7252a96a164c None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:32.426401 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63423d-ce70-46a3-a3cf-7252a96a164c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:32.426869 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63423d-ce70-46a3-a3cf-7252a96a164c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:32.429044 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63423d-ce70-46a3-a3cf-7252a96a164c None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:32.436333 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 356/713] 10.222.0.60 () {56 vars in 1124 bytes} [Fri May 6 23:20:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:32.437822 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13985f48-3d93-48c3-92c0-b79f049d0df9 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:32.438301 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13985f48-3d93-48c3-92c0-b79f049d0df9 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:32.438793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13985f48-3d93-48c3-92c0-b79f049d0df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:32.469553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-13985f48-3d93-48c3-92c0-b79f049d0df9 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:32.471026 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-13985f48-3d93-48c3-92c0-b79f049d0df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:32.513268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce73ce6-44d1-480d-b605-e3ae154462ba None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:32.543225 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 357/714] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:32.544345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13985f48-3d93-48c3-92c0-b79f049d0df9 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:32.548414 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527c18e-246b-4ec5-9e77-3e96b669e768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:32.549102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527c18e-246b-4ec5-9e77-3e96b669e768 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:32.549382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527c18e-246b-4ec5-9e77-3e96b669e768 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:32.549657 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527c18e-246b-4ec5-9e77-3e96b669e768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:32.550611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527c18e-246b-4ec5-9e77-3e96b669e768 None admin] RBAC: Adding query filter params (role.id=408ee9a3a38640a48dbcdb2c377efcd8, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=9b74631c6e1547d991753a65c41bc7e7) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:32.550922 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527c18e-246b-4ec5-9e77-3e96b669e768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:32.552349 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527c18e-246b-4ec5-9e77-3e96b669e768 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:32.558514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 358/715] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:20:32 2022] GET /identity/v3/role_assignments?user.id=9b74631c6e1547d991753a65c41bc7e7&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=408ee9a3a38640a48dbcdb2c377efcd8 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:32.581089 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527c18e-246b-4ec5-9e77-3e96b669e768 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:32.650556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13985f48-3d93-48c3-92c0-b79f049d0df9 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:32.686226 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffcc2a-7c3e-443f-963f-e015340374b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:32.687307 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffcc2a-7c3e-443f-963f-e015340374b2 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:32.687788 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffcc2a-7c3e-443f-963f-e015340374b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:32.688279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffcc2a-7c3e-443f-963f-e015340374b2 None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:32.689239 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffcc2a-7c3e-443f-963f-e015340374b2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:32.689759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffcc2a-7c3e-443f-963f-e015340374b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:32.691520 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffcc2a-7c3e-443f-963f-e015340374b2 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:32.698417 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 358/716] 10.222.0.60 () {56 vars in 1124 bytes} [Fri May 6 23:20:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:32.732706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527c18e-246b-4ec5-9e77-3e96b669e768 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:32.802486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab0e90-5c13-419f-abc9-ec3e32b56bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:32.803327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab0e90-5c13-419f-abc9-ec3e32b56bb1 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:32.803608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab0e90-5c13-419f-abc9-ec3e32b56bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:32.803881 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab0e90-5c13-419f-abc9-ec3e32b56bb1 None admin] PATH_INFO: `/v3/services/network` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:32.804580 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab0e90-5c13-419f-abc9-ec3e32b56bb1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:32.806677 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab0e90-5c13-419f-abc9-ec3e32b56bb1 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:32.830779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-2bab0e90-5c13-419f-abc9-ec3e32b56bb1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 06 23:20:32.830779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:32.830779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:20:32.830779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:20:32.830779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:20:32.830779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:20:32.830779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:20:32.830779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:32.830779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 06 23:20:32.830779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:32.830779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:20:32.830779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:32.830779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:32.830779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:32.830779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:32.830779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:32.830779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:32.831838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:32.831838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:32.831838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:32.831838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:32.831838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:32.831838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:32.831838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:20:32.831838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:20:32.831838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:20:32.831838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:20:32.831838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:32.831838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:32.831838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:32.831838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:32.831838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:32.831838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:32.832706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:32.832706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:32.832706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:32.832706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:32.832706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:32.832706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:32.832706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:32.832706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:32.832706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:32.832706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:32.832706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:20:32.832706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:32.832706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 06 23:20:32.832706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:32.832706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 359/717] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:32 2022] GET /identity/v3/services/network => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:32.838521 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffcc2a-7c3e-443f-963f-e015340374b2 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:32.959488 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffcc2a-7c3e-443f-963f-e015340374b2 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:32.995326 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97a5cc-8138-4a7c-b1cc-83e21782720b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:32.996410 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97a5cc-8138-4a7c-b1cc-83e21782720b None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:32.996910 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97a5cc-8138-4a7c-b1cc-83e21782720b None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:32.997374 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97a5cc-8138-4a7c-b1cc-83e21782720b None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:32.998284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97a5cc-8138-4a7c-b1cc-83e21782720b None admin] RBAC: Adding query filter params (name=network) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:32.998780 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97a5cc-8138-4a7c-b1cc-83e21782720b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:33.000417 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97a5cc-8138-4a7c-b1cc-83e21782720b None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:33.005715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 359/718] 10.222.0.60 () {56 vars in 1112 bytes} [Fri May 6 23:20:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:33.011793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab0e90-5c13-419f-abc9-ec3e32b56bb1 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:33.156097 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab0e90-5c13-419f-abc9-ec3e32b56bb1 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:33.188624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57f67c-af4a-4fbb-ad21-8e0970922163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:33.189351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57f67c-af4a-4fbb-ad21-8e0970922163 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:33.189630 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57f67c-af4a-4fbb-ad21-8e0970922163 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:33.189953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57f67c-af4a-4fbb-ad21-8e0970922163 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:33.190666 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57f67c-af4a-4fbb-ad21-8e0970922163 None admin] RBAC: Adding query filter params (type=network) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:33.190968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57f67c-af4a-4fbb-ad21-8e0970922163 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:33.192434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57f67c-af4a-4fbb-ad21-8e0970922163 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:33.198765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 360/719] 10.222.0.60 () {56 vars in 1112 bytes} [Fri May 6 23:20:33 2022] GET /identity/v3/services?type=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:34.791858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d363e9-768f-46ed-a312-093827835edd None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:34.792415 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d363e9-768f-46ed-a312-093827835edd None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:34.792415 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d363e9-768f-46ed-a312-093827835edd None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:34.794086 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 360/720] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:34.806334 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dacca-4df9-4084-b1b7-f02c2b868b06 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:34.806827 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dacca-4df9-4084-b1b7-f02c2b868b06 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:34.807052 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dacca-4df9-4084-b1b7-f02c2b868b06 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:34.808691 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 361/721] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:34.813617 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef7945-1d91-430b-916b-774e95944ac7 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:34.813899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef7945-1d91-430b-916b-774e95944ac7 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:34.814171 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef7945-1d91-430b-916b-774e95944ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:34.815703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa399b-f4e8-4b51-9060-3f7926f7812c None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:34.815985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa399b-f4e8-4b51-9060-3f7926f7812c None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:34.816256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa399b-f4e8-4b51-9060-3f7926f7812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:34.836491 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-e5aa399b-f4e8-4b51-9060-3f7926f7812c None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:34.838196 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e5aa399b-f4e8-4b51-9060-3f7926f7812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:34.857727 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-f2ef7945-1d91-430b-916b-774e95944ac7 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:34.859329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-f2ef7945-1d91-430b-916b-774e95944ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:34.908627 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 361/722] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 06 23:20:34.934463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa399b-f4e8-4b51-9060-3f7926f7812c None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:35.003250 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 362/723] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:35.045764 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa399b-f4e8-4b51-9060-3f7926f7812c None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:35.048317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef7945-1d91-430b-916b-774e95944ac7 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:35.092985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e301b5-9737-4270-9e4d-96532082addd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:35.094526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e301b5-9737-4270-9e4d-96532082addd None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:35.094953 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e301b5-9737-4270-9e4d-96532082addd None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:35.095362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e301b5-9737-4270-9e4d-96532082addd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:35.113088 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e301b5-9737-4270-9e4d-96532082addd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:35.123054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-a6e301b5-9737-4270-9e4d-96532082addd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:20:35.123054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:35.123054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:35.123054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:35.123054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:35.123054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:35.123054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:35.123054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:35.123054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:35.123054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:35.123054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:35.123054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:35.123054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:35.123054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:35.123054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:35.123054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:35.124030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:35.124030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:35.124030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:35.124030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:35.124030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:35.124030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:35.124030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:35.124030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:35.124030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:35.124030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:35.124030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:35.124030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:35.124030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:35.124030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:35.124030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:35.124030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:35.124897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:35.124897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:35.124897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:35.124897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:35.124897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:35.124897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:35.124897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:35.124897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:35.124897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:35.124897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:35.124897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:20:35.124897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:35.130461 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 362/724] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:20:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:35.132323 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e301b5-9737-4270-9e4d-96532082addd None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:35.243969 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e301b5-9737-4270-9e4d-96532082addd None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:35.285990 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b103f4-1b9b-46bf-80d8-40e637cb2499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:35.286665 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b103f4-1b9b-46bf-80d8-40e637cb2499 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:35.287219 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b103f4-1b9b-46bf-80d8-40e637cb2499 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:35.287491 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b103f4-1b9b-46bf-80d8-40e637cb2499 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:35.288555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b103f4-1b9b-46bf-80d8-40e637cb2499 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:35.289254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b103f4-1b9b-46bf-80d8-40e637cb2499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:35.291618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b103f4-1b9b-46bf-80d8-40e637cb2499 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:35.302149 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 363/725] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:20:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:35.307625 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b103f4-1b9b-46bf-80d8-40e637cb2499 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:35.308509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef7945-1d91-430b-916b-774e95944ac7 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:35.364494 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982ec7d-c001-4b36-b887-1d2aa77a61dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:35.365341 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982ec7d-c001-4b36-b887-1d2aa77a61dc None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:35.365906 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982ec7d-c001-4b36-b887-1d2aa77a61dc None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:35.366182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982ec7d-c001-4b36-b887-1d2aa77a61dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:35.381446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982ec7d-c001-4b36-b887-1d2aa77a61dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:35.392180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-4982ec7d-c001-4b36-b887-1d2aa77a61dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:35.392180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:35.392180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:35.392180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:35.392180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:35.392180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:35.392180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:35.392180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:35.392180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:35.392180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:35.392180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:35.392180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:35.392180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:35.392180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:35.392180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:35.392180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:35.393244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:35.393244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:35.393244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:35.393244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:35.393244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:35.393244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:35.393244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:35.393244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:35.393244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:35.393244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:35.393244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:35.393244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:35.393244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:35.393244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:35.393244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:35.393244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:35.394819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:35.394819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:35.394819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:35.394819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:35.394819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:35.394819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:35.394819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:35.394819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:35.394819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:35.394819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:35.394819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:35.394819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:35.394819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 363/726] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:35.400567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d64fb1-1646-42ce-aeda-24565d37e4bb None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:35.400567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d64fb1-1646-42ce-aeda-24565d37e4bb None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:35.400567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d64fb1-1646-42ce-aeda-24565d37e4bb None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:35.400567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 364/727] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:35.401490 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d64fb1-1646-42ce-aeda-24565d37e4bb None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:35.426624 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b103f4-1b9b-46bf-80d8-40e637cb2499 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:35.463081 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbbc31-b259-4bed-9abc-73cce0d5a007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:35.463880 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbbc31-b259-4bed-9abc-73cce0d5a007 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:35.464649 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbbc31-b259-4bed-9abc-73cce0d5a007 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:35.464925 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbbc31-b259-4bed-9abc-73cce0d5a007 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:35.479630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dbbc31-b259-4bed-9abc-73cce0d5a007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:35.481621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dbbc31-b259-4bed-9abc-73cce0d5a007 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:35.503169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-c6dbbc31-b259-4bed-9abc-73cce0d5a007 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:35.503169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:35.503169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:35.503169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:35.503169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:35.503169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:35.503169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:35.503169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:35.503169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:35.503169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:35.503169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:35.503169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:35.503169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:35.503169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:35.503169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:35.505124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:35.505124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:35.505124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:35.505124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:35.505124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:35.505124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:35.505124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:35.505124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:35.505124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:35.505124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:35.505124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:35.505124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:35.505124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:35.505124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:35.505124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:35.505124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:35.505124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:35.506694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:35.506694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:35.506694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:35.506694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:35.506694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 364/728] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:35.506694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addc2a5-c5f6-4b67-b1a6-7545eafadf4d None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:35.506694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addc2a5-c5f6-4b67-b1a6-7545eafadf4d None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:35.507361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addc2a5-c5f6-4b67-b1a6-7545eafadf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:35.526120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d64fb1-1646-42ce-aeda-24565d37e4bb None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:35.531394 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-5addc2a5-c5f6-4b67-b1a6-7545eafadf4d None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:35.532670 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-5addc2a5-c5f6-4b67-b1a6-7545eafadf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:35.569254 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2320be-3f51-434b-9ea3-4bc77a7fd0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:35.569989 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2320be-3f51-434b-9ea3-4bc77a7fd0cc None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:35.570586 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2320be-3f51-434b-9ea3-4bc77a7fd0cc None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:35.570864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2320be-3f51-434b-9ea3-4bc77a7fd0cc None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:35.572464 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2320be-3f51-434b-9ea3-4bc77a7fd0cc None admin] RBAC: Adding query filter params (name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:35.572798 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2320be-3f51-434b-9ea3-4bc77a7fd0cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:35.574173 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2320be-3f51-434b-9ea3-4bc77a7fd0cc None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:35.582812 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 365/729] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:20:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:35.584131 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2320be-3f51-434b-9ea3-4bc77a7fd0cc None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:35.608192 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 365/730] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:35.609904 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3c5f0-8b0f-489e-ac4e-3b80de464376 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:35.610199 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3c5f0-8b0f-489e-ac4e-3b80de464376 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:35.610477 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3c5f0-8b0f-489e-ac4e-3b80de464376 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:35.611882 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 366/731] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:35.616465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3c5f0-8b0f-489e-ac4e-3b80de464376 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:35.688687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2320be-3f51-434b-9ea3-4bc77a7fd0cc None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:35.721095 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abfb17-cdca-49d1-a591-2cb9a99ee972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:35.721759 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abfb17-cdca-49d1-a591-2cb9a99ee972 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:35.722034 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abfb17-cdca-49d1-a591-2cb9a99ee972 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:35.722305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abfb17-cdca-49d1-a591-2cb9a99ee972 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:35.723076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abfb17-cdca-49d1-a591-2cb9a99ee972 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:35.723381 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abfb17-cdca-49d1-a591-2cb9a99ee972 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:35.724793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abfb17-cdca-49d1-a591-2cb9a99ee972 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:35.725372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3c5f0-8b0f-489e-ac4e-3b80de464376 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:35.736596 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 366/732] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:35.738162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ce131-769c-4862-83c1-b6755939b6c1 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:35.738520 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ce131-769c-4862-83c1-b6755939b6c1 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:35.738872 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ce131-769c-4862-83c1-b6755939b6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:35.755244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-d13ce131-769c-4862-83c1-b6755939b6c1 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:35.756420 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d13ce131-769c-4862-83c1-b6755939b6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:35.762350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07dccb-6230-4a0c-bea8-c17f4454c3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:35.763140 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07dccb-6230-4a0c-bea8-c17f4454c3bf None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:35.763418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07dccb-6230-4a0c-bea8-c17f4454c3bf None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:35.763709 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07dccb-6230-4a0c-bea8-c17f4454c3bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:35.773359 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07dccb-6230-4a0c-bea8-c17f4454c3bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:35.775348 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07dccb-6230-4a0c-bea8-c17f4454c3bf None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:35.792098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-2f07dccb-6230-4a0c-bea8-c17f4454c3bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:35.792098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:35.792098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:35.792098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:35.792098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:35.792098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:35.792098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:35.792098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:35.792098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:35.792098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:35.792098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:35.792098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:35.792098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:35.792098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:35.792098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:35.793460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:35.793460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:35.793460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:35.793460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:35.793460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:35.793460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:35.793460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:35.793460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:35.793460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:35.793460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:35.793460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:35.793460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:35.793460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:35.793460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:35.793460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:35.793460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:35.793460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:35.794322 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:35.794322 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:35.794322 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:35.794322 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:35.794322 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 367/733] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:35.794589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07dccb-6230-4a0c-bea8-c17f4454c3bf None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:35.834221 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 367/734] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:35.835705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ce131-769c-4862-83c1-b6755939b6c1 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:35.900802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07dccb-6230-4a0c-bea8-c17f4454c3bf None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:35.946122 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ce131-769c-4862-83c1-b6755939b6c1 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:35.982572 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef991a-1b21-49f4-a63f-c08e433ca768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:35.983381 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef991a-1b21-49f4-a63f-c08e433ca768 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:35.983658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef991a-1b21-49f4-a63f-c08e433ca768 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:35.983924 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef991a-1b21-49f4-a63f-c08e433ca768 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:35.991961 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef991a-1b21-49f4-a63f-c08e433ca768 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:35.993503 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef991a-1b21-49f4-a63f-c08e433ca768 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:36.009483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-15ef991a-1b21-49f4-a63f-c08e433ca768 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 06 23:20:36.009483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:36.009483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:36.009483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:36.009483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:36.009483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:36.009483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:36.009483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:36.009483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:36.009483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:36.009483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:36.009483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:36.009483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:36.009483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:36.009483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:36.009483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:36.010488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:36.010488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:36.010488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:36.010488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:36.010488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:36.010488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:36.010488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:36.010488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:36.010488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:36.010488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:36.010488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:36.010488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:36.010488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:36.010488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:36.010488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:36.010488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:36.010488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:36.010488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:36.011455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:36.011455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:36.011455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:36.011455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:36.011455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:36.011455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:36.011455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:36.011455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:36.011455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 06 23:20:36.011455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:36.014322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 368/735] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:20:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:36.014322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef991a-1b21-49f4-a63f-c08e433ca768 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:36.057776 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f94fc6-ff0f-4f98-973d-42788f14fe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:36.058580 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f94fc6-ff0f-4f98-973d-42788f14fe8e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:36.058847 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f94fc6-ff0f-4f98-973d-42788f14fe8e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:36.059124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f94fc6-ff0f-4f98-973d-42788f14fe8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:36.070818 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f94fc6-ff0f-4f98-973d-42788f14fe8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:36.078812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-38f94fc6-ff0f-4f98-973d-42788f14fe8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:20:36.078812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:36.078812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:36.078812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:36.078812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:36.078812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:36.078812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:36.078812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:36.078812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:36.078812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:36.078812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:36.078812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:36.078812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:36.078812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:36.078812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:36.078812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:36.079987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:36.079987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:36.079987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:36.079987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:36.079987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:36.079987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:36.079987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:36.079987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:36.079987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:36.079987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:36.079987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:36.079987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:36.079987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:36.079987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:36.079987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:36.079987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:36.081059 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:36.081059 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:36.081059 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:36.081059 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:36.081059 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:36.081059 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:36.081059 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:36.081059 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:36.081059 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:36.081059 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:36.081059 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:20:36.081059 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:36.084851 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 368/736] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:20:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:36.085619 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f94fc6-ff0f-4f98-973d-42788f14fe8e None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:36.118854 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef991a-1b21-49f4-a63f-c08e433ca768 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:36.150602 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d7289-1707-4997-b54e-e005311cd877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:36.151250 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d7289-1707-4997-b54e-e005311cd877 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:36.151529 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d7289-1707-4997-b54e-e005311cd877 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:36.151800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d7289-1707-4997-b54e-e005311cd877 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:36.152510 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d7289-1707-4997-b54e-e005311cd877 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:36.152840 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d7289-1707-4997-b54e-e005311cd877 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:36.154197 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d7289-1707-4997-b54e-e005311cd877 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:36.170000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 369/737] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:36.170000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d7289-1707-4997-b54e-e005311cd877 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:36.181953 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f94fc6-ff0f-4f98-973d-42788f14fe8e None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:36.213017 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a7a85-f2f7-43db-8146-7bbcca09a600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:36.213669 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a7a85-f2f7-43db-8146-7bbcca09a600 None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:36.214212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a7a85-f2f7-43db-8146-7bbcca09a600 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:36.214487 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a7a85-f2f7-43db-8146-7bbcca09a600 None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:36.215202 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a7a85-f2f7-43db-8146-7bbcca09a600 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:36.216606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a7a85-f2f7-43db-8146-7bbcca09a600 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:36.230952 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 369/738] 10.222.0.60 () {60 vars in 1141 bytes} [Fri May 6 23:20:36 2022] POST /identity/v3/services => generated 251 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:20:36.231757 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a7a85-f2f7-43db-8146-7bbcca09a600 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:36.263764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d7289-1707-4997-b54e-e005311cd877 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:36.311717 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e164083-3a5d-4028-a09a-791ccedd036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:36.312401 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e164083-3a5d-4028-a09a-791ccedd036d None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:36.312720 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e164083-3a5d-4028-a09a-791ccedd036d None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:36.312993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e164083-3a5d-4028-a09a-791ccedd036d None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:36.313847 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e164083-3a5d-4028-a09a-791ccedd036d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:36.314156 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e164083-3a5d-4028-a09a-791ccedd036d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:36.315613 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e164083-3a5d-4028-a09a-791ccedd036d None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:36.335481 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 370/739] 10.222.0.60 () {56 vars in 1135 bytes} [Fri May 6 23:20:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:36.337705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a27f9b-9ea7-4f5b-bed7-d3932817e0f7 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:36.337988 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a27f9b-9ea7-4f5b-bed7-d3932817e0f7 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:36.338260 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a27f9b-9ea7-4f5b-bed7-d3932817e0f7 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:36.339992 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 371/740] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:36.344885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a27f9b-9ea7-4f5b-bed7-d3932817e0f7 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:36.349381 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a7a85-f2f7-43db-8146-7bbcca09a600 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:36.387618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c3483-c5fd-45b0-ae79-52d15968d475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:36.388298 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c3483-c5fd-45b0-ae79-52d15968d475 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:36.388602 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c3483-c5fd-45b0-ae79-52d15968d475 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:36.388874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c3483-c5fd-45b0-ae79-52d15968d475 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:36.389624 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c3483-c5fd-45b0-ae79-52d15968d475 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:36.389932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c3483-c5fd-45b0-ae79-52d15968d475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:36.391326 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c3483-c5fd-45b0-ae79-52d15968d475 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:36.401629 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 370/741] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:20:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:36.402465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c3483-c5fd-45b0-ae79-52d15968d475 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:36.462221 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a27f9b-9ea7-4f5b-bed7-d3932817e0f7 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:36.496224 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75c3f7-8d70-4a62-b182-6535ad2f4b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:36.497067 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75c3f7-8d70-4a62-b182-6535ad2f4b70 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:36.497357 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75c3f7-8d70-4a62-b182-6535ad2f4b70 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:36.497631 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75c3f7-8d70-4a62-b182-6535ad2f4b70 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:36.505821 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75c3f7-8d70-4a62-b182-6535ad2f4b70 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:36.507270 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75c3f7-8d70-4a62-b182-6535ad2f4b70 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:36.512280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c3483-c5fd-45b0-ae79-52d15968d475 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:36.523699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-2d75c3f7-8d70-4a62-b182-6535ad2f4b70 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 06 23:20:36.523699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:36.523699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:36.523699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:36.523699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:36.523699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:36.523699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:36.523699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:36.523699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:36.523699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:36.523699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:36.523699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:36.523699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:36.523699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:36.523699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:36.523699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:36.524747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:36.524747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:36.524747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:36.524747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:36.524747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:36.524747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:36.524747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:36.524747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:36.524747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:36.524747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:36.524747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:36.524747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:36.524747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:36.524747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:36.524747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:36.524747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:36.524747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:36.524747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:36.525741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:36.525741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:36.525741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:36.525741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:36.525741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:36.525741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:36.525741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:36.525741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:36.525741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 06 23:20:36.525741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:36.525741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 372/742] 10.222.0.60 () {56 vars in 1117 bytes} [Fri May 6 23:20:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:36.526852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b1505-4e55-4117-b132-f5a0f933de05 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:36.526852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b1505-4e55-4117-b132-f5a0f933de05 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:36.526852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b1505-4e55-4117-b132-f5a0f933de05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:36.543237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-902b1505-4e55-4117-b132-f5a0f933de05 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:36.544415 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-902b1505-4e55-4117-b132-f5a0f933de05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:36.549957 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84397a4f-b01c-4047-a39e-97db94ebf57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:36.550600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84397a4f-b01c-4047-a39e-97db94ebf57b None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:36.550878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84397a4f-b01c-4047-a39e-97db94ebf57b None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:36.551176 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84397a4f-b01c-4047-a39e-97db94ebf57b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:36.612693 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 373/743] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:36 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 06 23:20:36.614436 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b1505-4e55-4117-b132-f5a0f933de05 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:36.616366 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84397a4f-b01c-4047-a39e-97db94ebf57b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:36.618737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84397a4f-b01c-4047-a39e-97db94ebf57b None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:36.714194 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b1505-4e55-4117-b132-f5a0f933de05 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:36.718983 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 371/744] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:36 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 06 23:20:36.718983 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84397a4f-b01c-4047-a39e-97db94ebf57b None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:36.748379 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c92bc-1986-4d7c-be49-4482d682a3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:36.749205 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c92bc-1986-4d7c-be49-4482d682a3d4 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:36.749483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c92bc-1986-4d7c-be49-4482d682a3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:36.749760 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c92bc-1986-4d7c-be49-4482d682a3d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:36.760449 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c92bc-1986-4d7c-be49-4482d682a3d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:36.761977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c92bc-1986-4d7c-be49-4482d682a3d4 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:36.790403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-1e3c92bc-1986-4d7c-be49-4482d682a3d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:36.790403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:36.790403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:36.790403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:36.790403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:36.790403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:36.790403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:36.790403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:36.790403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:36.790403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:36.790403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:36.790403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:36.790403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:36.790403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:36.790403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:36.791633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:36.791633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:36.791633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:36.791633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:36.791633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:36.791633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:36.791633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:36.791633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:36.791633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:36.791633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:36.791633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:36.791633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:36.791633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:36.791633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:36.791633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:36.791633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:36.791633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:36.792735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:36.792735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:36.792735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:36.792735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:36.796221 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 374/745] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:36.796940 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c92bc-1986-4d7c-be49-4482d682a3d4 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:36.819317 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84397a4f-b01c-4047-a39e-97db94ebf57b None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:36.857722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8edeb-8f91-47d5-9f03-584a428e6a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:36.858389 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8edeb-8f91-47d5-9f03-584a428e6a19 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:36.858665 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8edeb-8f91-47d5-9f03-584a428e6a19 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:36.858933 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8edeb-8f91-47d5-9f03-584a428e6a19 None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:36.859776 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8edeb-8f91-47d5-9f03-584a428e6a19 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:36.860078 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8edeb-8f91-47d5-9f03-584a428e6a19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:36.861524 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8edeb-8f91-47d5-9f03-584a428e6a19 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:36.878149 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 372/746] 10.222.0.60 () {56 vars in 1149 bytes} [Fri May 6 23:20:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:36.878905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8edeb-8f91-47d5-9f03-584a428e6a19 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:36.904364 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c92bc-1986-4d7c-be49-4482d682a3d4 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:36.937254 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3e1b6-fd10-428f-bd66-a5f96cfa8c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:36.937912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3e1b6-fd10-428f-bd66-a5f96cfa8c83 None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:36.938194 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3e1b6-fd10-428f-bd66-a5f96cfa8c83 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:36.938467 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3e1b6-fd10-428f-bd66-a5f96cfa8c83 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:36.939185 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3e1b6-fd10-428f-bd66-a5f96cfa8c83 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:36.940561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3e1b6-fd10-428f-bd66-a5f96cfa8c83 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:36.954396 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 375/747] 10.222.0.60 () {60 vars in 1141 bytes} [Fri May 6 23:20:36 2022] POST /identity/v3/services => generated 240 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:20:36.955502 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3e1b6-fd10-428f-bd66-a5f96cfa8c83 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:36.988954 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8edeb-8f91-47d5-9f03-584a428e6a19 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:37.031485 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda47857-94ff-4143-bfd2-372f2ea07ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:37.032680 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda47857-94ff-4143-bfd2-372f2ea07ce6 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:37.033169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda47857-94ff-4143-bfd2-372f2ea07ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:37.033636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda47857-94ff-4143-bfd2-372f2ea07ce6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:37.046521 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda47857-94ff-4143-bfd2-372f2ea07ce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:37.048432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda47857-94ff-4143-bfd2-372f2ea07ce6 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:37.067357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-cda47857-94ff-4143-bfd2-372f2ea07ce6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:37.067357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:37.067357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:37.067357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:37.067357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:37.067357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:37.067357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:37.067357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:37.067357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:37.067357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:37.067357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:37.067357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:37.067357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:37.067357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:37.067357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:37.068327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:37.068327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:37.068327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:37.068327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:37.068327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:37.068327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:37.068327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:37.068327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:37.068327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:37.068327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:37.068327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:37.068327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:37.068327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:37.068327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:37.068327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:37.068327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:37.068327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:37.069295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:37.069295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:37.069295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:37.069295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:37.071860 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 373/748] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:37.073017 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda47857-94ff-4143-bfd2-372f2ea07ce6 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:37.080258 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3e1b6-fd10-428f-bd66-a5f96cfa8c83 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:37.116827 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f79d92-f1d7-4836-a92f-ac3585051ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:37.117622 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f79d92-f1d7-4836-a92f-ac3585051ee2 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:37.117976 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f79d92-f1d7-4836-a92f-ac3585051ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:37.118855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f79d92-f1d7-4836-a92f-ac3585051ee2 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:37.119670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f79d92-f1d7-4836-a92f-ac3585051ee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:37.120051 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f79d92-f1d7-4836-a92f-ac3585051ee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:37.121587 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f79d92-f1d7-4836-a92f-ac3585051ee2 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:37.139217 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 376/749] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:37.140212 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f79d92-f1d7-4836-a92f-ac3585051ee2 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:37.183814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda47857-94ff-4143-bfd2-372f2ea07ce6 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:37.225417 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f051c-d68d-4d52-a68c-82dd5ddfebb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:37.226074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f051c-d68d-4d52-a68c-82dd5ddfebb5 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:37.226359 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f051c-d68d-4d52-a68c-82dd5ddfebb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:37.226653 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f051c-d68d-4d52-a68c-82dd5ddfebb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:37.244500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f79d92-f1d7-4836-a92f-ac3585051ee2 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:37.281912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64195c7a-0203-4114-b3f2-7c1e81ed69b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:37.282641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64195c7a-0203-4114-b3f2-7c1e81ed69b8 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:37.282925 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64195c7a-0203-4114-b3f2-7c1e81ed69b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:37.283225 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64195c7a-0203-4114-b3f2-7c1e81ed69b8 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:37.284417 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64195c7a-0203-4114-b3f2-7c1e81ed69b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:37.284762 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64195c7a-0203-4114-b3f2-7c1e81ed69b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:37.286143 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64195c7a-0203-4114-b3f2-7c1e81ed69b8 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:37.306051 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 377/750] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:37.306051 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64195c7a-0203-4114-b3f2-7c1e81ed69b8 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:37.306307 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f051c-d68d-4d52-a68c-82dd5ddfebb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:37.308254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f051c-d68d-4d52-a68c-82dd5ddfebb5 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:37.408484 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64195c7a-0203-4114-b3f2-7c1e81ed69b8 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:37.413852 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 374/751] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 06 23:20:37.414768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f051c-d68d-4d52-a68c-82dd5ddfebb5 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:37.443839 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934ced3-d476-4194-8c48-646d31cf6fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:37.445021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934ced3-d476-4194-8c48-646d31cf6fb7 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:37.445506 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934ced3-d476-4194-8c48-646d31cf6fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:37.445979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934ced3-d476-4194-8c48-646d31cf6fb7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:37.454552 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934ced3-d476-4194-8c48-646d31cf6fb7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:37.456275 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934ced3-d476-4194-8c48-646d31cf6fb7 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:37.470928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-5934ced3-d476-4194-8c48-646d31cf6fb7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 06 23:20:37.470928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:37.470928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:37.470928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:37.470928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:37.470928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:37.470928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:37.470928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:37.470928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:37.470928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:37.470928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:37.470928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:37.470928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:37.470928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:37.470928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:37.470928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:37.471878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:37.471878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:37.471878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:37.471878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:37.471878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:37.471878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:37.471878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:37.471878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:37.471878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:37.471878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:37.471878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:37.471878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:37.471878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:37.471878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:37.471878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:37.471878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:37.471878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:37.471878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:37.472853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:37.472853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:37.472853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:37.472853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:37.472853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:37.472853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:37.472853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:37.472853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:37.472853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 06 23:20:37.472853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:37.475476 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 378/752] 10.222.0.60 () {56 vars in 1093 bytes} [Fri May 6 23:20:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:37.476554 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934ced3-d476-4194-8c48-646d31cf6fb7 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:37.527323 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f051c-d68d-4d52-a68c-82dd5ddfebb5 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:37.572244 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d0bd0-275f-4913-8119-ed5267fd3adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:37.573565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d0bd0-275f-4913-8119-ed5267fd3adc None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:37.574281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d0bd0-275f-4913-8119-ed5267fd3adc None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:37.574993 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d0bd0-275f-4913-8119-ed5267fd3adc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:37.579606 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934ced3-d476-4194-8c48-646d31cf6fb7 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:37.583855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d0bd0-275f-4913-8119-ed5267fd3adc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:37.585478 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d0bd0-275f-4913-8119-ed5267fd3adc None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:37.603960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-b88d0bd0-275f-4913-8119-ed5267fd3adc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:37.603960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:37.603960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:37.603960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:37.603960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:37.603960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:37.603960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:37.603960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:37.603960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:37.603960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:37.603960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:37.603960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:37.603960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:37.603960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:37.603960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:37.605100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:37.605100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:37.605100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:37.605100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:37.605100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:37.605100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:37.605100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:37.605100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:37.605100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:37.605100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:37.605100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:37.605100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:37.605100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:37.605100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:37.605100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:37.605100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:37.605100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:37.606199 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:37.606199 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:37.606199 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:37.606199 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:37.606199 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:37.606199 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:37.606199 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:37.606199 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:37.613281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 375/753] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:37.613425 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d0bd0-275f-4913-8119-ed5267fd3adc None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:37.621708 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6de2a-0266-470e-906b-973826624361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:37.622629 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6de2a-0266-470e-906b-973826624361 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:37.622919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6de2a-0266-470e-906b-973826624361 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:37.623198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6de2a-0266-470e-906b-973826624361 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:37.634451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6de2a-0266-470e-906b-973826624361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:37.635910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6de2a-0266-470e-906b-973826624361 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:37.653092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-b8d6de2a-0266-470e-906b-973826624361 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:37.653092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:37.653092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:37.653092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:37.653092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:37.653092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:37.653092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:37.653092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:37.653092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:37.653092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:37.653092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:37.653092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:37.653092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:37.653092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:37.653092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:37.653993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:37.653993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:37.653993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:37.653993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:37.653993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:37.653993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:37.653993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:37.653993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:37.653993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:37.653993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:37.653993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:37.653993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:37.653993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:37.653993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:37.653993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:37.653993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:37.653993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:37.654879 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:37.654879 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:37.654879 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:37.654879 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:37.659372 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 379/754] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:37.660172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6de2a-0266-470e-906b-973826624361 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:37.734049 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d0bd0-275f-4913-8119-ed5267fd3adc None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:37.766354 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f9c22-07c6-4264-8c71-33ad63690a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:37.767022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f9c22-07c6-4264-8c71-33ad63690a47 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:37.767305 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f9c22-07c6-4264-8c71-33ad63690a47 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:37.767580 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f9c22-07c6-4264-8c71-33ad63690a47 None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:37.768414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f9c22-07c6-4264-8c71-33ad63690a47 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:37.768750 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f9c22-07c6-4264-8c71-33ad63690a47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:37.770256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f9c22-07c6-4264-8c71-33ad63690a47 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:37.775667 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6de2a-0266-470e-906b-973826624361 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:37.787972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 376/755] 10.222.0.60 () {56 vars in 1133 bytes} [Fri May 6 23:20:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:37.792865 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f9c22-07c6-4264-8c71-33ad63690a47 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:37.814693 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc39393-c162-47f7-9db0-552a07fc4237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:37.815713 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc39393-c162-47f7-9db0-552a07fc4237 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:37.816219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc39393-c162-47f7-9db0-552a07fc4237 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:37.816768 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc39393-c162-47f7-9db0-552a07fc4237 None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:37.817797 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc39393-c162-47f7-9db0-552a07fc4237 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:37.818323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc39393-c162-47f7-9db0-552a07fc4237 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:37.819977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc39393-c162-47f7-9db0-552a07fc4237 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:37.849164 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 380/756] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:37.850306 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc39393-c162-47f7-9db0-552a07fc4237 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:37.898414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f9c22-07c6-4264-8c71-33ad63690a47 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:37.939570 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b594fc-f02f-48f0-8a56-e0c40ddd9858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:37.940182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b594fc-f02f-48f0-8a56-e0c40ddd9858 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:37.940465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b594fc-f02f-48f0-8a56-e0c40ddd9858 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:37.940786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b594fc-f02f-48f0-8a56-e0c40ddd9858 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:37.941509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b594fc-f02f-48f0-8a56-e0c40ddd9858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:37.941816 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b594fc-f02f-48f0-8a56-e0c40ddd9858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:37.943182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b594fc-f02f-48f0-8a56-e0c40ddd9858 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:37.954378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc39393-c162-47f7-9db0-552a07fc4237 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:37.958966 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 377/757] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:37.959857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b594fc-f02f-48f0-8a56-e0c40ddd9858 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:37.991418 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb778ed-b063-46ed-a335-124f1b182824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:37.992615 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb778ed-b063-46ed-a335-124f1b182824 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:37.993176 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb778ed-b063-46ed-a335-124f1b182824 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:37.993664 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb778ed-b063-46ed-a335-124f1b182824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:38.004057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb778ed-b063-46ed-a335-124f1b182824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:38.005826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb778ed-b063-46ed-a335-124f1b182824 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:38.025179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-2fb778ed-b063-46ed-a335-124f1b182824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:38.025179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:38.025179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:38.025179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:38.025179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:38.025179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:38.025179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:38.025179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:38.025179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:38.025179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:38.025179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:38.025179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:38.025179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:38.025179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:38.025179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:38.026091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:38.026091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:38.026091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:38.026091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:38.026091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:38.026091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:38.026091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:38.026091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:38.026091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:38.026091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:38.026091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:38.026091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:38.026091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:38.026091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:38.026091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:38.026091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:38.026091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:38.026982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:38.026982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:38.026982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:38.026982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:38.033397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 381/758] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:38.034502 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb778ed-b063-46ed-a335-124f1b182824 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:38.060211 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b594fc-f02f-48f0-8a56-e0c40ddd9858 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:38.094830 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5985979-c1eb-47e7-9614-7beda73b0679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:38.095260 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5985979-c1eb-47e7-9614-7beda73b0679 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:38.095542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5985979-c1eb-47e7-9614-7beda73b0679 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:38.095815 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5985979-c1eb-47e7-9614-7beda73b0679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:38.096676 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5985979-c1eb-47e7-9614-7beda73b0679 None admin] RBAC: Adding query filter params (role.id=408ee9a3a38640a48dbcdb2c377efcd8, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=48b3ec57aee94b87889d578e114fa0db) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:38.096981 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5985979-c1eb-47e7-9614-7beda73b0679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:38.098411 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5985979-c1eb-47e7-9614-7beda73b0679 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:38.109371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 378/759] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:20:37 2022] GET /identity/v3/role_assignments?user.id=48b3ec57aee94b87889d578e114fa0db&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=408ee9a3a38640a48dbcdb2c377efcd8 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:38.109371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5985979-c1eb-47e7-9614-7beda73b0679 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:38.214965 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb778ed-b063-46ed-a335-124f1b182824 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:38.230414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5985979-c1eb-47e7-9614-7beda73b0679 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:38.266800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6811c-ffd7-4cc3-b6c5-e0170598353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:38.267474 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6811c-ffd7-4cc3-b6c5-e0170598353e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:38.267761 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6811c-ffd7-4cc3-b6c5-e0170598353e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:38.268035 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6811c-ffd7-4cc3-b6c5-e0170598353e None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:38.268798 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6811c-ffd7-4cc3-b6c5-e0170598353e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:38.269103 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6811c-ffd7-4cc3-b6c5-e0170598353e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:38.270507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6811c-ffd7-4cc3-b6c5-e0170598353e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:38.284096 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 379/760] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:38.289494 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6811c-ffd7-4cc3-b6c5-e0170598353e None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:38.306219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d5677-ce74-4986-8ff5-ca40a31b1c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:38.307042 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d5677-ce74-4986-8ff5-ca40a31b1c11 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:38.307327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d5677-ce74-4986-8ff5-ca40a31b1c11 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:38.307599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d5677-ce74-4986-8ff5-ca40a31b1c11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:38.329531 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d5677-ce74-4986-8ff5-ca40a31b1c11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:38.331052 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d5677-ce74-4986-8ff5-ca40a31b1c11 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:38.357674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-dd0d5677-ce74-4986-8ff5-ca40a31b1c11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:38.357674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:38.357674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:38.357674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:38.357674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:38.357674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:38.357674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:38.357674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:38.357674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:38.357674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:38.357674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:38.357674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:38.357674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:38.357674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:38.357674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:38.358855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:38.358855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:38.358855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:38.358855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:38.358855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:38.358855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:38.358855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:38.358855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:38.358855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:38.358855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:38.358855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:38.358855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:38.358855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:38.358855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:38.358855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:38.358855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:38.358855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:38.359765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:38.359765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:38.359765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:38.359765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:38.359765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:38.359765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:38.359765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:38.359765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:38.364721 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 382/761] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:38.374383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d5677-ce74-4986-8ff5-ca40a31b1c11 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:38.447625 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6811c-ffd7-4cc3-b6c5-e0170598353e None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:38.511444 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ff71c-2178-47d3-af14-07d1e35380ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:38.512145 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ff71c-2178-47d3-af14-07d1e35380ea None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:38.512420 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ff71c-2178-47d3-af14-07d1e35380ea None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:38.512727 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ff71c-2178-47d3-af14-07d1e35380ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:38.519370 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ff71c-2178-47d3-af14-07d1e35380ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:38.520856 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ff71c-2178-47d3-af14-07d1e35380ea None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:38.530355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d5677-ce74-4986-8ff5-ca40a31b1c11 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:38.534664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-4c9ff71c-2178-47d3-af14-07d1e35380ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:38.534664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:38.534664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:38.534664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:38.534664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:38.534664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:38.534664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:38.534664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:38.534664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:38.534664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:38.534664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:38.534664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:38.534664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:38.534664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:38.534664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:38.535557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:38.535557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:38.535557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:38.535557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:38.535557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:38.535557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:38.535557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:38.535557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:38.535557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:38.535557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:38.535557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:38.535557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:38.535557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:38.535557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:38.535557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:38.535557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:38.535557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:38.536847 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:38.536847 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:38.536847 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:38.536847 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:38.536847 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:38.536847 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:38.536847 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:38.536847 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:38.536847 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 380/762] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:38.537529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687081e6-cdfa-4a3f-805b-8c85f1c5a88e None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:38.537683 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687081e6-cdfa-4a3f-805b-8c85f1c5a88e None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:38.538763 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687081e6-cdfa-4a3f-805b-8c85f1c5a88e None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:38.543393 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 381/763] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:38.544176 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687081e6-cdfa-4a3f-805b-8c85f1c5a88e None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:38.565142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c609ed-03b4-4e5d-8122-bda31b4cfbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:38.565810 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c609ed-03b4-4e5d-8122-bda31b4cfbe3 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:38.566149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c609ed-03b4-4e5d-8122-bda31b4cfbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:38.566430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c609ed-03b4-4e5d-8122-bda31b4cfbe3 None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:38.567273 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c609ed-03b4-4e5d-8122-bda31b4cfbe3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:38.567584 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c609ed-03b4-4e5d-8122-bda31b4cfbe3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:38.569159 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c609ed-03b4-4e5d-8122-bda31b4cfbe3 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:38.582162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 383/764] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:38.583497 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab825aa7-1825-4c4b-8528-a168a57404a3 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:38.583842 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab825aa7-1825-4c4b-8528-a168a57404a3 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:38.584123 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab825aa7-1825-4c4b-8528-a168a57404a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:38.601757 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-ab825aa7-1825-4c4b-8528-a168a57404a3 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:38.603011 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-ab825aa7-1825-4c4b-8528-a168a57404a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:38.647825 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687081e6-cdfa-4a3f-805b-8c85f1c5a88e None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:38.671979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 384/765] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:20:38.673150 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab825aa7-1825-4c4b-8528-a168a57404a3 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:38.683049 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6796689-79ce-4a30-a239-580e375c6b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:38.683761 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6796689-79ce-4a30-a239-580e375c6b16 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:38.684098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6796689-79ce-4a30-a239-580e375c6b16 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:38.684422 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6796689-79ce-4a30-a239-580e375c6b16 None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:38.685289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6796689-79ce-4a30-a239-580e375c6b16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:38.685603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6796689-79ce-4a30-a239-580e375c6b16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:38.687155 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6796689-79ce-4a30-a239-580e375c6b16 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:38.704730 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 382/766] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:38.705969 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6796689-79ce-4a30-a239-580e375c6b16 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:38.795006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab825aa7-1825-4c4b-8528-a168a57404a3 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:38.804730 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6796689-79ce-4a30-a239-580e375c6b16 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:38.848960 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6856fd-fc8d-4f95-b232-1074f7af43c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:38.849218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5066293-e183-4d3f-908d-47253005a164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:38.850084 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6856fd-fc8d-4f95-b232-1074f7af43c1 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:38.850212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5066293-e183-4d3f-908d-47253005a164 None admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:38.850373 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5066293-e183-4d3f-908d-47253005a164 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:38.850646 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5066293-e183-4d3f-908d-47253005a164 None admin] PATH_INFO: `/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/9b74631c6e1547d991753a65c41bc7e7/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:38.851064 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6856fd-fc8d-4f95-b232-1074f7af43c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:38.851526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6856fd-fc8d-4f95-b232-1074f7af43c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:38.852679 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6856fd-fc8d-4f95-b232-1074f7af43c1 None admin] RBAC: Adding query filter params (role.id=71050e310414462b8d07f901fef201ad, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=d211582f9fc34b0e815e27db081c50c9) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:38.852784 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5066293-e183-4d3f-908d-47253005a164 None admin] RBAC: Authorizing `identity:create_grant(project_id=4389eb256aba4b7182e33cb3720b1073, user_id=9b74631c6e1547d991753a65c41bc7e7, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:38.853285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6856fd-fc8d-4f95-b232-1074f7af43c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:38.854419 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5066293-e183-4d3f-908d-47253005a164 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:38.855125 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6856fd-fc8d-4f95-b232-1074f7af43c1 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:38.861892 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 385/767] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:20:38 2022] GET /identity/v3/role_assignments?user.id=d211582f9fc34b0e815e27db081c50c9&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=71050e310414462b8d07f901fef201ad => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:38.863033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6856fd-fc8d-4f95-b232-1074f7af43c1 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:38.895228 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 383/768] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:20:38 2022] PUT /identity/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/9b74631c6e1547d991753a65c41bc7e7/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:20:38.981132 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6856fd-fc8d-4f95-b232-1074f7af43c1 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:39.023548 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c30ce1-98fc-42fa-a59c-7e6542081a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:39.025519 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c30ce1-98fc-42fa-a59c-7e6542081a3f None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:39.026010 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c30ce1-98fc-42fa-a59c-7e6542081a3f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:39.026498 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c30ce1-98fc-42fa-a59c-7e6542081a3f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:39.027387 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c30ce1-98fc-42fa-a59c-7e6542081a3f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:39.029085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c30ce1-98fc-42fa-a59c-7e6542081a3f None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:39.042815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-c2c30ce1-98fc-42fa-a59c-7e6542081a3f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 06 23:20:39.042815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:39.042815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:20:39.042815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:20:39.042815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:20:39.042815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:20:39.042815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:20:39.042815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:39.042815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 06 23:20:39.042815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:39.042815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:20:39.042815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:39.042815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:39.042815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:39.042815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:39.042815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:39.043800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:39.043800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:39.043800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:39.043800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:39.043800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:39.043800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:39.043800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:39.043800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:20:39.043800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:20:39.043800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:20:39.043800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:20:39.043800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:39.043800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:39.043800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:39.043800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:39.043800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:39.044659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:39.044659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:39.044659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:39.044659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:39.044659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:39.044659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:39.044659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:39.044659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:39.044659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:39.044659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:39.044659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:39.044659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:20:39.044659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:39.044659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 06 23:20:39.044659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:39.047823 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 386/769] 10.222.0.60 () {56 vars in 1129 bytes} [Fri May 6 23:20:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:39.054322 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5066293-e183-4d3f-908d-47253005a164 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:39.166948 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5066293-e183-4d3f-908d-47253005a164 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:39.204604 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9a87c-05d5-4f04-b29e-a7fefec259ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:39.205607 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9a87c-05d5-4f04-b29e-a7fefec259ee None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:39.206097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9a87c-05d5-4f04-b29e-a7fefec259ee None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:39.206589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9a87c-05d5-4f04-b29e-a7fefec259ee None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:39.207486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9a87c-05d5-4f04-b29e-a7fefec259ee None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:39.208042 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9a87c-05d5-4f04-b29e-a7fefec259ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:39.209692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9a87c-05d5-4f04-b29e-a7fefec259ee None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:39.215227 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 384/770] 10.222.0.60 () {56 vars in 1124 bytes} [Fri May 6 23:20:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:39.221420 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c30ce1-98fc-42fa-a59c-7e6542081a3f None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:39.331787 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c30ce1-98fc-42fa-a59c-7e6542081a3f None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:39.370193 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb25e7e-2c82-4f10-bb30-87f3fcfd6983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:39.370867 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb25e7e-2c82-4f10-bb30-87f3fcfd6983 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:39.371149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb25e7e-2c82-4f10-bb30-87f3fcfd6983 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:39.371420 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb25e7e-2c82-4f10-bb30-87f3fcfd6983 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:39.372139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb25e7e-2c82-4f10-bb30-87f3fcfd6983 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:39.372447 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb25e7e-2c82-4f10-bb30-87f3fcfd6983 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:39.373878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb25e7e-2c82-4f10-bb30-87f3fcfd6983 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:39.384282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 387/771] 10.222.0.60 () {56 vars in 1124 bytes} [Fri May 6 23:20:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:39.385576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9a87c-05d5-4f04-b29e-a7fefec259ee None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:39.516241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9a87c-05d5-4f04-b29e-a7fefec259ee None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:39.550396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c8c37-00ab-4bc9-8ee9-4b0f84ac2905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:39.551053 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c8c37-00ab-4bc9-8ee9-4b0f84ac2905 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:39.551335 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c8c37-00ab-4bc9-8ee9-4b0f84ac2905 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:39.551609 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c8c37-00ab-4bc9-8ee9-4b0f84ac2905 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:39.552400 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c8c37-00ab-4bc9-8ee9-4b0f84ac2905 None admin] RBAC: Adding query filter params (interface=public, service_id=7437f567f3c04a978bbd11032c79254d, region_id=RegionOne) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:39.552745 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c8c37-00ab-4bc9-8ee9-4b0f84ac2905 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:39.554163 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c8c37-00ab-4bc9-8ee9-4b0f84ac2905 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:39.559065 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a0563-fc31-4df7-9c8e-6c9c972a803b None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:39.559362 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a0563-fc31-4df7-9c8e-6c9c972a803b None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:39.559642 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a0563-fc31-4df7-9c8e-6c9c972a803b None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:39.562114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 388/772] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:20:39.563057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 385/773] 10.222.0.60 () {56 vars in 1251 bytes} [Fri May 6 23:20:39 2022] GET /identity/v3/endpoints?service_id=7437f567f3c04a978bbd11032c79254d&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:39.567897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a0563-fc31-4df7-9c8e-6c9c972a803b None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:39.570458 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a515e-8b0d-43a7-a3c9-26cc5f50a8c3 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:39.570934 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a515e-8b0d-43a7-a3c9-26cc5f50a8c3 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:39.571486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a515e-8b0d-43a7-a3c9-26cc5f50a8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:39.600314 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-702a515e-8b0d-43a7-a3c9-26cc5f50a8c3 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:39.602579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-702a515e-8b0d-43a7-a3c9-26cc5f50a8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:39.715427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 386/774] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:20:39.738261 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a515e-8b0d-43a7-a3c9-26cc5f50a8c3 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:39.738553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a0563-fc31-4df7-9c8e-6c9c972a803b None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:39.796231 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8499f72-0ac1-4a27-af32-ae8716090a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:39.797107 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8499f72-0ac1-4a27-af32-ae8716090a40 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:39.797388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8499f72-0ac1-4a27-af32-ae8716090a40 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:39.797706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8499f72-0ac1-4a27-af32-ae8716090a40 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:39.798397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8499f72-0ac1-4a27-af32-ae8716090a40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:39.801091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8499f72-0ac1-4a27-af32-ae8716090a40 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:39.811326 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 389/775] 10.222.0.60 () {56 vars in 1087 bytes} [Fri May 6 23:20:39 2022] GET /identity/v3/services => generated 772 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:39.882780 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a515e-8b0d-43a7-a3c9-26cc5f50a8c3 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:39.919520 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48f205-149b-4164-9c50-839983be573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:39.920374 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48f205-149b-4164-9c50-839983be573d None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:39.920696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48f205-149b-4164-9c50-839983be573d None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:39.920967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48f205-149b-4164-9c50-839983be573d None admin] PATH_INFO: `/v3/services/network` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:39.921629 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48f205-149b-4164-9c50-839983be573d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:39.923001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48f205-149b-4164-9c50-839983be573d None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:39.935166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-ea48f205-149b-4164-9c50-839983be573d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 06 23:20:39.935166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:39.935166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:20:39.935166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:20:39.935166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:20:39.935166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:20:39.935166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:20:39.935166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:39.935166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 06 23:20:39.935166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:39.935166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:20:39.935166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:39.935166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:39.935166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:39.935166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:39.935166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:39.935166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:39.936208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:39.936208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:39.936208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:39.936208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:39.936208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:39.936208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:39.936208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:20:39.936208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:20:39.936208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:20:39.936208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:20:39.936208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:39.936208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:39.936208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:39.936208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:39.936208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:39.936208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:39.937065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:39.937065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:39.937065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:39.937065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:39.937065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:39.937065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:39.937065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:39.937065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:39.937065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:39.937065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:39.937065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:20:39.937065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:39.937065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 06 23:20:39.937065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:39.937065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 387/776] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:39 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:39.945741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8499f72-0ac1-4a27-af32-ae8716090a40 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:40.074203 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8499f72-0ac1-4a27-af32-ae8716090a40 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:40.118491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35911fc4-45ef-420f-92bc-5f504a52efa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:40.119545 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35911fc4-45ef-420f-92bc-5f504a52efa0 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:40.119884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35911fc4-45ef-420f-92bc-5f504a52efa0 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:40.119884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35911fc4-45ef-420f-92bc-5f504a52efa0 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:40.120702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35911fc4-45ef-420f-92bc-5f504a52efa0 None admin] RBAC: Adding query filter params (name=network) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:40.121006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35911fc4-45ef-420f-92bc-5f504a52efa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:40.122390 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35911fc4-45ef-420f-92bc-5f504a52efa0 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:40.128919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 390/777] 10.222.0.60 () {56 vars in 1112 bytes} [Fri May 6 23:20:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:40.134989 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48f205-149b-4164-9c50-839983be573d None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:40.244509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48f205-149b-4164-9c50-839983be573d None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:40.280275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c9c71-cc78-4efa-9205-b96ea6833ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:40.280963 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c9c71-cc78-4efa-9205-b96ea6833ae9 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:40.281250 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c9c71-cc78-4efa-9205-b96ea6833ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:40.281521 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c9c71-cc78-4efa-9205-b96ea6833ae9 None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:40.282219 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c9c71-cc78-4efa-9205-b96ea6833ae9 None admin] RBAC: Adding query filter params (type=network) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:40.282519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c9c71-cc78-4efa-9205-b96ea6833ae9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:40.283882 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c9c71-cc78-4efa-9205-b96ea6833ae9 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:40.289401 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 388/778] 10.222.0.60 () {56 vars in 1112 bytes} [Fri May 6 23:20:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:40.294924 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35911fc4-45ef-420f-92bc-5f504a52efa0 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:40.428859 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35911fc4-45ef-420f-92bc-5f504a52efa0 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:40.486683 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752a2f8-bdaf-4529-8001-efde022492af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:40.487360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752a2f8-bdaf-4529-8001-efde022492af None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:40.487642 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752a2f8-bdaf-4529-8001-efde022492af None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:40.487920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752a2f8-bdaf-4529-8001-efde022492af None admin] PATH_INFO: `/v3/endpoints` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:40.488752 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752a2f8-bdaf-4529-8001-efde022492af None admin] RBAC: Adding query filter params (interface=public, service_id=ed58724959c54c7fb6593f74b76d0873, region_id=RegionOne) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:40.489069 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752a2f8-bdaf-4529-8001-efde022492af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:40.490446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752a2f8-bdaf-4529-8001-efde022492af None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:40.503166 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 391/779] 10.222.0.60 () {56 vars in 1251 bytes} [Fri May 6 23:20:40 2022] GET /identity/v3/endpoints?service_id=ed58724959c54c7fb6593f74b76d0873&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:40.508489 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c9c71-cc78-4efa-9205-b96ea6833ae9 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:40.638259 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c9c71-cc78-4efa-9205-b96ea6833ae9 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:40.678164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e374f26-9ef3-4ce5-ad89-83e3ec435276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:40.678830 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e374f26-9ef3-4ce5-ad89-83e3ec435276 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:40.679163 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e374f26-9ef3-4ce5-ad89-83e3ec435276 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:40.679384 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e374f26-9ef3-4ce5-ad89-83e3ec435276 None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:40.680072 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e374f26-9ef3-4ce5-ad89-83e3ec435276 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:40.681565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e374f26-9ef3-4ce5-ad89-83e3ec435276 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:40.693310 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 389/780] 10.222.0.60 () {56 vars in 1087 bytes} [Fri May 6 23:20:40 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:40.845954 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8983c7d-19e8-48eb-b5c1-e3a8d356250d None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:40.845954 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8983c7d-19e8-48eb-b5c1-e3a8d356250d None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:40.845954 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8983c7d-19e8-48eb-b5c1-e3a8d356250d None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:40.847192 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 392/781] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:40.853279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd9061-3f84-4671-9c70-3ec4c1241535 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:40.854162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd9061-3f84-4671-9c70-3ec4c1241535 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:40.854904 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd9061-3f84-4671-9c70-3ec4c1241535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:40.877165 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-8fcd9061-3f84-4671-9c70-3ec4c1241535 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:40.879353 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-8fcd9061-3f84-4671-9c70-3ec4c1241535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:40.965012 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 390/782] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:20:40.987714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8983c7d-19e8-48eb-b5c1-e3a8d356250d None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:41.090561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8983c7d-19e8-48eb-b5c1-e3a8d356250d None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:41.124828 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55aa21c-a326-459a-bee9-e7efeec11718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:41.125985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55aa21c-a326-459a-bee9-e7efeec11718 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:41.126461 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55aa21c-a326-459a-bee9-e7efeec11718 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:41.126928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55aa21c-a326-459a-bee9-e7efeec11718 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:41.137863 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55aa21c-a326-459a-bee9-e7efeec11718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:41.145808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-c55aa21c-a326-459a-bee9-e7efeec11718 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:20:41.145808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:41.145808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:41.145808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:41.145808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:41.145808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:41.145808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:41.145808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:41.145808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:41.145808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:41.145808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:41.145808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:41.145808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:41.145808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:41.145808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:41.145808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:41.146714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:41.146714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:41.146714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:41.146714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:41.146714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:41.146714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:41.146714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:41.146714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:41.146714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:41.146714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:41.146714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:41.146714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:41.146714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:41.146714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:41.146714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:41.146714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:41.147567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:41.147567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:41.147567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:41.147567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:41.147567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:41.147567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:41.147567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:41.147567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:41.147567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:41.147567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:41.147567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:20:41.147567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:41.150384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 393/783] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:20:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:41.156299 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd9061-3f84-4671-9c70-3ec4c1241535 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:41.291245 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd9061-3f84-4671-9c70-3ec4c1241535 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:41.340064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24eb62-6f98-4dbc-9ff2-c54f0001e127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:41.340765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24eb62-6f98-4dbc-9ff2-c54f0001e127 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:41.341046 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24eb62-6f98-4dbc-9ff2-c54f0001e127 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:41.341326 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24eb62-6f98-4dbc-9ff2-c54f0001e127 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:41.342087 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24eb62-6f98-4dbc-9ff2-c54f0001e127 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:41.342393 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24eb62-6f98-4dbc-9ff2-c54f0001e127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:41.343766 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24eb62-6f98-4dbc-9ff2-c54f0001e127 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:41.356311 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 391/784] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:20:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:41.361956 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55aa21c-a326-459a-bee9-e7efeec11718 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:41.496004 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55aa21c-a326-459a-bee9-e7efeec11718 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:41.529921 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a7de2-a40b-410c-86fc-4cca0f5047ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:41.531085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a7de2-a40b-410c-86fc-4cca0f5047ed None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:41.531572 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a7de2-a40b-410c-86fc-4cca0f5047ed None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:41.532038 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a7de2-a40b-410c-86fc-4cca0f5047ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:41.544231 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a7de2-a40b-410c-86fc-4cca0f5047ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:41.547464 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a7de2-a40b-410c-86fc-4cca0f5047ed None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:41.569360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-e75a7de2-a40b-410c-86fc-4cca0f5047ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:41.569360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:41.569360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:41.569360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:41.569360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:41.569360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:41.569360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:41.569360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:41.569360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:41.569360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:41.569360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:41.569360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:41.569360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:41.569360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:41.569360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:41.570301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:41.570301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:41.570301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:41.570301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:41.570301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:41.570301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:41.570301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:41.570301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:41.570301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:41.570301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:41.570301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:41.570301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:41.570301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:41.570301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:41.570301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:41.570301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:41.570301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:41.571246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:41.571246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:41.571246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:41.571246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:41.573994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 394/785] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:41.581698 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24eb62-6f98-4dbc-9ff2-c54f0001e127 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:41.734080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24eb62-6f98-4dbc-9ff2-c54f0001e127 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:41.780014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9bfb6-2c7d-4f9d-81bc-55edad47b6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:41.780705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9bfb6-2c7d-4f9d-81bc-55edad47b6e2 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:41.780987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9bfb6-2c7d-4f9d-81bc-55edad47b6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:41.781266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9bfb6-2c7d-4f9d-81bc-55edad47b6e2 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:41.781989 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9bfb6-2c7d-4f9d-81bc-55edad47b6e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:41.782294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9bfb6-2c7d-4f9d-81bc-55edad47b6e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:41.783668 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9bfb6-2c7d-4f9d-81bc-55edad47b6e2 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:41.800720 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 392/786] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:41.802038 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a7de2-a40b-410c-86fc-4cca0f5047ed None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:41.829771 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22903c-0a65-4172-98f9-4ec9b47ed1df None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:41.830069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22903c-0a65-4172-98f9-4ec9b47ed1df None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:41.830325 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22903c-0a65-4172-98f9-4ec9b47ed1df None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:41.831942 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 393/787] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:20:41.838472 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f1507-31c3-4e4c-b158-112f5307a320 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:41.838472 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f1507-31c3-4e4c-b158-112f5307a320 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:41.838472 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f1507-31c3-4e4c-b158-112f5307a320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:41.860506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-3c2f1507-31c3-4e4c-b158-112f5307a320 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:41.862037 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-3c2f1507-31c3-4e4c-b158-112f5307a320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:41.928969 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 394/788] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:20:41.935622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb8b06-19c5-4236-b63f-91e3809c973a None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:41.936235 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb8b06-19c5-4236-b63f-91e3809c973a None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:41.936764 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb8b06-19c5-4236-b63f-91e3809c973a None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:41.938610 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 395/789] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:41.944058 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a7de2-a40b-410c-86fc-4cca0f5047ed None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:41.952199 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b3799-d444-47e6-ba79-b425b9f6a64f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:41.952765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b3799-d444-47e6-ba79-b425b9f6a64f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:41.953266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b3799-d444-47e6-ba79-b425b9f6a64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:41.975568 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-fe6b3799-d444-47e6-ba79-b425b9f6a64f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:41.977170 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-fe6b3799-d444-47e6-ba79-b425b9f6a64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:41.979426 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b4275-f3e1-4dbf-a025-6b733f15a97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:41.980224 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b4275-f3e1-4dbf-a025-6b733f15a97c None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:41.980506 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b4275-f3e1-4dbf-a025-6b733f15a97c None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:41.980817 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b4275-f3e1-4dbf-a025-6b733f15a97c None admin] PATH_INFO: `/v3/users/swift` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:41.988442 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b4275-f3e1-4dbf-a025-6b733f15a97c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:41.989908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b4275-f3e1-4dbf-a025-6b733f15a97c None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:42.004006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-125b4275-f3e1-4dbf-a025-6b733f15a97c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 06 23:20:42.004006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:42.004006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:42.004006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:42.004006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:42.004006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:42.004006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:42.004006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:42.004006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:42.004006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:42.004006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:42.004006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:42.004006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:42.004006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:42.004006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:42.004006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:42.005092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:42.005092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:42.005092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:42.005092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:42.005092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:42.005092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:42.005092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:42.005092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:42.005092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:42.005092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:42.005092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:42.005092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:42.005092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:42.005092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:42.005092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:42.005092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:42.005092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:42.005092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:42.006046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:42.006046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:42.006046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:42.006046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:42.006046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:42.006046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:42.006046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:42.006046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:42.006046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 06 23:20:42.006046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:42.006046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 395/790] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:20:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:42.006637 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b4275-f3e1-4dbf-a025-6b733f15a97c None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:42.048965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 396/791] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:20:42.050077 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b3799-d444-47e6-ba79-b425b9f6a64f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:42.136196 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b4275-f3e1-4dbf-a025-6b733f15a97c None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:42.164738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b3799-d444-47e6-ba79-b425b9f6a64f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:42.170309 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654c393-2e6e-492f-b067-4e71269551b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:42.171365 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654c393-2e6e-492f-b067-4e71269551b9 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:42.171820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654c393-2e6e-492f-b067-4e71269551b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:42.172266 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654c393-2e6e-492f-b067-4e71269551b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:42.182809 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654c393-2e6e-492f-b067-4e71269551b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:42.190751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-e654c393-2e6e-492f-b067-4e71269551b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:20:42.190751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:42.190751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:42.190751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:42.190751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:42.190751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:42.190751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:42.190751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:42.190751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:42.190751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:42.190751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:42.190751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:42.190751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:42.190751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:42.190751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:42.190751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:42.191658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:42.191658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:42.191658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:42.191658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:42.191658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:42.191658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:42.191658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:42.191658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:42.191658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:42.191658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:42.191658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:42.191658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:42.191658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:42.191658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:42.191658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:42.191658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:42.192493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:42.192493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:42.192493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:42.192493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:42.192493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:42.192493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:42.192493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:42.192493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:42.192493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:42.192493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:42.192493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:20:42.192493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:42.195243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 396/792] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:20:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:42.196748 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654c393-2e6e-492f-b067-4e71269551b9 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:42.207782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37ec92-b226-4356-b99b-97ca1e08b0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:42.208463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37ec92-b226-4356-b99b-97ca1e08b0dd None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:42.208776 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37ec92-b226-4356-b99b-97ca1e08b0dd None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:42.209052 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37ec92-b226-4356-b99b-97ca1e08b0dd None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:42.210315 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37ec92-b226-4356-b99b-97ca1e08b0dd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:42.210631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37ec92-b226-4356-b99b-97ca1e08b0dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:42.212914 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37ec92-b226-4356-b99b-97ca1e08b0dd None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:42.246177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 397/793] 10.222.0.60 () {56 vars in 1135 bytes} [Fri May 6 23:20:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:42.246177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37ec92-b226-4356-b99b-97ca1e08b0dd None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:42.322550 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654c393-2e6e-492f-b067-4e71269551b9 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:42.357892 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37ec92-b226-4356-b99b-97ca1e08b0dd None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:42.364327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347c2c6-ef5d-43a4-b23a-091767f25e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:42.365186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347c2c6-ef5d-43a4-b23a-091767f25e4f None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:42.365467 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347c2c6-ef5d-43a4-b23a-091767f25e4f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:42.365745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347c2c6-ef5d-43a4-b23a-091767f25e4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:42.380108 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347c2c6-ef5d-43a4-b23a-091767f25e4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:42.391026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-6347c2c6-ef5d-43a4-b23a-091767f25e4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:42.391026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:42.391026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:42.391026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:42.391026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:42.391026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:42.391026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:42.391026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:42.391026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:42.391026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:42.391026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:42.391026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:42.391026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:42.391026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:42.391026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:42.391026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:42.391936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:42.391936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:42.391936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:42.391936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:42.391936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:42.391936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:42.391936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:42.391936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:42.391936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:42.391936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:42.391936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:42.391936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:42.391936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:42.391936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:42.391936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:42.391936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:42.392805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:42.392805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:42.392805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:42.392805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:42.392805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:42.392805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:42.392805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:42.392805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:42.392805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:42.392805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:42.392805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:42.392805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:42.393993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 397/794] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:42.394650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347c2c6-ef5d-43a4-b23a-091767f25e4f None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:42.398238 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fb8fa-5d96-4895-9e31-46707d23b013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:42.399861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fb8fa-5d96-4895-9e31-46707d23b013 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:42.400448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fb8fa-5d96-4895-9e31-46707d23b013 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:42.400930 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fb8fa-5d96-4895-9e31-46707d23b013 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:42.401863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fb8fa-5d96-4895-9e31-46707d23b013 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:42.402388 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fb8fa-5d96-4895-9e31-46707d23b013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:42.404030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fb8fa-5d96-4895-9e31-46707d23b013 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:42.413036 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 398/795] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:20:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:42.414121 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fb8fa-5d96-4895-9e31-46707d23b013 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:42.515889 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347c2c6-ef5d-43a4-b23a-091767f25e4f None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:42.533075 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fb8fa-5d96-4895-9e31-46707d23b013 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:42.549392 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438995a-4aec-4a1f-ab93-a7eae45c56b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:42.550614 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438995a-4aec-4a1f-ab93-a7eae45c56b3 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:42.551090 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438995a-4aec-4a1f-ab93-a7eae45c56b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:42.551577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438995a-4aec-4a1f-ab93-a7eae45c56b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:42.563550 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438995a-4aec-4a1f-ab93-a7eae45c56b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:42.565451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438995a-4aec-4a1f-ab93-a7eae45c56b3 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:42.571861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8971e-8aa9-4e49-8907-d6f7b30c3bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:42.572581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8971e-8aa9-4e49-8907-d6f7b30c3bcf None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:42.572862 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8971e-8aa9-4e49-8907-d6f7b30c3bcf None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:42.573136 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8971e-8aa9-4e49-8907-d6f7b30c3bcf None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:42.574306 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8971e-8aa9-4e49-8907-d6f7b30c3bcf None admin] RBAC: Adding query filter params (name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:42.574618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8971e-8aa9-4e49-8907-d6f7b30c3bcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:42.576459 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8971e-8aa9-4e49-8907-d6f7b30c3bcf None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:42.585092 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 399/796] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:20:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:42.585318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-a438995a-4aec-4a1f-ab93-a7eae45c56b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:42.585318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:42.585318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:42.585318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:42.585318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:42.585318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:42.585318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:42.585318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:42.585318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:42.585318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:42.585318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:42.585318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:42.585318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:42.585318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:42.585318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:42.586134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:42.586134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:42.586134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:42.586134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:42.586134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:42.586134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:42.586134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:42.586134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:42.586134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:42.586134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:42.586134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:42.586134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:42.586134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:42.586134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:42.586134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:42.586134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:42.586134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:42.587564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:42.587564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:42.587564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:42.587564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:42.587792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8971e-8aa9-4e49-8907-d6f7b30c3bcf None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:42.594774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 398/797] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:42.595857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438995a-4aec-4a1f-ab93-a7eae45c56b3 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:42.693331 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438995a-4aec-4a1f-ab93-a7eae45c56b3 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:42.700868 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8971e-8aa9-4e49-8907-d6f7b30c3bcf None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:42.728430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535059e8-cc48-49cb-87ed-ef3e6645b44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:42.729254 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535059e8-cc48-49cb-87ed-ef3e6645b44c None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:42.729528 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535059e8-cc48-49cb-87ed-ef3e6645b44c None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:42.729801 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535059e8-cc48-49cb-87ed-ef3e6645b44c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:42.734301 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef216e2c-9a69-4db0-a629-d00fa13587f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:42.735086 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef216e2c-9a69-4db0-a629-d00fa13587f8 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:42.735366 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef216e2c-9a69-4db0-a629-d00fa13587f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:42.735638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef216e2c-9a69-4db0-a629-d00fa13587f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:42.740249 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535059e8-cc48-49cb-87ed-ef3e6645b44c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:42.741717 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535059e8-cc48-49cb-87ed-ef3e6645b44c None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:42.746218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef216e2c-9a69-4db0-a629-d00fa13587f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:42.747645 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef216e2c-9a69-4db0-a629-d00fa13587f8 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:42.759036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-535059e8-cc48-49cb-87ed-ef3e6645b44c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:42.759036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:42.759036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:42.759036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:42.759036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:42.759036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:42.759036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:42.759036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:42.759036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:42.759036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:42.759036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:42.759036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:42.759036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:42.759036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:42.759036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:42.759993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:42.759993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:42.759993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:42.759993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:42.759993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:42.759993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:42.759993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:42.759993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:42.759993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:42.759993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:42.759993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:42.759993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:42.759993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:42.759993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:42.759993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:42.759993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:42.759993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:42.761297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:42.761297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:42.761297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:42.761297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:42.764957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 399/798] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:42.765060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-ef216e2c-9a69-4db0-a629-d00fa13587f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:42.765060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:42.765060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:42.765060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:42.765060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:42.765060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:42.765060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:42.765060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:42.765060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:42.765060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:42.765060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:42.765060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:42.765060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:42.765060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:42.765060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:42.766254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:42.766254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:42.766254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:42.766254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:42.766254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:42.766254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:42.766254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:42.766254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:42.766254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:42.766254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:42.766254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:42.766254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:42.766254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:42.766254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:42.766254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:42.766254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:42.766254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:42.768445 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:42.768445 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:42.768445 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:42.768445 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:42.768952 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535059e8-cc48-49cb-87ed-ef3e6645b44c None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:42.769092 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 400/799] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:42.769092 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cac101-0343-4b34-8210-06f21cde82ac None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:42.769092 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cac101-0343-4b34-8210-06f21cde82ac None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:42.769092 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cac101-0343-4b34-8210-06f21cde82ac None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:42.773488 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 401/800] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:42.774324 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cac101-0343-4b34-8210-06f21cde82ac None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:42.879957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535059e8-cc48-49cb-87ed-ef3e6645b44c None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:42.888368 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cac101-0343-4b34-8210-06f21cde82ac None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:42.912652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a48da2-2136-40a3-aec1-267e672d204b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:42.913319 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48da2-2136-40a3-aec1-267e672d204b None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:42.913603 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48da2-2136-40a3-aec1-267e672d204b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:42.913881 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48da2-2136-40a3-aec1-267e672d204b None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:42.914605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a48da2-2136-40a3-aec1-267e672d204b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:42.915436 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a48da2-2136-40a3-aec1-267e672d204b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:42.916829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a48da2-2136-40a3-aec1-267e672d204b None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:42.928295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90e02c-388f-4a01-a72b-d438d8d147c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:42.928487 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 400/801] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:42.929312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a48da2-2136-40a3-aec1-267e672d204b None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:42.929539 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90e02c-388f-4a01-a72b-d438d8d147c1 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:42.929996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90e02c-388f-4a01-a72b-d438d8d147c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:42.930272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90e02c-388f-4a01-a72b-d438d8d147c1 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:42.931582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90e02c-388f-4a01-a72b-d438d8d147c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:42.931889 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90e02c-388f-4a01-a72b-d438d8d147c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:42.933279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90e02c-388f-4a01-a72b-d438d8d147c1 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:42.946864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 402/802] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:42.948434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf0b12-b4e8-4f3c-ba06-9c72bd883119 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:42.948755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf0b12-b4e8-4f3c-ba06-9c72bd883119 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:42.949031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf0b12-b4e8-4f3c-ba06-9c72bd883119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:42.965014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-cfaf0b12-b4e8-4f3c-ba06-9c72bd883119 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:42.966191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-cfaf0b12-b4e8-4f3c-ba06-9c72bd883119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:43.031172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 403/803] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:20:43.032274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf0b12-b4e8-4f3c-ba06-9c72bd883119 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:43.052432 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a48da2-2136-40a3-aec1-267e672d204b None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:43.086088 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e07e8a-6f0d-448d-bcaf-b6c842444b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:43.087237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e07e8a-6f0d-448d-bcaf-b6c842444b8e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:43.087517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e07e8a-6f0d-448d-bcaf-b6c842444b8e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:43.087786 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e07e8a-6f0d-448d-bcaf-b6c842444b8e None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:43.088500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e07e8a-6f0d-448d-bcaf-b6c842444b8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:43.088827 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e07e8a-6f0d-448d-bcaf-b6c842444b8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:43.090440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e07e8a-6f0d-448d-bcaf-b6c842444b8e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:43.101277 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 401/804] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:43.102055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e07e8a-6f0d-448d-bcaf-b6c842444b8e None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:43.140791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf0b12-b4e8-4f3c-ba06-9c72bd883119 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:43.182922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd41bff-85e4-45d1-bf00-711a88499289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:43.183742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd41bff-85e4-45d1-bf00-711a88499289 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:43.184021 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd41bff-85e4-45d1-bf00-711a88499289 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:43.184302 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd41bff-85e4-45d1-bf00-711a88499289 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:43.192134 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd41bff-85e4-45d1-bf00-711a88499289 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:43.195199 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd41bff-85e4-45d1-bf00-711a88499289 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:43.208671 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e07e8a-6f0d-448d-bcaf-b6c842444b8e None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:43.212278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-cdd41bff-85e4-45d1-bf00-711a88499289 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:43.212278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:43.212278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:43.212278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:43.212278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:43.212278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:43.212278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:43.212278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:43.212278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:43.212278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:43.212278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:43.212278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:43.212278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:43.212278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:43.212278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:43.213243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:43.213243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:43.213243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:43.213243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:43.213243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:43.213243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:43.213243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:43.213243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:43.213243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:43.213243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:43.213243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:43.213243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:43.213243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:43.213243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:43.213243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:43.213243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:43.213243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:43.214396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:43.214396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:43.214396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:43.214396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:43.214396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:43.214396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:43.214396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:43.214396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:43.214396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 404/805] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:43.215365 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd41bff-85e4-45d1-bf00-711a88499289 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:43.246605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca55110-b8bf-4ee6-b196-4a3bb82ce6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:43.247428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca55110-b8bf-4ee6-b196-4a3bb82ce6b6 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:43.247713 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca55110-b8bf-4ee6-b196-4a3bb82ce6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:43.247992 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca55110-b8bf-4ee6-b196-4a3bb82ce6b6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:43.255395 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca55110-b8bf-4ee6-b196-4a3bb82ce6b6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:43.256876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca55110-b8bf-4ee6-b196-4a3bb82ce6b6 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:43.273964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-4ca55110-b8bf-4ee6-b196-4a3bb82ce6b6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 06 23:20:43.273964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:43.273964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:43.273964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:43.273964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:43.273964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:43.273964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:43.273964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:43.273964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:43.273964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:43.273964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:43.273964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:43.273964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:43.273964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:43.273964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:43.273964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:43.274981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:43.274981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:43.274981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:43.274981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:43.274981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:43.274981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:43.274981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:43.274981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:43.274981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:43.274981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:43.274981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:43.274981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:43.274981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:43.274981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:43.274981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:43.274981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:43.274981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:43.274981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:43.275897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:43.275897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:43.275897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:43.275897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:43.275897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:43.275897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:43.275897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:43.275897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:43.275897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 06 23:20:43.275897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:43.275897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 402/806] 10.222.0.60 () {56 vars in 1117 bytes} [Fri May 6 23:20:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:43.275897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca55110-b8bf-4ee6-b196-4a3bb82ce6b6 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:43.318761 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd41bff-85e4-45d1-bf00-711a88499289 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:43.351613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47d6fc-f5b4-411a-bb59-e58cef1a19bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:43.352953 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47d6fc-f5b4-411a-bb59-e58cef1a19bf None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:43.353236 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47d6fc-f5b4-411a-bb59-e58cef1a19bf None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:43.353565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47d6fc-f5b4-411a-bb59-e58cef1a19bf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:43.354213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47d6fc-f5b4-411a-bb59-e58cef1a19bf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:43.355587 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47d6fc-f5b4-411a-bb59-e58cef1a19bf None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:43.367386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-ed47d6fc-f5b4-411a-bb59-e58cef1a19bf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 06 23:20:43.367386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:43.367386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:20:43.367386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:20:43.367386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:20:43.367386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:20:43.367386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:20:43.367386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:43.367386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 06 23:20:43.367386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:43.367386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:20:43.367386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:43.367386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:43.367386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:43.367386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:43.367386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:43.368608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:43.368608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:43.368608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:43.368608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:43.368608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:43.368608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:43.368608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:43.368608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:20:43.368608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:20:43.368608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:20:43.368608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:20:43.368608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:43.368608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:43.368608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:43.368608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:43.368608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:43.369552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:43.369552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:43.369552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:43.369552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:43.369552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:43.369552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:43.369552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:43.369552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:43.369552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:43.369552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:43.369552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:43.369552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:20:43.369552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:43.369552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 06 23:20:43.369552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:43.369552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 405/807] 10.222.0.60 () {56 vars in 1129 bytes} [Fri May 6 23:20:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:43.370401 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47d6fc-f5b4-411a-bb59-e58cef1a19bf None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:43.380957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca55110-b8bf-4ee6-b196-4a3bb82ce6b6 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:43.413312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65e329-518a-4bb4-825d-6818852e8f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:43.414082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65e329-518a-4bb4-825d-6818852e8f5b None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:43.414357 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65e329-518a-4bb4-825d-6818852e8f5b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:43.414624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65e329-518a-4bb4-825d-6818852e8f5b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:43.421324 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65e329-518a-4bb4-825d-6818852e8f5b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:43.422740 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65e329-518a-4bb4-825d-6818852e8f5b None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:43.436391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-5d65e329-518a-4bb4-825d-6818852e8f5b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 06 23:20:43.436391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:43.436391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:43.436391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:43.436391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:43.436391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:43.436391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:43.436391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:43.436391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:43.436391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:43.436391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:43.436391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:43.436391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:43.436391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:43.436391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:43.436391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:43.437539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:43.437539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:43.437539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:43.437539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:43.437539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:43.437539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:43.437539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:43.437539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:43.437539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:43.437539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:43.437539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:43.437539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:43.437539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:43.437539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:43.437539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:43.437539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:43.437539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:43.437539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:43.438781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:43.438781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:43.438781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:43.438781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:43.438781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:43.438781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:43.438781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:43.438781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:43.438781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 06 23:20:43.438781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:43.438781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 403/808] 10.222.0.60 () {56 vars in 1093 bytes} [Fri May 6 23:20:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:43.438781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65e329-518a-4bb4-825d-6818852e8f5b None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:43.470780 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47d6fc-f5b4-411a-bb59-e58cef1a19bf None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:43.501309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a8601-55df-4f81-b0a1-3b940f43ed60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:43.501954 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a8601-55df-4f81-b0a1-3b940f43ed60 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:43.502239 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a8601-55df-4f81-b0a1-3b940f43ed60 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:43.502507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a8601-55df-4f81-b0a1-3b940f43ed60 None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:43.503299 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a8601-55df-4f81-b0a1-3b940f43ed60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:43.503600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a8601-55df-4f81-b0a1-3b940f43ed60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:43.505066 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a8601-55df-4f81-b0a1-3b940f43ed60 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:43.517076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 406/809] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:43.518355 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc24dc-aeae-4dc6-8476-fa54a987b75b None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:43.518612 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc24dc-aeae-4dc6-8476-fa54a987b75b None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:43.518885 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc24dc-aeae-4dc6-8476-fa54a987b75b None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:43.521290 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 407/810] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:43.521290 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc24dc-aeae-4dc6-8476-fa54a987b75b None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:43.533779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65e329-518a-4bb4-825d-6818852e8f5b None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:43.565944 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b2394-ef56-4b23-a371-5b3a5dfc2d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:43.566631 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b2394-ef56-4b23-a371-5b3a5dfc2d3c None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:43.566908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b2394-ef56-4b23-a371-5b3a5dfc2d3c None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:43.567180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b2394-ef56-4b23-a371-5b3a5dfc2d3c None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:43.568009 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b2394-ef56-4b23-a371-5b3a5dfc2d3c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:43.568313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b2394-ef56-4b23-a371-5b3a5dfc2d3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:43.569776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b2394-ef56-4b23-a371-5b3a5dfc2d3c None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:43.586438 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 404/811] 10.222.0.60 () {56 vars in 1149 bytes} [Fri May 6 23:20:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:43.587780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b2394-ef56-4b23-a371-5b3a5dfc2d3c None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:43.620436 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc24dc-aeae-4dc6-8476-fa54a987b75b None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:43.652211 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd76eb-3ff0-46af-a3fe-e84320d05eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:43.652893 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd76eb-3ff0-46af-a3fe-e84320d05eed None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:43.653172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd76eb-3ff0-46af-a3fe-e84320d05eed None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:43.653441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd76eb-3ff0-46af-a3fe-e84320d05eed None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:43.654191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd76eb-3ff0-46af-a3fe-e84320d05eed None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:43.654597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd76eb-3ff0-46af-a3fe-e84320d05eed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:43.655963 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd76eb-3ff0-46af-a3fe-e84320d05eed None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:43.660198 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 408/812] 10.222.0.60 () {56 vars in 1124 bytes} [Fri May 6 23:20:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:43.660959 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd76eb-3ff0-46af-a3fe-e84320d05eed None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:43.682281 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b2394-ef56-4b23-a371-5b3a5dfc2d3c None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:43.714877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfc41b-8f39-4ca6-9644-c6f5bffd1732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:43.715542 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfc41b-8f39-4ca6-9644-c6f5bffd1732 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:43.715822 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfc41b-8f39-4ca6-9644-c6f5bffd1732 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:43.716095 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfc41b-8f39-4ca6-9644-c6f5bffd1732 None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:43.716950 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfc41b-8f39-4ca6-9644-c6f5bffd1732 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:43.717256 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfc41b-8f39-4ca6-9644-c6f5bffd1732 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:43.718677 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfc41b-8f39-4ca6-9644-c6f5bffd1732 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:43.734817 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 405/813] 10.222.0.60 () {56 vars in 1133 bytes} [Fri May 6 23:20:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:43.735928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ebbee-6b64-4571-a8af-b8fe0c68b7af None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:43.736220 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ebbee-6b64-4571-a8af-b8fe0c68b7af None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:43.736492 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ebbee-6b64-4571-a8af-b8fe0c68b7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:43.753034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd76eb-3ff0-46af-a3fe-e84320d05eed None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:43.753299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-ab9ebbee-6b64-4571-a8af-b8fe0c68b7af None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:43.754468 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-ab9ebbee-6b64-4571-a8af-b8fe0c68b7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:43.784688 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc82c69-3f9f-4156-8e90-05fdd1afae17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:43.785558 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc82c69-3f9f-4156-8e90-05fdd1afae17 None admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:43.785834 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc82c69-3f9f-4156-8e90-05fdd1afae17 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:43.786111 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc82c69-3f9f-4156-8e90-05fdd1afae17 None admin] PATH_INFO: `/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/48b3ec57aee94b87889d578e114fa0db/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:43.788058 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc82c69-3f9f-4156-8e90-05fdd1afae17 None admin] RBAC: Authorizing `identity:create_grant(project_id=4389eb256aba4b7182e33cb3720b1073, user_id=48b3ec57aee94b87889d578e114fa0db, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:43.789512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc82c69-3f9f-4156-8e90-05fdd1afae17 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:43.801978 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 409/814] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:20:43 2022] PUT /identity/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/48b3ec57aee94b87889d578e114fa0db/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:20:43.802826 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc82c69-3f9f-4156-8e90-05fdd1afae17 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:43.824585 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 406/815] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:20:43.824585 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ebbee-6b64-4571-a8af-b8fe0c68b7af None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:43.919417 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc82c69-3f9f-4156-8e90-05fdd1afae17 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:43.938680 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ebbee-6b64-4571-a8af-b8fe0c68b7af None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:43.954467 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b4d5-01d2-4d6a-b93b-a8a1e12b7a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:43.955426 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b4d5-01d2-4d6a-b93b-a8a1e12b7a38 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:43.955808 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b4d5-01d2-4d6a-b93b-a8a1e12b7a38 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:43.956177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b4d5-01d2-4d6a-b93b-a8a1e12b7a38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:43.967667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86b4d5-01d2-4d6a-b93b-a8a1e12b7a38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:43.969348 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86b4d5-01d2-4d6a-b93b-a8a1e12b7a38 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:43.974089 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c13b6-4a2c-4b72-9e6b-655bbc6b1641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:43.974771 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c13b6-4a2c-4b72-9e6b-655bbc6b1641 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:43.975067 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c13b6-4a2c-4b72-9e6b-655bbc6b1641 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:43.975330 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c13b6-4a2c-4b72-9e6b-655bbc6b1641 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:43.976049 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c13b6-4a2c-4b72-9e6b-655bbc6b1641 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:43.976359 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c13b6-4a2c-4b72-9e6b-655bbc6b1641 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:43.977866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c13b6-4a2c-4b72-9e6b-655bbc6b1641 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:43.987874 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 407/816] 10.222.0.60 () {56 vars in 1124 bytes} [Fri May 6 23:20:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:43.987874 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c13b6-4a2c-4b72-9e6b-655bbc6b1641 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:43.989112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-6e86b4d5-01d2-4d6a-b93b-a8a1e12b7a38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:43.989112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:43.989112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:43.989112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:43.989112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:43.989112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:43.989112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:43.989112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:43.989112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:43.989112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:43.989112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:43.989112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:43.989112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:43.989112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:43.989112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:43.989975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:43.989975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:43.989975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:43.989975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:43.989975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:43.989975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:43.989975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:43.989975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:43.989975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:43.989975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:43.989975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:43.989975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:43.989975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:43.989975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:43.989975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:43.989975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:43.989975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:43.990839 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:43.990839 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:43.990839 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:43.990839 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:43.990839 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 410/817] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:43.991676 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b4d5-01d2-4d6a-b93b-a8a1e12b7a38 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:44.088510 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b4d5-01d2-4d6a-b93b-a8a1e12b7a38 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:44.091924 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c13b6-4a2c-4b72-9e6b-655bbc6b1641 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:44.121977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c06b6e-a981-4508-8cc6-08ce3f139b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:44.123131 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c06b6e-a981-4508-8cc6-08ce3f139b10 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:44.123623 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c06b6e-a981-4508-8cc6-08ce3f139b10 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:44.124094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c06b6e-a981-4508-8cc6-08ce3f139b10 None admin] PATH_INFO: `/v3/services/network` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:44.124705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836ccc8-cdbe-4671-ac82-c7a170f559a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:44.125234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c06b6e-a981-4508-8cc6-08ce3f139b10 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:44.125339 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836ccc8-cdbe-4671-ac82-c7a170f559a0 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:44.125623 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836ccc8-cdbe-4671-ac82-c7a170f559a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:44.125900 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836ccc8-cdbe-4671-ac82-c7a170f559a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:44.127307 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c06b6e-a981-4508-8cc6-08ce3f139b10 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:44.139429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-f3c06b6e-a981-4508-8cc6-08ce3f139b10 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 06 23:20:44.139429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:44.139429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:20:44.139429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:20:44.139429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:20:44.139429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:20:44.139429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:20:44.139429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:44.139429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 06 23:20:44.139429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:44.139429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:20:44.139429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:44.139429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:44.139429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:44.139429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:44.139429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:44.139429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:44.140440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:44.140440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:44.140440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:44.140440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:44.140440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:44.140440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:44.140440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:20:44.140440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:20:44.140440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:20:44.140440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:20:44.140440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:44.140440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:44.140440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:44.140440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:44.140440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:44.140440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:44.141599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:44.141599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:44.141599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:44.141599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:44.141599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:44.141599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:44.141599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:44.141599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:44.141599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:44.141599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:44.141599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:20:44.141599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:44.141599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 06 23:20:44.141599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:44.148609 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 411/818] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:43 2022] GET /identity/v3/services/network => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:44.148609 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c06b6e-a981-4508-8cc6-08ce3f139b10 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:44.191335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836ccc8-cdbe-4671-ac82-c7a170f559a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:44.192860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836ccc8-cdbe-4671-ac82-c7a170f559a0 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:44.241268 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c06b6e-a981-4508-8cc6-08ce3f139b10 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:44.274322 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176006be-1e7c-4eb2-aa04-c1e56ae41e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:44.275008 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176006be-1e7c-4eb2-aa04-c1e56ae41e82 None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:44.275395 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176006be-1e7c-4eb2-aa04-c1e56ae41e82 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:44.275845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176006be-1e7c-4eb2-aa04-c1e56ae41e82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:44.277240 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176006be-1e7c-4eb2-aa04-c1e56ae41e82 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:44.279792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176006be-1e7c-4eb2-aa04-c1e56ae41e82 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:44.293014 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 408/819] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 06 23:20:44.293014 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836ccc8-cdbe-4671-ac82-c7a170f559a0 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:44.316752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 412/820] 10.222.0.60 () {60 vars in 1144 bytes} [Fri May 6 23:20:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:20:44.317874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176006be-1e7c-4eb2-aa04-c1e56ae41e82 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:44.419431 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836ccc8-cdbe-4671-ac82-c7a170f559a0 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:44.434690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176006be-1e7c-4eb2-aa04-c1e56ae41e82 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:44.467091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72dbbe-3ba9-4587-8da2-83e89e2d1853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:44.467769 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72dbbe-3ba9-4587-8da2-83e89e2d1853 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:44.468050 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72dbbe-3ba9-4587-8da2-83e89e2d1853 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:44.468326 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72dbbe-3ba9-4587-8da2-83e89e2d1853 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:44.469100 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72dbbe-3ba9-4587-8da2-83e89e2d1853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:44.469413 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72dbbe-3ba9-4587-8da2-83e89e2d1853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:44.470833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72dbbe-3ba9-4587-8da2-83e89e2d1853 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:44.474971 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315085eb-8bf8-4156-bfeb-757194856899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:44.475907 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315085eb-8bf8-4156-bfeb-757194856899 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:44.476377 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315085eb-8bf8-4156-bfeb-757194856899 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:44.476830 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315085eb-8bf8-4156-bfeb-757194856899 None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:44.477795 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315085eb-8bf8-4156-bfeb-757194856899 None admin] RBAC: Adding query filter params (name=network) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:44.478247 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315085eb-8bf8-4156-bfeb-757194856899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:44.479818 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315085eb-8bf8-4156-bfeb-757194856899 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:44.485506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 413/821] 10.222.0.60 () {56 vars in 1112 bytes} [Fri May 6 23:20:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:44.486591 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315085eb-8bf8-4156-bfeb-757194856899 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:44.488054 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 409/822] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:44.489925 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72dbbe-3ba9-4587-8da2-83e89e2d1853 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:44.597163 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315085eb-8bf8-4156-bfeb-757194856899 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:44.608766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72dbbe-3ba9-4587-8da2-83e89e2d1853 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:44.636850 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021b946-3a36-4f40-b234-b264f5973b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:44.637773 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021b946-3a36-4f40-b234-b264f5973b25 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:44.638058 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021b946-3a36-4f40-b234-b264f5973b25 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:44.638483 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021b946-3a36-4f40-b234-b264f5973b25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:44.646802 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8e834-eb03-49c2-b1eb-43f83a1693da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:44.648203 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8e834-eb03-49c2-b1eb-43f83a1693da None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:44.648614 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8e834-eb03-49c2-b1eb-43f83a1693da None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:44.648986 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8e834-eb03-49c2-b1eb-43f83a1693da None admin] PATH_INFO: `/v3/projects/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:44.652430 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021b946-3a36-4f40-b234-b264f5973b25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:44.654231 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021b946-3a36-4f40-b234-b264f5973b25 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:44.657910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8e834-eb03-49c2-b1eb-43f83a1693da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:44.659459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8e834-eb03-49c2-b1eb-43f83a1693da None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:44.672878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-7021b946-3a36-4f40-b234-b264f5973b25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:44.672878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:44.672878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:44.672878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:44.672878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:44.672878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:44.672878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:44.672878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:44.672878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:44.672878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:44.672878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:44.672878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:44.672878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:44.672878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:44.672878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:44.673960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:44.673960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:44.673960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:44.673960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:44.673960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:44.673960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:44.673960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:44.673960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:44.673960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:44.673960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:44.673960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:44.673960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:44.673960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:44.673960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:44.673960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:44.673960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:44.673960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:44.675036 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:44.675036 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:44.675036 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:44.675036 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:44.675036 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 414/823] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:44.679601 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021b946-3a36-4f40-b234-b264f5973b25 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:44.679728 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-9ca8e834-eb03-49c2-b1eb-43f83a1693da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:44.679728 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:44.679728 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:44.679728 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:44.679728 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:44.679728 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:44.679728 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:44.679728 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:44.679728 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:44.679728 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:44.679728 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:44.679728 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:44.679728 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:44.679728 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:44.679728 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:44.681246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:44.681246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:44.681246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:44.681246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:44.681246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:44.681246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:44.681246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:44.681246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:44.681246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:44.681246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:44.681246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:44.681246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:44.681246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:44.681246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:44.681246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:44.681246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:44.681246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:44.682536 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:44.682536 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:44.682536 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:44.682536 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:44.682536 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:44.682536 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:44.682536 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:44.682536 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:44.682536 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 410/824] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:44.683509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8e834-eb03-49c2-b1eb-43f83a1693da None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:44.796902 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021b946-3a36-4f40-b234-b264f5973b25 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:44.800964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8e834-eb03-49c2-b1eb-43f83a1693da None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:44.841494 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d770a-7a32-414e-bce3-c03d9ac54cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:44.842255 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d770a-7a32-414e-bce3-c03d9ac54cf5 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:44.842534 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d770a-7a32-414e-bce3-c03d9ac54cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:44.842805 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d770a-7a32-414e-bce3-c03d9ac54cf5 None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:44.843663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d770a-7a32-414e-bce3-c03d9ac54cf5 None admin] RBAC: Adding query filter params (type=network) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:44.843817 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d770a-7a32-414e-bce3-c03d9ac54cf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:44.845800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d770a-7a32-414e-bce3-c03d9ac54cf5 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:44.848618 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3972a6d-5503-411c-b351-54798f519cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:44.849496 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3972a6d-5503-411c-b351-54798f519cf7 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:44.849773 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3972a6d-5503-411c-b351-54798f519cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:44.850053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3972a6d-5503-411c-b351-54798f519cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:44.850771 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3972a6d-5503-411c-b351-54798f519cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:44.851070 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3972a6d-5503-411c-b351-54798f519cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:44.851332 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 415/825] 10.222.0.60 () {56 vars in 1112 bytes} [Fri May 6 23:20:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:44.852182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d770a-7a32-414e-bce3-c03d9ac54cf5 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:44.852582 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3972a6d-5503-411c-b351-54798f519cf7 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:44.865680 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 411/826] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:44.866503 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3972a6d-5503-411c-b351-54798f519cf7 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:44.970063 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3972a6d-5503-411c-b351-54798f519cf7 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:44.979037 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d770a-7a32-414e-bce3-c03d9ac54cf5 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:45.004394 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6575230-ba03-4b17-bae6-8bd682fef42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:45.005075 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6575230-ba03-4b17-bae6-8bd682fef42f None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:45.005354 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6575230-ba03-4b17-bae6-8bd682fef42f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:45.005627 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6575230-ba03-4b17-bae6-8bd682fef42f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:45.006370 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6575230-ba03-4b17-bae6-8bd682fef42f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:45.007802 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6575230-ba03-4b17-bae6-8bd682fef42f None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:45.020623 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a68d9-0419-4fa5-9be8-504b7f607e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:45.021414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a68d9-0419-4fa5-9be8-504b7f607e6a None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:45.021758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a68d9-0419-4fa5-9be8-504b7f607e6a None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:45.022032 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a68d9-0419-4fa5-9be8-504b7f607e6a None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:45.022816 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a68d9-0419-4fa5-9be8-504b7f607e6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:45.023219 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a68d9-0419-4fa5-9be8-504b7f607e6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:45.024826 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a68d9-0419-4fa5-9be8-504b7f607e6a None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:45.029703 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 412/827] 10.222.0.60 () {60 vars in 1144 bytes} [Fri May 6 23:20:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:20:45.030662 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6575230-ba03-4b17-bae6-8bd682fef42f None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:45.038173 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 416/828] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:45.044289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a68d9-0419-4fa5-9be8-504b7f607e6a None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:45.144498 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6575230-ba03-4b17-bae6-8bd682fef42f None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:45.151404 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a68d9-0419-4fa5-9be8-504b7f607e6a None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:45.180023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cae9c6-9730-409e-aff1-c3c1ee4568fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:45.180925 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cae9c6-9730-409e-aff1-c3c1ee4568fa None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:45.181204 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cae9c6-9730-409e-aff1-c3c1ee4568fa None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:45.181475 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cae9c6-9730-409e-aff1-c3c1ee4568fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:45.188080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542013f-a645-4166-a1a9-1032b25ea635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:45.189164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542013f-a645-4166-a1a9-1032b25ea635 None admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:45.189396 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cae9c6-9730-409e-aff1-c3c1ee4568fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:45.189636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542013f-a645-4166-a1a9-1032b25ea635 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:45.190004 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542013f-a645-4166-a1a9-1032b25ea635 None admin] PATH_INFO: `/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/d211582f9fc34b0e815e27db081c50c9/roles/71050e310414462b8d07f901fef201ad` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:45.191005 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cae9c6-9730-409e-aff1-c3c1ee4568fa None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:45.206533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-42cae9c6-9730-409e-aff1-c3c1ee4568fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:45.206533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:45.206533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:45.206533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:45.206533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:45.206533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:45.206533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:45.206533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:45.206533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:45.206533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:45.206533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:45.206533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:45.206533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:45.206533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:45.206533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:45.208335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:45.208335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:45.208335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:45.208335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:45.208335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:45.208335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:45.208335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:45.208335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:45.208335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:45.208335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:45.208335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:45.208335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:45.208335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:45.208335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:45.208335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:45.208335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:45.208335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:45.210433 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:45.210433 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:45.210433 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:45.210433 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:45.210433 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:45.210433 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:45.210433 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:45.210433 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:45.211452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542013f-a645-4166-a1a9-1032b25ea635 None admin] RBAC: Authorizing `identity:create_grant(project_id=4389eb256aba4b7182e33cb3720b1073, user_id=d211582f9fc34b0e815e27db081c50c9, role_id=71050e310414462b8d07f901fef201ad)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:45.211631 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 413/829] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:45.211815 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542013f-a645-4166-a1a9-1032b25ea635 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:45.219287 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cae9c6-9730-409e-aff1-c3c1ee4568fa None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:45.231364 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 417/830] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:20:45 2022] PUT /identity/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/d211582f9fc34b0e815e27db081c50c9/roles/71050e310414462b8d07f901fef201ad => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:20:45.381900 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cae9c6-9730-409e-aff1-c3c1ee4568fa None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:45.418316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f76ed-d85b-4486-a449-7b08496b761c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:45.418910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f76ed-d85b-4486-a449-7b08496b761c None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:45.419190 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f76ed-d85b-4486-a449-7b08496b761c None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:45.419463 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f76ed-d85b-4486-a449-7b08496b761c None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:45.420279 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f76ed-d85b-4486-a449-7b08496b761c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:45.420624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f76ed-d85b-4486-a449-7b08496b761c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:45.422092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f76ed-d85b-4486-a449-7b08496b761c None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:45.435772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 414/831] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:45.441222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542013f-a645-4166-a1a9-1032b25ea635 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:45.542555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542013f-a645-4166-a1a9-1032b25ea635 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:45.582290 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e3ef0-68a8-49ea-ae3b-03089b978110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:45.583132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3ef0-68a8-49ea-ae3b-03089b978110 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:45.583418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3ef0-68a8-49ea-ae3b-03089b978110 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:45.583693 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3ef0-68a8-49ea-ae3b-03089b978110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:45.584554 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e3ef0-68a8-49ea-ae3b-03089b978110 None admin] RBAC: Adding query filter params (role.id=408ee9a3a38640a48dbcdb2c377efcd8, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=9b74631c6e1547d991753a65c41bc7e7) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:45.584868 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e3ef0-68a8-49ea-ae3b-03089b978110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:45.586307 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e3ef0-68a8-49ea-ae3b-03089b978110 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:45.593442 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 418/832] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:20:45 2022] GET /identity/v3/role_assignments?user.id=9b74631c6e1547d991753a65c41bc7e7&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=408ee9a3a38640a48dbcdb2c377efcd8 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:46.142865 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312ebd3-9e34-471c-a8a2-be2570fd139c None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:46.143236 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312ebd3-9e34-471c-a8a2-be2570fd139c None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:46.143409 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312ebd3-9e34-471c-a8a2-be2570fd139c None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:46.144959 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 415/833] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:46.150949 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231052f-ded6-4287-ba32-96c6fcee0986 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:46.151236 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231052f-ded6-4287-ba32-96c6fcee0986 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:46.151512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231052f-ded6-4287-ba32-96c6fcee0986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:46.168302 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-9231052f-ded6-4287-ba32-96c6fcee0986 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:46.169534 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9231052f-ded6-4287-ba32-96c6fcee0986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:46.237773 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 419/834] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:20:46.262174 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312ebd3-9e34-471c-a8a2-be2570fd139c None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:46.362618 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312ebd3-9e34-471c-a8a2-be2570fd139c None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:46.401109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd31f1-6968-40bc-a606-94bee38f93ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:46.401838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd31f1-6968-40bc-a606-94bee38f93ea None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:46.402089 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd31f1-6968-40bc-a606-94bee38f93ea None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:46.402356 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd31f1-6968-40bc-a606-94bee38f93ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:46.412708 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd31f1-6968-40bc-a606-94bee38f93ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:46.420966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-19dd31f1-6968-40bc-a606-94bee38f93ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:20:46.420966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:46.420966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:46.420966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:46.420966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:46.420966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:46.420966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:46.420966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:46.420966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:46.420966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:46.420966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:46.420966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:46.420966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:46.420966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:46.420966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:46.420966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:46.423081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:46.423081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:46.423081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:46.423081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:46.423081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:46.423081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:46.423081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:46.423081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:46.423081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:46.423081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:46.423081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:46.423081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:46.423081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:46.423081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:46.423081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:46.423081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:46.425142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:46.425142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:46.425142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:46.425142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:46.425142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:46.425142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:46.425142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:46.425142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:46.425142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:46.425142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:46.425142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:20:46.425142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:46.425142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 416/835] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:20:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:46.432558 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231052f-ded6-4287-ba32-96c6fcee0986 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:46.530761 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231052f-ded6-4287-ba32-96c6fcee0986 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:46.564824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78458ac-b2eb-4ba7-85cf-37a6a5d2f6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:46.565493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78458ac-b2eb-4ba7-85cf-37a6a5d2f6d4 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:46.565777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78458ac-b2eb-4ba7-85cf-37a6a5d2f6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:46.566056 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78458ac-b2eb-4ba7-85cf-37a6a5d2f6d4 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:46.566813 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78458ac-b2eb-4ba7-85cf-37a6a5d2f6d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:46.567121 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78458ac-b2eb-4ba7-85cf-37a6a5d2f6d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:46.568499 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78458ac-b2eb-4ba7-85cf-37a6a5d2f6d4 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:46.577525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 420/836] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:20:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:46.583006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd31f1-6968-40bc-a606-94bee38f93ea None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:46.690457 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd31f1-6968-40bc-a606-94bee38f93ea None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:46.723648 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44201db-9520-44a2-8dd8-b13a6f923233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:46.724436 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44201db-9520-44a2-8dd8-b13a6f923233 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:46.724784 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44201db-9520-44a2-8dd8-b13a6f923233 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:46.725068 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44201db-9520-44a2-8dd8-b13a6f923233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:46.736153 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44201db-9520-44a2-8dd8-b13a6f923233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:46.737621 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44201db-9520-44a2-8dd8-b13a6f923233 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:46.754625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-b44201db-9520-44a2-8dd8-b13a6f923233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:46.754625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:46.754625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:46.754625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:46.754625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:46.754625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:46.754625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:46.754625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:46.754625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:46.754625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:46.754625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:46.754625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:46.754625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:46.754625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:46.754625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:46.755532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:46.755532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:46.755532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:46.755532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:46.755532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:46.755532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:46.755532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:46.755532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:46.755532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:46.755532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:46.755532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:46.755532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:46.755532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:46.755532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:46.755532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:46.755532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:46.755532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:46.756420 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:46.756420 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:46.756420 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:46.756420 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:46.756420 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 417/837] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:46.763000 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78458ac-b2eb-4ba7-85cf-37a6a5d2f6d4 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:46.782928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5420e0-8c7c-4c4d-b88b-b9be158c17b0 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:46.783202 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5420e0-8c7c-4c4d-b88b-b9be158c17b0 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:46.783481 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5420e0-8c7c-4c4d-b88b-b9be158c17b0 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:46.785133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 418/838] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:20:46.790060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cb7af-273b-44e8-b59f-a4c35a509029 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:46.790345 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cb7af-273b-44e8-b59f-a4c35a509029 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:46.790622 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cb7af-273b-44e8-b59f-a4c35a509029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:46.807609 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-9a6cb7af-273b-44e8-b59f-a4c35a509029 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:46.808857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-9a6cb7af-273b-44e8-b59f-a4c35a509029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:46.870294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78458ac-b2eb-4ba7-85cf-37a6a5d2f6d4 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:46.892672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 419/839] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:20:46.906153 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6cb7af-273b-44e8-b59f-a4c35a509029 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:46.909005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160e49b-9aef-4d43-80f7-a5f29ec23e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:46.909942 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160e49b-9aef-4d43-80f7-a5f29ec23e8a None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:46.910429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160e49b-9aef-4d43-80f7-a5f29ec23e8a None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:46.910899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160e49b-9aef-4d43-80f7-a5f29ec23e8a None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:46.911840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160e49b-9aef-4d43-80f7-a5f29ec23e8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:46.912350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160e49b-9aef-4d43-80f7-a5f29ec23e8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:46.913974 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160e49b-9aef-4d43-80f7-a5f29ec23e8a None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:46.927267 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 421/840] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:46.933433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160e49b-9aef-4d43-80f7-a5f29ec23e8a None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:47.010763 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6cb7af-273b-44e8-b59f-a4c35a509029 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:47.034834 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160e49b-9aef-4d43-80f7-a5f29ec23e8a None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:47.045777 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b54f44-25b0-4061-86d5-34cce0ddd511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:47.046893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b54f44-25b0-4061-86d5-34cce0ddd511 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:47.047404 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b54f44-25b0-4061-86d5-34cce0ddd511 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:47.047880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b54f44-25b0-4061-86d5-34cce0ddd511 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:47.048798 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b54f44-25b0-4061-86d5-34cce0ddd511 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:47.050396 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b54f44-25b0-4061-86d5-34cce0ddd511 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:47.063015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-f8b54f44-25b0-4061-86d5-34cce0ddd511 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 06 23:20:47.063015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:47.063015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:20:47.063015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:20:47.063015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:20:47.063015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:20:47.063015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:20:47.063015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:47.063015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 06 23:20:47.063015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:47.063015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:20:47.063015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:47.063015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:47.063015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:47.063015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:47.063015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:47.063015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:47.064080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:47.064080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:47.064080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:47.064080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:47.064080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:47.064080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:47.064080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:20:47.064080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:20:47.064080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:20:47.064080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:20:47.064080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:47.064080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:47.064080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:47.064080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:47.064080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:47.064080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:47.064931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:47.064931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:47.064931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:47.064931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:47.064931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:47.064931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:47.064931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:47.064931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:47.064931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:47.064931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:47.064931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:20:47.064931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:47.064931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 06 23:20:47.064931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:47.066993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 420/841] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:20:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:47.072701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b54f44-25b0-4061-86d5-34cce0ddd511 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:47.074776 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24e879-89f6-4af1-b76e-73c1c1d82e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:47.075818 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24e879-89f6-4af1-b76e-73c1c1d82e69 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:47.076940 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24e879-89f6-4af1-b76e-73c1c1d82e69 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:47.077223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24e879-89f6-4af1-b76e-73c1c1d82e69 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:47.084934 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24e879-89f6-4af1-b76e-73c1c1d82e69 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:47.087226 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24e879-89f6-4af1-b76e-73c1c1d82e69 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:47.102412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-bf24e879-89f6-4af1-b76e-73c1c1d82e69 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 06 23:20:47.102412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:47.102412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:47.102412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:47.102412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:47.102412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:47.102412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:47.102412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:47.102412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:47.102412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:47.102412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:47.102412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:47.102412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:47.102412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:47.102412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:47.102412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:47.103379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:47.103379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:47.103379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:47.103379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:47.103379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:47.103379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:47.103379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:47.103379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:47.103379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:47.103379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:47.103379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:47.103379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:47.103379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:47.103379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:47.103379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:47.103379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:47.103379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:47.103379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:47.104304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:47.104304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:47.104304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:47.104304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:47.104304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:47.104304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:47.104304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:47.104304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:47.104304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 06 23:20:47.104304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:47.108382 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 422/842] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:20:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:47.109220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24e879-89f6-4af1-b76e-73c1c1d82e69 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:47.186298 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b54f44-25b0-4061-86d5-34cce0ddd511 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:47.217339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24e879-89f6-4af1-b76e-73c1c1d82e69 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:47.219309 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f0212-9e54-48d2-b09e-93415efb18ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:47.220022 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f0212-9e54-48d2-b09e-93415efb18ba None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:47.220303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f0212-9e54-48d2-b09e-93415efb18ba None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:47.221260 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f0212-9e54-48d2-b09e-93415efb18ba None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:47.221370 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f0212-9e54-48d2-b09e-93415efb18ba None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:47.221597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f0212-9e54-48d2-b09e-93415efb18ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:47.222966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f0212-9e54-48d2-b09e-93415efb18ba None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:47.229176 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 421/843] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:20:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:47.234079 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f0212-9e54-48d2-b09e-93415efb18ba None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:47.260566 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dea25-8038-4ac1-8480-253b59b008ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:47.261688 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dea25-8038-4ac1-8480-253b59b008ca None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:47.262171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dea25-8038-4ac1-8480-253b59b008ca None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:47.262657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dea25-8038-4ac1-8480-253b59b008ca None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:47.263963 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27dea25-8038-4ac1-8480-253b59b008ca None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:47.264482 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27dea25-8038-4ac1-8480-253b59b008ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:47.266197 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27dea25-8038-4ac1-8480-253b59b008ca None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:47.289252 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 423/844] 10.222.0.60 () {56 vars in 1135 bytes} [Fri May 6 23:20:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:47.290966 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dea25-8038-4ac1-8480-253b59b008ca None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:47.335056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f0212-9e54-48d2-b09e-93415efb18ba None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:47.369319 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb1b11-fe30-49b0-b933-04b9fcc2e1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:47.369982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb1b11-fe30-49b0-b933-04b9fcc2e1ed None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:47.370261 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb1b11-fe30-49b0-b933-04b9fcc2e1ed None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:47.370530 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb1b11-fe30-49b0-b933-04b9fcc2e1ed None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:47.371255 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb1b11-fe30-49b0-b933-04b9fcc2e1ed None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:47.371697 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb1b11-fe30-49b0-b933-04b9fcc2e1ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:47.372916 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb1b11-fe30-49b0-b933-04b9fcc2e1ed None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:47.384812 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 422/845] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:20:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:47.401760 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dea25-8038-4ac1-8480-253b59b008ca None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:47.437996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c39438-835b-4c0d-9f37-ad24e64e6ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:47.438665 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c39438-835b-4c0d-9f37-ad24e64e6ba4 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:47.438942 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c39438-835b-4c0d-9f37-ad24e64e6ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:47.439212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c39438-835b-4c0d-9f37-ad24e64e6ba4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:47.517339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c39438-835b-4c0d-9f37-ad24e64e6ba4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:47.519154 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c39438-835b-4c0d-9f37-ad24e64e6ba4 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:47.628668 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 424/846] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:47 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 06 23:20:47.630937 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb1b11-fe30-49b0-b933-04b9fcc2e1ed None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:47.638816 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff8534-13a7-47d2-be1e-c5638b33e86b None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:47.639104 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff8534-13a7-47d2-be1e-c5638b33e86b None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:47.639385 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff8534-13a7-47d2-be1e-c5638b33e86b None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:47.642105 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 425/847] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:20:47.646057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b78a6-326a-41e7-a500-ce6d414fbf55 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:47.646344 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b78a6-326a-41e7-a500-ce6d414fbf55 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:47.646615 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b78a6-326a-41e7-a500-ce6d414fbf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:47.665368 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-0c5b78a6-326a-41e7-a500-ce6d414fbf55 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:47.666749 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-0c5b78a6-326a-41e7-a500-ce6d414fbf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:47.736731 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 426/848] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:20:47.753880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb1b11-fe30-49b0-b933-04b9fcc2e1ed None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:47.758807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b78a6-326a-41e7-a500-ce6d414fbf55 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:47.799428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a4880-9450-46f9-ab85-672832ae0b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:47.800646 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a4880-9450-46f9-ab85-672832ae0b99 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:47.801808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a4880-9450-46f9-ab85-672832ae0b99 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:47.802349 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a4880-9450-46f9-ab85-672832ae0b99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:47.818627 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a4880-9450-46f9-ab85-672832ae0b99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:47.821241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a4880-9450-46f9-ab85-672832ae0b99 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:47.845223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-e69a4880-9450-46f9-ab85-672832ae0b99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:47.845223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:47.845223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:47.845223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:47.845223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:47.845223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:47.845223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:47.845223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:47.845223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:47.845223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:47.845223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:47.845223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:47.845223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:47.845223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:47.845223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:47.846105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:47.846105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:47.846105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:47.846105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:47.846105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:47.846105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:47.846105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:47.846105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:47.846105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:47.846105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:47.846105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:47.846105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:47.846105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:47.846105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:47.846105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:47.846105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:47.846105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:47.847036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:47.847036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:47.847036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:47.847036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:47.851238 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 423/849] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:47.853444 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a4880-9450-46f9-ab85-672832ae0b99 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:47.881386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b78a6-326a-41e7-a500-ce6d414fbf55 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:47.924463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183b9c8-660e-41dc-8d13-846ad8ad93bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:47.925532 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183b9c8-660e-41dc-8d13-846ad8ad93bb None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:47.925962 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183b9c8-660e-41dc-8d13-846ad8ad93bb None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:47.926371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183b9c8-660e-41dc-8d13-846ad8ad93bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:47.940337 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183b9c8-660e-41dc-8d13-846ad8ad93bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:47.949287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-6183b9c8-660e-41dc-8d13-846ad8ad93bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:47.949287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:47.949287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:47.949287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:47.949287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:47.949287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:47.949287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:47.949287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:47.949287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:47.949287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:47.949287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:47.949287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:47.949287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:47.949287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:47.949287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:47.949287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:47.950402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:47.950402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:47.950402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:47.950402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:47.950402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:47.950402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:47.950402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:47.950402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:47.950402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:47.950402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:47.950402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:47.950402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:47.950402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:47.950402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:47.950402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:47.950402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:47.951433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:47.951433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:47.951433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:47.951433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:47.951433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:47.951433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:47.951433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:47.951433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:47.951433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:47.951433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:47.951433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:20:47.951433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:47.957758 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a4880-9450-46f9-ab85-672832ae0b99 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:47.958434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 427/850] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:20:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:47.959788 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183b9c8-660e-41dc-8d13-846ad8ad93bb None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:47.996957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9867c-d35d-4775-a230-9d0fedc0600b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:47.997631 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9867c-d35d-4775-a230-9d0fedc0600b None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:47.997909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9867c-d35d-4775-a230-9d0fedc0600b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:47.998259 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9867c-d35d-4775-a230-9d0fedc0600b None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:47.998901 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9867c-d35d-4775-a230-9d0fedc0600b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:47.999207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9867c-d35d-4775-a230-9d0fedc0600b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:48.000607 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9867c-d35d-4775-a230-9d0fedc0600b None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:48.016727 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 424/851] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:48.016727 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00078d99-11d7-4445-9d00-3bde5e4fd7ca None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:48.016727 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00078d99-11d7-4445-9d00-3bde5e4fd7ca None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:48.016727 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00078d99-11d7-4445-9d00-3bde5e4fd7ca None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:48.016727 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 425/852] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:48.019969 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00078d99-11d7-4445-9d00-3bde5e4fd7ca None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:48.074655 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183b9c8-660e-41dc-8d13-846ad8ad93bb None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:48.110215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8336778-5dab-4382-922c-e822ab77f61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:48.111212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8336778-5dab-4382-922c-e822ab77f61a None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:48.111562 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8336778-5dab-4382-922c-e822ab77f61a None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:48.111905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8336778-5dab-4382-922c-e822ab77f61a None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:48.112775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8336778-5dab-4382-922c-e822ab77f61a None admin] RBAC: Adding query filter params (name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:48.113156 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8336778-5dab-4382-922c-e822ab77f61a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:48.114546 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8336778-5dab-4382-922c-e822ab77f61a None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:48.117720 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00078d99-11d7-4445-9d00-3bde5e4fd7ca None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:48.123630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 428/853] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:20:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:48.124990 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f88e1-87ff-4e8a-b7fa-471eccf80c6c None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:48.125277 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f88e1-87ff-4e8a-b7fa-471eccf80c6c None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:48.125552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f88e1-87ff-4e8a-b7fa-471eccf80c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:48.142894 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-2c6f88e1-87ff-4e8a-b7fa-471eccf80c6c None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:48.144065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-2c6f88e1-87ff-4e8a-b7fa-471eccf80c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:48.154263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8219d-ebff-441c-b94b-8a6cd2e03511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:48.155300 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8219d-ebff-441c-b94b-8a6cd2e03511 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:48.155750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8219d-ebff-441c-b94b-8a6cd2e03511 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:48.156168 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8219d-ebff-441c-b94b-8a6cd2e03511 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:48.163198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8219d-ebff-441c-b94b-8a6cd2e03511 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:48.165383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8219d-ebff-441c-b94b-8a6cd2e03511 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:48.179303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-dcd8219d-ebff-441c-b94b-8a6cd2e03511 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:48.179303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:48.179303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:48.179303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:48.179303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:48.179303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:48.179303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:48.179303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:48.179303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:48.179303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:48.179303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:48.179303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:48.179303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:48.179303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:48.179303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:48.180443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:48.180443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:48.180443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:48.180443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:48.180443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:48.180443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:48.180443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:48.180443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:48.180443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:48.180443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:48.180443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:48.180443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:48.180443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:48.180443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:48.180443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:48.180443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:48.180443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:48.181398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:48.181398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:48.181398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:48.181398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:48.181398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:48.181398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:48.181398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:48.181398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:48.182224 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 426/854] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:48.183029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8219d-ebff-441c-b94b-8a6cd2e03511 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:48.216579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 429/855] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:20:48.216579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f88e1-87ff-4e8a-b7fa-471eccf80c6c None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:48.287088 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8219d-ebff-441c-b94b-8a6cd2e03511 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:48.325330 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d6ef0-23b8-4a4b-bbf1-5513182cc9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:48.326554 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d6ef0-23b8-4a4b-bbf1-5513182cc9cb None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:48.327042 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d6ef0-23b8-4a4b-bbf1-5513182cc9cb None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:48.327487 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d6ef0-23b8-4a4b-bbf1-5513182cc9cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:48.331491 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f88e1-87ff-4e8a-b7fa-471eccf80c6c None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:48.338844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d6ef0-23b8-4a4b-bbf1-5513182cc9cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:48.341012 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d6ef0-23b8-4a4b-bbf1-5513182cc9cb None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:48.359556 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-dd8d6ef0-23b8-4a4b-bbf1-5513182cc9cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:48.359556 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:48.359556 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:48.359556 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:48.359556 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:48.359556 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:48.359556 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:48.359556 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:48.359556 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:48.359556 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:48.359556 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:48.359556 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:48.359556 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:48.359556 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:48.359556 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:48.360459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:48.360459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:48.360459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:48.360459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:48.360459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:48.360459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:48.360459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:48.360459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:48.360459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:48.360459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:48.360459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:48.360459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:48.360459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:48.360459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:48.360459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:48.360459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:48.360459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:48.361415 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:48.361415 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:48.361415 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:48.361415 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:48.361415 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 427/856] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:48.361696 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d6ef0-23b8-4a4b-bbf1-5513182cc9cb None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:48.371159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c461dee-6f3e-46a7-8935-9a168d6c8e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:48.371816 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c461dee-6f3e-46a7-8935-9a168d6c8e40 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:48.372095 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c461dee-6f3e-46a7-8935-9a168d6c8e40 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:48.372368 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c461dee-6f3e-46a7-8935-9a168d6c8e40 None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:48.373179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c461dee-6f3e-46a7-8935-9a168d6c8e40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:48.373485 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c461dee-6f3e-46a7-8935-9a168d6c8e40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:48.374908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c461dee-6f3e-46a7-8935-9a168d6c8e40 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:48.391341 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 430/857] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:48.391341 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c461dee-6f3e-46a7-8935-9a168d6c8e40 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:48.467225 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d6ef0-23b8-4a4b-bbf1-5513182cc9cb None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:48.482368 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c461dee-6f3e-46a7-8935-9a168d6c8e40 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:48.501306 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3345e7-03b9-4ac8-b42e-c78c4e0e3adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:48.502115 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3345e7-03b9-4ac8-b42e-c78c4e0e3adc None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:48.502396 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3345e7-03b9-4ac8-b42e-c78c4e0e3adc None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:48.502672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3345e7-03b9-4ac8-b42e-c78c4e0e3adc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:48.503325 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3345e7-03b9-4ac8-b42e-c78c4e0e3adc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:48.504720 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3345e7-03b9-4ac8-b42e-c78c4e0e3adc None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:48.515116 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd52b56-7293-4f2c-b496-dab16c6a9405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:48.515764 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd52b56-7293-4f2c-b496-dab16c6a9405 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:48.516043 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd52b56-7293-4f2c-b496-dab16c6a9405 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:48.516312 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd52b56-7293-4f2c-b496-dab16c6a9405 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:48.516744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-9b3345e7-03b9-4ac8-b42e-c78c4e0e3adc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 06 23:20:48.516744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:48.516744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:20:48.516744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:20:48.516744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:20:48.516744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:20:48.516744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:20:48.516744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:48.516744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 06 23:20:48.516744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:48.516744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:20:48.516744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:48.516744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:48.516744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:48.516744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:48.516744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:48.517665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:48.517665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:48.517665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:48.517665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:48.517665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:48.517665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:48.517665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:48.517665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:20:48.517665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:20:48.517665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:20:48.517665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:20:48.517665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:48.517665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:48.517665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:48.517665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:48.517665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:48.523994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:48.523994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:48.523994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:48.523994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:48.523994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:48.523994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:48.523994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:48.523994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:48.523994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:48.523994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:48.523994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:48.523994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:20:48.523994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:48.523994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 06 23:20:48.523994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:48.525582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd52b56-7293-4f2c-b496-dab16c6a9405 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:48.525582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd52b56-7293-4f2c-b496-dab16c6a9405 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:48.525725 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 428/858] 10.222.0.60 () {56 vars in 1132 bytes} [Fri May 6 23:20:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:48.526050 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd52b56-7293-4f2c-b496-dab16c6a9405 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:48.526210 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3345e7-03b9-4ac8-b42e-c78c4e0e3adc None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:48.536389 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 431/859] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:48.536389 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd52b56-7293-4f2c-b496-dab16c6a9405 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:48.626430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3345e7-03b9-4ac8-b42e-c78c4e0e3adc None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:48.633954 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd52b56-7293-4f2c-b496-dab16c6a9405 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:48.668300 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0e856-5441-4b40-8215-a3d839346ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:48.669021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0e856-5441-4b40-8215-a3d839346ed1 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:48.669262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0e856-5441-4b40-8215-a3d839346ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:48.669524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0e856-5441-4b40-8215-a3d839346ed1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:48.670357 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0e856-5441-4b40-8215-a3d839346ed1 None admin] RBAC: Adding query filter params (role.id=408ee9a3a38640a48dbcdb2c377efcd8, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=48b3ec57aee94b87889d578e114fa0db) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:48.670474 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5230b1a-f20c-4611-b6f8-873bec036105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:48.670671 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0e856-5441-4b40-8215-a3d839346ed1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:48.671038 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5230b1a-f20c-4611-b6f8-873bec036105 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:48.671314 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5230b1a-f20c-4611-b6f8-873bec036105 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:48.671583 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5230b1a-f20c-4611-b6f8-873bec036105 None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:48.672094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0e856-5441-4b40-8215-a3d839346ed1 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:48.672278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5230b1a-f20c-4611-b6f8-873bec036105 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:48.672594 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5230b1a-f20c-4611-b6f8-873bec036105 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:48.673945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5230b1a-f20c-4611-b6f8-873bec036105 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:48.683023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 429/860] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:20:48 2022] GET /identity/v3/role_assignments?user.id=48b3ec57aee94b87889d578e114fa0db&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=408ee9a3a38640a48dbcdb2c377efcd8 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:48.683023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0e856-5441-4b40-8215-a3d839346ed1 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:48.683260 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 432/861] 10.222.0.60 () {56 vars in 1126 bytes} [Fri May 6 23:20:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:48.688660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5230b1a-f20c-4611-b6f8-873bec036105 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:48.786609 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0e856-5441-4b40-8215-a3d839346ed1 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:48.816862 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5230b1a-f20c-4611-b6f8-873bec036105 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:48.820804 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313af95b-4a03-4879-b102-c02166439c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:48.822160 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313af95b-4a03-4879-b102-c02166439c3e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:48.822440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313af95b-4a03-4879-b102-c02166439c3e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:48.822714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313af95b-4a03-4879-b102-c02166439c3e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:48.835497 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313af95b-4a03-4879-b102-c02166439c3e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:48.837575 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313af95b-4a03-4879-b102-c02166439c3e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:48.860836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-313af95b-4a03-4879-b102-c02166439c3e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 06 23:20:48.860836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:48.860836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:48.860836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:48.860836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:48.860836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:48.860836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:48.860836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:48.860836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:48.860836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:48.860836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:48.860836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:48.860836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:48.860836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:48.860836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:48.860836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:48.861857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:48.861857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:48.861857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:48.861857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:48.861857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:48.861857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:48.861857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:48.861857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:48.861857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:48.861857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:48.861857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:48.861857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:48.861857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:48.861857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:48.861857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:48.861857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:48.861857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:48.861857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:48.862793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:48.862793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:48.862793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:48.862793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:48.862793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:48.862793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:48.862793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:48.862793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:48.862793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 06 23:20:48.862793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:48.863314 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3009f-e40c-405c-a95b-2a2ab9ca5afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:48.863314 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3009f-e40c-405c-a95b-2a2ab9ca5afd None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:48.863314 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3009f-e40c-405c-a95b-2a2ab9ca5afd None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:48.863314 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3009f-e40c-405c-a95b-2a2ab9ca5afd None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:48.863579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3009f-e40c-405c-a95b-2a2ab9ca5afd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:48.864226 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3009f-e40c-405c-a95b-2a2ab9ca5afd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:48.865329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3009f-e40c-405c-a95b-2a2ab9ca5afd None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:48.866335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 430/862] 10.222.0.60 () {56 vars in 1117 bytes} [Fri May 6 23:20:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:48.872081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313af95b-4a03-4879-b102-c02166439c3e None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:48.875887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 433/863] 10.222.0.60 () {56 vars in 1126 bytes} [Fri May 6 23:20:48 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:48.991054 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313af95b-4a03-4879-b102-c02166439c3e None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:49.027345 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9f006-faac-4e49-b702-43f813b75f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:49.028336 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9f006-faac-4e49-b702-43f813b75f02 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:49.028825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9f006-faac-4e49-b702-43f813b75f02 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:49.029273 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9f006-faac-4e49-b702-43f813b75f02 None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:49.030330 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9f006-faac-4e49-b702-43f813b75f02 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:49.030827 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9f006-faac-4e49-b702-43f813b75f02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:49.032473 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9f006-faac-4e49-b702-43f813b75f02 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:49.052614 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 431/864] 10.222.0.60 () {56 vars in 1149 bytes} [Fri May 6 23:20:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:49.060794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3009f-e40c-405c-a95b-2a2ab9ca5afd None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:49.161202 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3009f-e40c-405c-a95b-2a2ab9ca5afd None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:49.195470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bba8c-13c2-45ed-83cb-d6f86f249a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:49.196200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bba8c-13c2-45ed-83cb-d6f86f249a44 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:49.196477 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bba8c-13c2-45ed-83cb-d6f86f249a44 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:49.196776 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bba8c-13c2-45ed-83cb-d6f86f249a44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:49.266138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bba8c-13c2-45ed-83cb-d6f86f249a44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:49.267552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bba8c-13c2-45ed-83cb-d6f86f249a44 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:49.369019 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 434/865] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:49 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 06 23:20:49.374147 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9f006-faac-4e49-b702-43f813b75f02 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:49.478289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9f006-faac-4e49-b702-43f813b75f02 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:49.513142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74fe80-6b5f-45bf-a54a-f5db719c1e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:49.513933 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74fe80-6b5f-45bf-a54a-f5db719c1e5a None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:49.514209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74fe80-6b5f-45bf-a54a-f5db719c1e5a None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:49.514478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74fe80-6b5f-45bf-a54a-f5db719c1e5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:49.524999 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74fe80-6b5f-45bf-a54a-f5db719c1e5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:49.526456 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74fe80-6b5f-45bf-a54a-f5db719c1e5a None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:49.544598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-0b74fe80-6b5f-45bf-a54a-f5db719c1e5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:49.544598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:49.544598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:49.544598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:49.544598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:49.544598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:49.544598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:49.544598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:49.544598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:49.544598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:49.544598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:49.544598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:49.544598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:49.544598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:49.544598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:49.545517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:49.545517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:49.545517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:49.545517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:49.545517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:49.545517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:49.545517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:49.545517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:49.545517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:49.545517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:49.545517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:49.545517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:49.545517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:49.545517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:49.545517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:49.545517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:49.545517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:49.546405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:49.546405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:49.546405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:49.546405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:49.546405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 432/866] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:49.551319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bba8c-13c2-45ed-83cb-d6f86f249a44 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:49.647783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283e1c8-8683-4b22-bb66-d24c226ea58e None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:49.648142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283e1c8-8683-4b22-bb66-d24c226ea58e None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:49.648489 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283e1c8-8683-4b22-bb66-d24c226ea58e None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:49.650152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 433/867] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:49.655278 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37260a17-39b2-4424-8d0d-d96b636b2f78 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:49.655559 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37260a17-39b2-4424-8d0d-d96b636b2f78 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:49.655830 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37260a17-39b2-4424-8d0d-d96b636b2f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:49.658411 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bba8c-13c2-45ed-83cb-d6f86f249a44 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:49.673836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-37260a17-39b2-4424-8d0d-d96b636b2f78 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:49.675011 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-37260a17-39b2-4424-8d0d-d96b636b2f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:49.694137 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664657f-a0f5-4ffc-be3c-131975d9012a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:49.695124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664657f-a0f5-4ffc-be3c-131975d9012a None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:49.695598 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664657f-a0f5-4ffc-be3c-131975d9012a None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:49.696616 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664657f-a0f5-4ffc-be3c-131975d9012a None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:49.697576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664657f-a0f5-4ffc-be3c-131975d9012a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:49.698074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664657f-a0f5-4ffc-be3c-131975d9012a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:49.699628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664657f-a0f5-4ffc-be3c-131975d9012a None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:49.711658 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 435/868] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:49.716891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664657f-a0f5-4ffc-be3c-131975d9012a None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:49.755055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 434/869] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:20:49.777034 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37260a17-39b2-4424-8d0d-d96b636b2f78 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:49.831801 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664657f-a0f5-4ffc-be3c-131975d9012a None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:49.874589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4c070-ab2f-46b0-9258-d4d6387cba37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:49.875729 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4c070-ab2f-46b0-9258-d4d6387cba37 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:49.876008 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4c070-ab2f-46b0-9258-d4d6387cba37 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:49.876279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4c070-ab2f-46b0-9258-d4d6387cba37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:49.884255 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4c070-ab2f-46b0-9258-d4d6387cba37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:49.886190 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4c070-ab2f-46b0-9258-d4d6387cba37 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:49.895626 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37260a17-39b2-4424-8d0d-d96b636b2f78 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:49.906794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-25c4c070-ab2f-46b0-9258-d4d6387cba37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:49.906794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:49.906794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:49.906794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:49.906794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:49.906794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:49.906794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:49.906794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:49.906794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:49.906794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:49.906794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:49.906794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:49.906794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:49.906794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:49.906794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:49.907657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:49.907657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:49.907657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:49.907657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:49.907657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:49.907657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:49.907657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:49.907657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:49.907657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:49.907657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:49.907657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:49.907657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:49.907657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:49.907657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:49.907657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:49.907657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:49.907657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:49.908573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:49.908573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:49.908573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:49.908573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:49.908573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:49.908573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:49.908573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:49.908573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:49.914426 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 436/870] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:49.915286 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4c070-ab2f-46b0-9258-d4d6387cba37 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:49.940182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee4374-9d83-43f8-ba5d-d6807e369bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:49.940182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee4374-9d83-43f8-ba5d-d6807e369bf4 None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:49.940182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee4374-9d83-43f8-ba5d-d6807e369bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:49.940182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee4374-9d83-43f8-ba5d-d6807e369bf4 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:49.940850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee4374-9d83-43f8-ba5d-d6807e369bf4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:49.942278 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee4374-9d83-43f8-ba5d-d6807e369bf4 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:49.968587 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 435/871] 10.222.0.60 () {60 vars in 1141 bytes} [Fri May 6 23:20:49 2022] POST /identity/v3/services => generated 251 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:20:50.054843 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4c070-ab2f-46b0-9258-d4d6387cba37 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:50.099257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0de162-6b1f-4697-b375-a02b535e0098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:50.099915 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0de162-6b1f-4697-b375-a02b535e0098 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:50.100191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0de162-6b1f-4697-b375-a02b535e0098 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:50.100456 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0de162-6b1f-4697-b375-a02b535e0098 None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:50.101376 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0de162-6b1f-4697-b375-a02b535e0098 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:50.101681 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0de162-6b1f-4697-b375-a02b535e0098 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:50.103339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0de162-6b1f-4697-b375-a02b535e0098 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:50.116820 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 437/872] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:50.122754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee4374-9d83-43f8-ba5d-d6807e369bf4 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:50.231630 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee4374-9d83-43f8-ba5d-d6807e369bf4 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:50.269816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c25b13-bd6e-43a7-bb29-1de2bb780b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:50.271452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c25b13-bd6e-43a7-bb29-1de2bb780b82 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:50.272219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c25b13-bd6e-43a7-bb29-1de2bb780b82 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:50.272741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c25b13-bd6e-43a7-bb29-1de2bb780b82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:50.274805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c25b13-bd6e-43a7-bb29-1de2bb780b82 None admin] RBAC: Adding query filter params (role.id=71050e310414462b8d07f901fef201ad, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=d211582f9fc34b0e815e27db081c50c9) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:50.275328 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c25b13-bd6e-43a7-bb29-1de2bb780b82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:50.277604 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c25b13-bd6e-43a7-bb29-1de2bb780b82 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:50.285891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 436/873] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:20:50 2022] GET /identity/v3/role_assignments?user.id=d211582f9fc34b0e815e27db081c50c9&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=71050e310414462b8d07f901fef201ad => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:51.134225 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e57bf-622f-4b1d-ac48-4ac335fd35c7 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:51.134712 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e57bf-622f-4b1d-ac48-4ac335fd35c7 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:51.134712 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e57bf-622f-4b1d-ac48-4ac335fd35c7 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:51.136295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 438/874] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:51.141860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc38c5b-22a0-409c-982f-af9ccbfdeeb5 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:51.142280 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc38c5b-22a0-409c-982f-af9ccbfdeeb5 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:51.142460 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc38c5b-22a0-409c-982f-af9ccbfdeeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:51.155626 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c6c00-23ed-4b4e-bcc2-695a0fdea9b5 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:51.155952 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c6c00-23ed-4b4e-bcc2-695a0fdea9b5 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:51.156163 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c6c00-23ed-4b4e-bcc2-695a0fdea9b5 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:51.157965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 439/875] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:20:51.163062 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-ccc38c5b-22a0-409c-982f-af9ccbfdeeb5 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:51.166768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d99f0f-a61b-4474-b5d6-493d2254dcec None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:51.167057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d99f0f-a61b-4474-b5d6-493d2254dcec None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:51.167320 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d99f0f-a61b-4474-b5d6-493d2254dcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:51.167679 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-ccc38c5b-22a0-409c-982f-af9ccbfdeeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:51.185743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-c3d99f0f-a61b-4474-b5d6-493d2254dcec None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:51.187383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c3d99f0f-a61b-4474-b5d6-493d2254dcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:51.244642 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 437/876] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:51 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:20:51.262301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc38c5b-22a0-409c-982f-af9ccbfdeeb5 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:51.268587 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 440/877] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:51 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:20:51.291028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d99f0f-a61b-4474-b5d6-493d2254dcec None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:51.366973 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc38c5b-22a0-409c-982f-af9ccbfdeeb5 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:51.402981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c424df6-cb77-443a-a088-6dcf789dbfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:51.404101 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c424df6-cb77-443a-a088-6dcf789dbfe7 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:51.404648 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c424df6-cb77-443a-a088-6dcf789dbfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:51.405183 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c424df6-cb77-443a-a088-6dcf789dbfe7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:51.406035 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c424df6-cb77-443a-a088-6dcf789dbfe7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:51.407605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c424df6-cb77-443a-a088-6dcf789dbfe7 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:51.410139 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d99f0f-a61b-4474-b5d6-493d2254dcec None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:51.419743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-8c424df6-cb77-443a-a088-6dcf789dbfe7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 06 23:20:51.419743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:51.419743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:20:51.419743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:20:51.419743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:20:51.419743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:20:51.419743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:20:51.419743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:51.419743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 06 23:20:51.419743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:51.419743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:20:51.419743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:51.419743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:51.419743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:51.419743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:51.419743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:51.419743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:51.420756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:51.420756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:51.420756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:51.420756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:51.420756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:51.420756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:51.420756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:20:51.420756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:20:51.420756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:20:51.420756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:20:51.420756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:51.420756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:51.420756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:51.420756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:51.420756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:51.420756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:51.421599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:51.421599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:51.421599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:51.421599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:51.421599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:51.421599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:51.421599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:51.421599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:51.421599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:51.421599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:51.421599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:20:51.421599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:51.421599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 06 23:20:51.421599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:51.429113 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 438/878] 10.222.0.60 () {56 vars in 1126 bytes} [Fri May 6 23:20:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:51.431133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c424df6-cb77-443a-a088-6dcf789dbfe7 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:51.447431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0891ed0-3e52-43fc-b2d2-c7a75f580a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:51.448364 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0891ed0-3e52-43fc-b2d2-c7a75f580a56 None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:51.448695 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0891ed0-3e52-43fc-b2d2-c7a75f580a56 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:51.448973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0891ed0-3e52-43fc-b2d2-c7a75f580a56 None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:51.449704 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0891ed0-3e52-43fc-b2d2-c7a75f580a56 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:51.451516 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0891ed0-3e52-43fc-b2d2-c7a75f580a56 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:51.480573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 441/879] 10.222.0.60 () {60 vars in 1141 bytes} [Fri May 6 23:20:51 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:20:51.549251 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c424df6-cb77-443a-a088-6dcf789dbfe7 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:51.594171 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a199b6-1ba1-4685-9c3a-bc2d99f2e689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:51.594845 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a199b6-1ba1-4685-9c3a-bc2d99f2e689 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:51.595181 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a199b6-1ba1-4685-9c3a-bc2d99f2e689 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:51.595464 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a199b6-1ba1-4685-9c3a-bc2d99f2e689 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:51.596177 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a199b6-1ba1-4685-9c3a-bc2d99f2e689 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:51.596484 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a199b6-1ba1-4685-9c3a-bc2d99f2e689 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:51.597903 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a199b6-1ba1-4685-9c3a-bc2d99f2e689 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:51.603745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 439/880] 10.222.0.60 () {56 vars in 1122 bytes} [Fri May 6 23:20:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:51.613750 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0891ed0-3e52-43fc-b2d2-c7a75f580a56 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:51.718366 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0891ed0-3e52-43fc-b2d2-c7a75f580a56 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:51.751395 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb0e0e-a137-4f5c-b03d-5498acfd9797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:51.752057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb0e0e-a137-4f5c-b03d-5498acfd9797 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:51.752338 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb0e0e-a137-4f5c-b03d-5498acfd9797 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:51.752640 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb0e0e-a137-4f5c-b03d-5498acfd9797 None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:51.753350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb0e0e-a137-4f5c-b03d-5498acfd9797 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:51.753651 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb0e0e-a137-4f5c-b03d-5498acfd9797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:51.755020 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb0e0e-a137-4f5c-b03d-5498acfd9797 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:51.759981 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 442/881] 10.222.0.60 () {56 vars in 1122 bytes} [Fri May 6 23:20:51 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:52.320439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea519c7d-0f4a-42ca-bbca-cc26a33c6938 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:52.322052 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea519c7d-0f4a-42ca-bbca-cc26a33c6938 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:52.322535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea519c7d-0f4a-42ca-bbca-cc26a33c6938 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:52.324403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 440/882] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:20:52.330531 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d4ffe-23d3-451d-a13b-95576fa350c4 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:52.331394 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d4ffe-23d3-451d-a13b-95576fa350c4 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:52.331888 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d4ffe-23d3-451d-a13b-95576fa350c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:52.348960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-024d4ffe-23d3-451d-a13b-95576fa350c4 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:52.350470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-024d4ffe-23d3-451d-a13b-95576fa350c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:52.420035 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 443/883] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:20:52.442501 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea519c7d-0f4a-42ca-bbca-cc26a33c6938 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:52.549094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea519c7d-0f4a-42ca-bbca-cc26a33c6938 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:52.583563 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f6334-d003-41f9-91ce-b82fce1e0142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:52.584819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f6334-d003-41f9-91ce-b82fce1e0142 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:52.585307 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f6334-d003-41f9-91ce-b82fce1e0142 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:52.585795 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f6334-d003-41f9-91ce-b82fce1e0142 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:52.586585 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c76fa-52f6-4212-8b78-4509a854e2c5 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:52.586797 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f6334-d003-41f9-91ce-b82fce1e0142 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:52.587281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c76fa-52f6-4212-8b78-4509a854e2c5 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:52.587749 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c76fa-52f6-4212-8b78-4509a854e2c5 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:52.588117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f6334-d003-41f9-91ce-b82fce1e0142 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:52.590037 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 444/884] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:52.595212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd45ec-724c-475b-a4c1-386f5ca8e06d None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:52.595726 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd45ec-724c-475b-a4c1-386f5ca8e06d None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:52.596204 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd45ec-724c-475b-a4c1-386f5ca8e06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:52.600905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-f78f6334-d003-41f9-91ce-b82fce1e0142 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 06 23:20:52.600905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:52.600905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:20:52.600905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:20:52.600905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:20:52.600905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:20:52.600905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:20:52.600905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:52.600905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 06 23:20:52.600905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:52.600905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:20:52.600905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:52.600905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:52.600905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:52.600905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:52.600905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:52.600905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:52.601864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:52.601864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:52.601864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:52.601864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:52.601864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:52.601864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:52.601864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:20:52.601864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:20:52.601864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:20:52.601864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:20:52.601864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:52.601864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:52.601864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:52.601864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:52.601864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:52.601864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:52.603239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:52.603239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:52.603239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:52.603239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:52.603239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:52.603239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:52.603239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:52.603239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:52.603239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:52.603239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:52.603239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:20:52.603239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:52.603239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 06 23:20:52.603239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:52.603239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 441/885] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:20:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:52.608782 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f6334-d003-41f9-91ce-b82fce1e0142 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:52.618007 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-eadd45ec-724c-475b-a4c1-386f5ca8e06d None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:52.619470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-eadd45ec-724c-475b-a4c1-386f5ca8e06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:52.688609 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 445/886] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:20:52.707812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd45ec-724c-475b-a4c1-386f5ca8e06d None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:52.709513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f6334-d003-41f9-91ce-b82fce1e0142 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:52.759687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc3dee-9f23-48e6-a6d1-ef3d6b422c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:52.760405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc3dee-9f23-48e6-a6d1-ef3d6b422c37 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:52.760728 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc3dee-9f23-48e6-a6d1-ef3d6b422c37 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:52.760997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc3dee-9f23-48e6-a6d1-ef3d6b422c37 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:52.761782 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc3dee-9f23-48e6-a6d1-ef3d6b422c37 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:52.762095 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc3dee-9f23-48e6-a6d1-ef3d6b422c37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:52.763476 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc3dee-9f23-48e6-a6d1-ef3d6b422c37 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:52.772921 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 442/887] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:20:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:52.774446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc3dee-9f23-48e6-a6d1-ef3d6b422c37 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:52.826004 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd45ec-724c-475b-a4c1-386f5ca8e06d None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:52.861751 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a63ec-2ed5-421b-b445-84d39e302dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:52.862859 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a63ec-2ed5-421b-b445-84d39e302dea None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:52.863360 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a63ec-2ed5-421b-b445-84d39e302dea None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:52.863829 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a63ec-2ed5-421b-b445-84d39e302dea None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:52.874694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a63ec-2ed5-421b-b445-84d39e302dea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:52.882986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-705a63ec-2ed5-421b-b445-84d39e302dea None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 06 23:20:52.882986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:52.882986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:52.882986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:52.882986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:52.882986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:52.882986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:52.882986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:52.882986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:52.882986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:52.882986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:52.882986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:52.882986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:52.882986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:52.882986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:52.882986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:52.884091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:52.884091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:52.884091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:52.884091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:52.884091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:52.884091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:52.884091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:52.884091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:52.884091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:52.884091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:52.884091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:52.884091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:52.884091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:52.884091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:52.884091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:52.884091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:52.885304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:52.885304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:52.885304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:52.885304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:52.885304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:52.885304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:52.885304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:52.885304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:52.885304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:52.885304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:52.885304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 06 23:20:52.885304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:52.885948 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc3dee-9f23-48e6-a6d1-ef3d6b422c37 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:52.887842 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 446/888] 10.222.0.60 () {56 vars in 1120 bytes} [Fri May 6 23:20:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:52.895131 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a63ec-2ed5-421b-b445-84d39e302dea None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:52.925204 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc6617-30e5-4f56-a757-e597d0b1b499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:52.926732 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc6617-30e5-4f56-a757-e597d0b1b499 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:52.927493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc6617-30e5-4f56-a757-e597d0b1b499 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:52.927956 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc6617-30e5-4f56-a757-e597d0b1b499 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:52.929336 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc6617-30e5-4f56-a757-e597d0b1b499 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:52.930095 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc6617-30e5-4f56-a757-e597d0b1b499 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:52.932183 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc6617-30e5-4f56-a757-e597d0b1b499 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:52.939055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 443/889] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:20:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:52.947794 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc6617-30e5-4f56-a757-e597d0b1b499 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:53.010748 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a63ec-2ed5-421b-b445-84d39e302dea None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:53.052516 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64952502-ae10-4b8b-bb1d-3b2110864502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:53.053150 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc6617-30e5-4f56-a757-e597d0b1b499 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:53.053309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64952502-ae10-4b8b-bb1d-3b2110864502 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:53.053470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64952502-ae10-4b8b-bb1d-3b2110864502 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:53.053742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64952502-ae10-4b8b-bb1d-3b2110864502 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:53.054484 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64952502-ae10-4b8b-bb1d-3b2110864502 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:53.054789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64952502-ae10-4b8b-bb1d-3b2110864502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:53.057168 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64952502-ae10-4b8b-bb1d-3b2110864502 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:53.066875 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 447/890] 10.222.0.60 () {56 vars in 1115 bytes} [Fri May 6 23:20:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:53.072261 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64952502-ae10-4b8b-bb1d-3b2110864502 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:53.093389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a272da5-3f3b-41db-b688-0e9169495d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:53.094055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a272da5-3f3b-41db-b688-0e9169495d1a None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:53.094336 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a272da5-3f3b-41db-b688-0e9169495d1a None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:53.094614 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a272da5-3f3b-41db-b688-0e9169495d1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:53.095408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a272da5-3f3b-41db-b688-0e9169495d1a None admin] RBAC: Adding query filter params (interface=public, service_id=edaefab2d13145adb4e51c3722e4c073, region_id=RegionOne) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:53.095720 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a272da5-3f3b-41db-b688-0e9169495d1a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:53.097294 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a272da5-3f3b-41db-b688-0e9169495d1a None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:53.107025 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 444/891] 10.222.0.60 () {56 vars in 1251 bytes} [Fri May 6 23:20:52 2022] GET /identity/v3/endpoints?service_id=edaefab2d13145adb4e51c3722e4c073&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:53.107853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a272da5-3f3b-41db-b688-0e9169495d1a None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:53.185272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64952502-ae10-4b8b-bb1d-3b2110864502 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:53.218575 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3facd7-2ff3-4909-b856-f54251c32038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:53.219419 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3facd7-2ff3-4909-b856-f54251c32038 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:53.219698 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3facd7-2ff3-4909-b856-f54251c32038 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:53.219968 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3facd7-2ff3-4909-b856-f54251c32038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:53.220165 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a272da5-3f3b-41db-b688-0e9169495d1a None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:53.232997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3facd7-2ff3-4909-b856-f54251c32038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:53.234634 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3facd7-2ff3-4909-b856-f54251c32038 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:53.254514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb5abf-54b1-4494-aea1-4fc3f9d35d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:53.255176 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb5abf-54b1-4494-aea1-4fc3f9d35d42 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:53.255458 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb5abf-54b1-4494-aea1-4fc3f9d35d42 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:53.255631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-da3facd7-2ff3-4909-b856-f54251c32038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:53.255631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:53.255631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:53.255631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:53.255631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:53.255631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:53.255631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:53.255631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:53.255631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:53.255631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:53.255631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:53.255631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:53.255631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:53.255631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:53.255631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:53.257666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:53.257666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:53.257666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:53.257666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:53.257666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:53.257666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:53.257666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:53.257666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:53.257666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:53.257666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:53.257666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:53.257666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:53.257666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:53.257666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:53.257666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:53.257666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:53.257666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:53.260418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:53.260418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:53.260418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:53.260418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:53.260947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb5abf-54b1-4494-aea1-4fc3f9d35d42 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:53.260947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb5abf-54b1-4494-aea1-4fc3f9d35d42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:53.261225 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 448/892] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:53.261373 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb5abf-54b1-4494-aea1-4fc3f9d35d42 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:53.264465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3facd7-2ff3-4909-b856-f54251c32038 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:53.276451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 445/893] 10.222.0.60 () {56 vars in 1087 bytes} [Fri May 6 23:20:53 2022] GET /identity/v3/services => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:20:53.378850 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3facd7-2ff3-4909-b856-f54251c32038 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:53.416932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c53849-3dfb-4701-992a-67e1af38def4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:53.418039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53849-3dfb-4701-992a-67e1af38def4 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:53.418537 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53849-3dfb-4701-992a-67e1af38def4 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:53.419015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53849-3dfb-4701-992a-67e1af38def4 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:53.419986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c53849-3dfb-4701-992a-67e1af38def4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:53.420509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c53849-3dfb-4701-992a-67e1af38def4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:53.422191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c53849-3dfb-4701-992a-67e1af38def4 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:53.436021 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 449/894] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:53.441353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb5abf-54b1-4494-aea1-4fc3f9d35d42 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:53.546463 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb5abf-54b1-4494-aea1-4fc3f9d35d42 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:53.580558 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f72668-1255-42fa-b7f0-5dfcfb7670ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:53.581365 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f72668-1255-42fa-b7f0-5dfcfb7670ac None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:53.581644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f72668-1255-42fa-b7f0-5dfcfb7670ac None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:53.581914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f72668-1255-42fa-b7f0-5dfcfb7670ac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:53.590789 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f72668-1255-42fa-b7f0-5dfcfb7670ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:53.592243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f72668-1255-42fa-b7f0-5dfcfb7670ac None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:53.607141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-23f72668-1255-42fa-b7f0-5dfcfb7670ac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 06 23:20:53.607141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:53.607141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:53.607141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:53.607141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:53.607141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:53.607141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:53.607141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:53.607141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:53.607141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:53.607141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:53.607141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:53.607141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:53.607141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:53.607141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:53.607141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:53.608114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:53.608114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:53.608114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:53.608114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:53.608114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:53.608114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:53.608114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:53.608114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:53.608114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:53.608114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:53.608114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:53.608114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:53.608114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:53.608114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:53.608114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:53.608114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:53.608114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:53.608114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:53.609543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:53.609543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:53.609543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:53.609543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:53.609543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:53.609543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:53.609543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:53.609543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:53.609543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 06 23:20:53.609543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:53.609543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 446/895] 10.222.0.60 () {56 vars in 1117 bytes} [Fri May 6 23:20:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:53.614314 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c53849-3dfb-4701-992a-67e1af38def4 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:53.718699 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c53849-3dfb-4701-992a-67e1af38def4 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:53.753822 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc573e11-07e4-48a3-ae8d-9d01c9a610b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:53.754876 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc573e11-07e4-48a3-ae8d-9d01c9a610b4 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:53.755363 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc573e11-07e4-48a3-ae8d-9d01c9a610b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:53.755842 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc573e11-07e4-48a3-ae8d-9d01c9a610b4 None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:53.756900 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc573e11-07e4-48a3-ae8d-9d01c9a610b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:53.757428 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc573e11-07e4-48a3-ae8d-9d01c9a610b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:53.759116 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc573e11-07e4-48a3-ae8d-9d01c9a610b4 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:53.777544 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 450/896] 10.222.0.60 () {56 vars in 1149 bytes} [Fri May 6 23:20:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:53.788587 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f72668-1255-42fa-b7f0-5dfcfb7670ac None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:53.873922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b651b1f-4eac-47c2-812b-150729ffe641 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:53.874260 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b651b1f-4eac-47c2-812b-150729ffe641 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:53.874479 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b651b1f-4eac-47c2-812b-150729ffe641 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:53.876088 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 451/897] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:20:53.881444 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edfb1f-bb5c-48bf-99ff-5a8437871614 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:53.881571 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edfb1f-bb5c-48bf-99ff-5a8437871614 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:53.881760 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edfb1f-bb5c-48bf-99ff-5a8437871614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:53.898397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f72668-1255-42fa-b7f0-5dfcfb7670ac None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:53.902416 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-01edfb1f-bb5c-48bf-99ff-5a8437871614 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:53.903828 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-01edfb1f-bb5c-48bf-99ff-5a8437871614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:53.932115 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c1c7e-1fc4-44d0-ba12-8db91f96df42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:53.932794 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c1c7e-1fc4-44d0-ba12-8db91f96df42 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:53.933068 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c1c7e-1fc4-44d0-ba12-8db91f96df42 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:53.933345 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c1c7e-1fc4-44d0-ba12-8db91f96df42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:53.993135 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 452/898] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:20:54.005380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c1c7e-1fc4-44d0-ba12-8db91f96df42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:54.007102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c1c7e-1fc4-44d0-ba12-8db91f96df42 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:54.009229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edfb1f-bb5c-48bf-99ff-5a8437871614 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:54.105702 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edfb1f-bb5c-48bf-99ff-5a8437871614 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:54.106162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 447/899] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:20:53 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 06 23:20:54.107557 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86d958-b2f6-4cf5-836b-1e9680fcdd0a None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:54.107843 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86d958-b2f6-4cf5-836b-1e9680fcdd0a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:54.108116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86d958-b2f6-4cf5-836b-1e9680fcdd0a None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:54.113557 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 448/900] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:54.114306 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86d958-b2f6-4cf5-836b-1e9680fcdd0a None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:54.146203 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c123425-dc68-4be4-9403-74b2f531b4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:54.147004 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c123425-dc68-4be4-9403-74b2f531b4b2 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:54.147441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c123425-dc68-4be4-9403-74b2f531b4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:54.147716 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c123425-dc68-4be4-9403-74b2f531b4b2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:54.149783 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c123425-dc68-4be4-9403-74b2f531b4b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:54.151154 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c123425-dc68-4be4-9403-74b2f531b4b2 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:54.165509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-8c123425-dc68-4be4-9403-74b2f531b4b2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 06 23:20:54.165509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:54.165509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:20:54.165509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:20:54.165509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:20:54.165509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:20:54.165509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:20:54.165509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:54.165509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 06 23:20:54.165509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:54.165509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:20:54.165509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:54.165509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:54.165509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:54.165509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:54.165509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:54.166452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:54.166452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:54.166452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:54.166452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:54.166452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:54.166452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:54.166452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:54.166452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:20:54.166452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:20:54.166452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:20:54.166452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:20:54.166452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:54.166452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:54.166452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:54.166452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:54.166452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:54.167309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:54.167309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:54.167309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:54.167309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:54.167309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:54.167309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:54.167309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:54.167309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:54.167309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:54.167309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:54.167309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:54.167309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:20:54.167309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:54.167309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 06 23:20:54.167309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:54.168963 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 453/901] 10.222.0.60 () {56 vars in 1132 bytes} [Fri May 6 23:20:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:54.172666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf27b9-61c4-450b-a67e-69acfcb06ce0 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:54.172666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf27b9-61c4-450b-a67e-69acfcb06ce0 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:54.172666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf27b9-61c4-450b-a67e-69acfcb06ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:54.188126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-b7bf27b9-61c4-450b-a67e-69acfcb06ce0 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:54.189620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-b7bf27b9-61c4-450b-a67e-69acfcb06ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:54.216486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86d958-b2f6-4cf5-836b-1e9680fcdd0a None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:54.250342 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e2d26-dc9b-406a-a822-4ecfade02a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:54.251050 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e2d26-dc9b-406a-a822-4ecfade02a73 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:54.251328 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e2d26-dc9b-406a-a822-4ecfade02a73 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:54.251602 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e2d26-dc9b-406a-a822-4ecfade02a73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:54.256576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 454/902] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:20:54.256576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf27b9-61c4-450b-a67e-69acfcb06ce0 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:54.269551 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e2d26-dc9b-406a-a822-4ecfade02a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:54.271650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e2d26-dc9b-406a-a822-4ecfade02a73 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:54.291291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-fd8e2d26-dc9b-406a-a822-4ecfade02a73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:54.291291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:54.291291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:54.291291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:54.291291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:54.291291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:54.291291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:54.291291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:54.291291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:54.291291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:54.291291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:54.291291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:54.291291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:54.291291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:54.291291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:54.292411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:54.292411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:54.292411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:54.292411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:54.292411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:54.292411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:54.292411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:54.292411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:54.292411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:54.292411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:54.292411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:54.292411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:54.292411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:54.292411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:54.292411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:54.292411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:54.292411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:54.293587 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:54.293587 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:54.293587 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:54.293587 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:54.293587 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 449/903] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:54.293587 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e2d26-dc9b-406a-a822-4ecfade02a73 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:54.353094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf27b9-61c4-450b-a67e-69acfcb06ce0 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:54.386391 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f79b7-c1ae-41c9-9cd2-4e2a9d8b16ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:54.387108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f79b7-c1ae-41c9-9cd2-4e2a9d8b16ef None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:54.387317 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f79b7-c1ae-41c9-9cd2-4e2a9d8b16ef None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:54.387586 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f79b7-c1ae-41c9-9cd2-4e2a9d8b16ef None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:54.388280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f79b7-c1ae-41c9-9cd2-4e2a9d8b16ef None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:54.388599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f79b7-c1ae-41c9-9cd2-4e2a9d8b16ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:54.389962 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f79b7-c1ae-41c9-9cd2-4e2a9d8b16ef None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:54.394485 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 455/904] 10.222.0.60 () {56 vars in 1126 bytes} [Fri May 6 23:20:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:54.395240 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f79b7-c1ae-41c9-9cd2-4e2a9d8b16ef None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:54.395736 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e2d26-dc9b-406a-a822-4ecfade02a73 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:54.439179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f66cbb-35a6-400c-875b-14ae43c4bcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:54.439846 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f66cbb-35a6-400c-875b-14ae43c4bcf8 None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:54.440287 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f66cbb-35a6-400c-875b-14ae43c4bcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:54.440396 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f66cbb-35a6-400c-875b-14ae43c4bcf8 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:54.441152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f66cbb-35a6-400c-875b-14ae43c4bcf8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:54.442589 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f66cbb-35a6-400c-875b-14ae43c4bcf8 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:54.464929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 450/905] 10.222.0.60 () {60 vars in 1141 bytes} [Fri May 6 23:20:54 2022] POST /identity/v3/services => generated 241 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:20:54.465759 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f66cbb-35a6-400c-875b-14ae43c4bcf8 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:54.505735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f79b7-c1ae-41c9-9cd2-4e2a9d8b16ef None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:54.565202 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4afc10-478b-47a8-8733-caffd5836384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:54.565934 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4afc10-478b-47a8-8733-caffd5836384 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:54.566217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4afc10-478b-47a8-8733-caffd5836384 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:54.566485 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4afc10-478b-47a8-8733-caffd5836384 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:54.567210 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4afc10-478b-47a8-8733-caffd5836384 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:54.567512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4afc10-478b-47a8-8733-caffd5836384 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:54.569006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4afc10-478b-47a8-8733-caffd5836384 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:54.586883 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 456/906] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:54.588575 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4afc10-478b-47a8-8733-caffd5836384 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:54.605603 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f66cbb-35a6-400c-875b-14ae43c4bcf8 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:54.650091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9987cd-8e22-4e70-ab69-e779df1b86b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:54.650754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9987cd-8e22-4e70-ab69-e779df1b86b0 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:54.651033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9987cd-8e22-4e70-ab69-e779df1b86b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:54.651307 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9987cd-8e22-4e70-ab69-e779df1b86b0 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:54.652160 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9987cd-8e22-4e70-ab69-e779df1b86b0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:54.652339 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9987cd-8e22-4e70-ab69-e779df1b86b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:54.653756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9987cd-8e22-4e70-ab69-e779df1b86b0 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:54.658836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 451/907] 10.222.0.60 () {56 vars in 1126 bytes} [Fri May 6 23:20:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:54.665690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9987cd-8e22-4e70-ab69-e779df1b86b0 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:54.716277 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4afc10-478b-47a8-8733-caffd5836384 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:54.749357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62067906-16f7-48a8-adc5-0b64b066332e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:54.750168 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067906-16f7-48a8-adc5-0b64b066332e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:54.750448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067906-16f7-48a8-adc5-0b64b066332e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:54.750736 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067906-16f7-48a8-adc5-0b64b066332e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:54.757344 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62067906-16f7-48a8-adc5-0b64b066332e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:54.759280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62067906-16f7-48a8-adc5-0b64b066332e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:54.773447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-62067906-16f7-48a8-adc5-0b64b066332e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:54.773447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:54.773447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:54.773447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:54.773447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:54.773447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:54.773447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:54.773447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:54.773447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:54.773447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:54.773447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:54.773447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:54.773447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:54.773447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:54.773447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:54.774399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:54.774399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:54.774399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:54.774399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:54.774399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:54.774399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:54.774399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:54.774399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:54.774399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:54.774399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:54.774399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:54.774399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:54.774399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:54.774399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:54.774399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:54.774399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:54.774399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:54.775278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:54.775278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:54.775278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:54.775278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:54.775278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:54.775278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:54.775278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:54.775278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:54.775278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 457/908] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:54.780482 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62067906-16f7-48a8-adc5-0b64b066332e None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:54.796114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9987cd-8e22-4e70-ab69-e779df1b86b0 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:54.842959 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb26c8b-16e7-4341-bb34-3db3c0cdbdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:54.844241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb26c8b-16e7-4341-bb34-3db3c0cdbdc2 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:54.844919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb26c8b-16e7-4341-bb34-3db3c0cdbdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:54.845200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb26c8b-16e7-4341-bb34-3db3c0cdbdc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:54.846011 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb26c8b-16e7-4341-bb34-3db3c0cdbdc2 None admin] RBAC: Adding query filter params (interface=public, service_id=995852b839b541039732f95905f4056c, region_id=RegionOne) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:54.846321 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb26c8b-16e7-4341-bb34-3db3c0cdbdc2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:54.848400 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb26c8b-16e7-4341-bb34-3db3c0cdbdc2 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:54.856308 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 452/909] 10.222.0.60 () {56 vars in 1251 bytes} [Fri May 6 23:20:54 2022] GET /identity/v3/endpoints?service_id=995852b839b541039732f95905f4056c&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:54.861460 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb26c8b-16e7-4341-bb34-3db3c0cdbdc2 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:54.900065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62067906-16f7-48a8-adc5-0b64b066332e None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:54.943875 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666517c5-657d-4bef-838a-04f602f4d4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:54.945127 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666517c5-657d-4bef-838a-04f602f4d4d4 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:54.946423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666517c5-657d-4bef-838a-04f602f4d4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:54.946918 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666517c5-657d-4bef-838a-04f602f4d4d4 None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:54.947910 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666517c5-657d-4bef-838a-04f602f4d4d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:54.948422 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666517c5-657d-4bef-838a-04f602f4d4d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:54.950807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666517c5-657d-4bef-838a-04f602f4d4d4 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:54.960177 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb26c8b-16e7-4341-bb34-3db3c0cdbdc2 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:54.971808 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 458/910] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:54.978474 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666517c5-657d-4bef-838a-04f602f4d4d4 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:55.001808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835bb52-1200-412a-a3ae-aed5667bfebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:55.002478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835bb52-1200-412a-a3ae-aed5667bfebc None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:55.002759 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835bb52-1200-412a-a3ae-aed5667bfebc None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:55.003037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835bb52-1200-412a-a3ae-aed5667bfebc None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:55.003722 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835bb52-1200-412a-a3ae-aed5667bfebc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:55.005718 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835bb52-1200-412a-a3ae-aed5667bfebc None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:55.020645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 453/911] 10.222.0.60 () {56 vars in 1087 bytes} [Fri May 6 23:20:54 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:20:55.099777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666517c5-657d-4bef-838a-04f602f4d4d4 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:55.136749 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a80ba-2fd3-4795-936b-308179fcd8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:55.137418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a80ba-2fd3-4795-936b-308179fcd8ae None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:55.137698 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a80ba-2fd3-4795-936b-308179fcd8ae None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:55.137974 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a80ba-2fd3-4795-936b-308179fcd8ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:55.138813 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a80ba-2fd3-4795-936b-308179fcd8ae None admin] RBAC: Adding query filter params (role.id=ba21f19c24814b0cb6fd00d728df4447, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=d211582f9fc34b0e815e27db081c50c9) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:55.139120 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a80ba-2fd3-4795-936b-308179fcd8ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:55.140588 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a80ba-2fd3-4795-936b-308179fcd8ae None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:55.147223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 459/912] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:20:54 2022] GET /identity/v3/role_assignments?user.id=d211582f9fc34b0e815e27db081c50c9&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=ba21f19c24814b0cb6fd00d728df4447 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:55.627290 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32e530-33fe-45b1-9b13-35671815bccc None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:55.627837 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32e530-33fe-45b1-9b13-35671815bccc None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:55.627837 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32e530-33fe-45b1-9b13-35671815bccc None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:55.629516 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 454/913] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:55.635753 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7489c5-4acc-4765-9e7d-37290c8d3135 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:55.636202 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7489c5-4acc-4765-9e7d-37290c8d3135 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:55.636387 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7489c5-4acc-4765-9e7d-37290c8d3135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:55.654155 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-1e7489c5-4acc-4765-9e7d-37290c8d3135 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:55.655924 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-1e7489c5-4acc-4765-9e7d-37290c8d3135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:55.731863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 460/914] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:20:55.754672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32e530-33fe-45b1-9b13-35671815bccc None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:55.869780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32e530-33fe-45b1-9b13-35671815bccc None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:55.904301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c111d-66f7-4968-baef-ab4591257f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:55.905051 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c111d-66f7-4968-baef-ab4591257f19 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:55.905334 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c111d-66f7-4968-baef-ab4591257f19 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:55.905611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c111d-66f7-4968-baef-ab4591257f19 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:55.906263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c111d-66f7-4968-baef-ab4591257f19 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:55.907637 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c111d-66f7-4968-baef-ab4591257f19 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:55.919380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-966c111d-66f7-4968-baef-ab4591257f19 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 06 23:20:55.919380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:55.919380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:20:55.919380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:20:55.919380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:20:55.919380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:20:55.919380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:20:55.919380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:55.919380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 06 23:20:55.919380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:55.919380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:20:55.919380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:55.919380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:55.919380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:55.919380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:55.919380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:55.919380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:55.920434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:55.920434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:55.920434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:55.920434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:55.920434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:55.920434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:55.920434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:20:55.920434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:20:55.920434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:20:55.920434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:20:55.920434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:55.920434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:55.920434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:55.920434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:55.920434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:55.920434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:55.921399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:55.921399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:55.921399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:55.921399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:55.921399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:55.921399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:55.921399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:55.921399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:55.921399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:55.921399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:55.921399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:20:55.921399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:55.921399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 06 23:20:55.921399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:55.924651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 455/915] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:20:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:55.926964 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7489c5-4acc-4765-9e7d-37290c8d3135 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:56.022621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7489c5-4acc-4765-9e7d-37290c8d3135 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:56.055957 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0e688-213d-4f80-b7e1-f4a4fbe37fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:56.056653 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0e688-213d-4f80-b7e1-f4a4fbe37fd3 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:56.056938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0e688-213d-4f80-b7e1-f4a4fbe37fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:56.057215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0e688-213d-4f80-b7e1-f4a4fbe37fd3 None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:56.057920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0e688-213d-4f80-b7e1-f4a4fbe37fd3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:56.058233 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0e688-213d-4f80-b7e1-f4a4fbe37fd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:56.059610 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0e688-213d-4f80-b7e1-f4a4fbe37fd3 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:56.068494 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 461/916] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:20:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:56.074599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c111d-66f7-4968-baef-ab4591257f19 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:56.178649 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c111d-66f7-4968-baef-ab4591257f19 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:56.212973 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1883ac-1c32-4f84-88fa-83e65bc7f207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:56.213732 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1883ac-1c32-4f84-88fa-83e65bc7f207 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:56.214014 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1883ac-1c32-4f84-88fa-83e65bc7f207 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:56.214553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1883ac-1c32-4f84-88fa-83e65bc7f207 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:56.215265 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1883ac-1c32-4f84-88fa-83e65bc7f207 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:56.215575 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1883ac-1c32-4f84-88fa-83e65bc7f207 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:56.216974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1883ac-1c32-4f84-88fa-83e65bc7f207 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:56.226681 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 456/917] 10.222.0.60 () {56 vars in 1114 bytes} [Fri May 6 23:20:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:56.228604 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0e688-213d-4f80-b7e1-f4a4fbe37fd3 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:56.334667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0e688-213d-4f80-b7e1-f4a4fbe37fd3 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:56.369402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda68241-4b25-4356-902d-1013557601a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:56.370065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda68241-4b25-4356-902d-1013557601a0 None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:56.370346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda68241-4b25-4356-902d-1013557601a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:56.370616 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda68241-4b25-4356-902d-1013557601a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:56.371371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda68241-4b25-4356-902d-1013557601a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:56.372811 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda68241-4b25-4356-902d-1013557601a0 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:56.404740 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 462/918] 10.222.0.60 () {60 vars in 1144 bytes} [Fri May 6 23:20:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:20:56.770006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41b32c-986e-47a1-97f9-11f49d5119fb None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:56.770731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41b32c-986e-47a1-97f9-11f49d5119fb None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:56.770731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41b32c-986e-47a1-97f9-11f49d5119fb None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:56.772162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 457/919] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:56.777967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207214d5-c818-448e-99a8-1a2cb498af5d None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:56.778490 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207214d5-c818-448e-99a8-1a2cb498af5d None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:56.778490 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207214d5-c818-448e-99a8-1a2cb498af5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:56.796273 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-207214d5-c818-448e-99a8-1a2cb498af5d None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:56.797495 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-207214d5-c818-448e-99a8-1a2cb498af5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:56.881944 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 463/920] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:20:56.903739 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41b32c-986e-47a1-97f9-11f49d5119fb None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:57.015254 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41b32c-986e-47a1-97f9-11f49d5119fb None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:57.049093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ac4d2-a4c0-4a5f-88ad-d4afa7c79e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:57.049838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ac4d2-a4c0-4a5f-88ad-d4afa7c79e0c None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:57.050294 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ac4d2-a4c0-4a5f-88ad-d4afa7c79e0c None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:57.050574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ac4d2-a4c0-4a5f-88ad-d4afa7c79e0c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:57.051231 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ac4d2-a4c0-4a5f-88ad-d4afa7c79e0c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:57.052637 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ac4d2-a4c0-4a5f-88ad-d4afa7c79e0c None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:57.065500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-160ac4d2-a4c0-4a5f-88ad-d4afa7c79e0c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 06 23:20:57.065500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:57.065500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:20:57.065500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:20:57.065500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:20:57.065500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:20:57.065500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:20:57.065500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:57.065500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 06 23:20:57.065500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:57.065500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:20:57.065500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:57.065500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:57.065500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:57.065500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:57.065500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:57.065500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:57.067927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:57.067927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:57.067927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:57.067927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:57.067927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:57.067927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:57.067927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:20:57.067927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:20:57.067927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:20:57.067927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:20:57.067927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:57.067927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:57.067927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:57.067927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:57.067927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:57.067927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:57.070910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:57.070910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:57.070910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:57.070910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:57.070910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:57.070910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:57.070910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:57.070910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:57.070910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:57.070910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:57.070910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:20:57.070910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:57.070910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 06 23:20:57.070910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:57.070910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 458/921] 10.222.0.60 () {56 vars in 1126 bytes} [Fri May 6 23:20:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:57.073968 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207214d5-c818-448e-99a8-1a2cb498af5d None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:57.182805 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207214d5-c818-448e-99a8-1a2cb498af5d None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:57.217074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a552c-8b7c-443a-adba-b7a25ed88f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:57.217737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a552c-8b7c-443a-adba-b7a25ed88f3b None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:57.218019 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a552c-8b7c-443a-adba-b7a25ed88f3b None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:57.218293 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a552c-8b7c-443a-adba-b7a25ed88f3b None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:57.218999 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a552c-8b7c-443a-adba-b7a25ed88f3b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:57.219302 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a552c-8b7c-443a-adba-b7a25ed88f3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:57.220696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a552c-8b7c-443a-adba-b7a25ed88f3b None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:57.225937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 464/922] 10.222.0.60 () {56 vars in 1122 bytes} [Fri May 6 23:20:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:57.233628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ac4d2-a4c0-4a5f-88ad-d4afa7c79e0c None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:57.304227 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b90f4-d35d-4373-bfcc-b005599e6147 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:57.304424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b90f4-d35d-4373-bfcc-b005599e6147 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:57.304738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b90f4-d35d-4373-bfcc-b005599e6147 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:57.306650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 465/923] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:57.312925 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc125f4-3cbd-4acd-aa43-2076be691372 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:57.313219 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc125f4-3cbd-4acd-aa43-2076be691372 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:57.313498 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc125f4-3cbd-4acd-aa43-2076be691372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:57.335467 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-2cc125f4-3cbd-4acd-aa43-2076be691372 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:57.337680 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-2cc125f4-3cbd-4acd-aa43-2076be691372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:57.344745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ac4d2-a4c0-4a5f-88ad-d4afa7c79e0c None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:57.387154 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a427a0e-5363-4dca-ab57-ca6ed288f633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:57.387822 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a427a0e-5363-4dca-ab57-ca6ed288f633 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:57.388105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a427a0e-5363-4dca-ab57-ca6ed288f633 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:57.388380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a427a0e-5363-4dca-ab57-ca6ed288f633 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:57.389544 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a427a0e-5363-4dca-ab57-ca6ed288f633 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:57.389862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a427a0e-5363-4dca-ab57-ca6ed288f633 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:57.391853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a427a0e-5363-4dca-ab57-ca6ed288f633 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:57.398415 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 459/924] 10.222.0.60 () {56 vars in 1122 bytes} [Fri May 6 23:20:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:57.404272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a427a0e-5363-4dca-ab57-ca6ed288f633 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:57.428574 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 466/925] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:20:57.446638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc125f4-3cbd-4acd-aa43-2076be691372 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:57.513240 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a427a0e-5363-4dca-ab57-ca6ed288f633 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:57.540120 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc125f4-3cbd-4acd-aa43-2076be691372 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:57.544364 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a00e97-b4d4-415c-9c28-63da3946335f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:57.545050 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a00e97-b4d4-415c-9c28-63da3946335f None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:57.545333 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a00e97-b4d4-415c-9c28-63da3946335f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:57.545608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a00e97-b4d4-415c-9c28-63da3946335f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:57.546395 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a00e97-b4d4-415c-9c28-63da3946335f None admin] RBAC: Adding query filter params (interface=public, service_id=7828608ab89c4d188ea571cb2c81ba22, region_id=RegionOne) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:57.546704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a00e97-b4d4-415c-9c28-63da3946335f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:57.548072 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a00e97-b4d4-415c-9c28-63da3946335f None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:57.552965 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 460/926] 10.222.0.60 () {56 vars in 1251 bytes} [Fri May 6 23:20:57 2022] GET /identity/v3/endpoints?service_id=7828608ab89c4d188ea571cb2c81ba22&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:57.554382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f584a6c-f6b9-4f7a-a044-00d012591dc2 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:57.554617 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f584a6c-f6b9-4f7a-a044-00d012591dc2 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:57.554892 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f584a6c-f6b9-4f7a-a044-00d012591dc2 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:57.556914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 461/927] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:20:57.561675 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f584a6c-f6b9-4f7a-a044-00d012591dc2 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:57.578991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282b319-0f3d-4dae-926d-b8de351d41c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:57.580073 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282b319-0f3d-4dae-926d-b8de351d41c9 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:57.580513 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282b319-0f3d-4dae-926d-b8de351d41c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:57.580971 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282b319-0f3d-4dae-926d-b8de351d41c9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:57.581828 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282b319-0f3d-4dae-926d-b8de351d41c9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:57.583377 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282b319-0f3d-4dae-926d-b8de351d41c9 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:57.596167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-5282b319-0f3d-4dae-926d-b8de351d41c9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 06 23:20:57.596167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:57.596167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:20:57.596167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:20:57.596167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:20:57.596167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:20:57.596167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:20:57.596167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:57.596167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 06 23:20:57.596167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:57.596167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:20:57.596167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:57.596167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:57.596167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:57.596167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:57.596167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:57.597172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:57.597172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:57.597172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:57.597172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:57.597172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:57.597172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:57.597172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:57.597172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:20:57.597172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:20:57.597172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:20:57.597172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:20:57.597172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:57.597172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:57.597172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:57.597172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:57.597172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:57.598399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:57.598399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:57.598399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:57.598399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:57.598399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:57.598399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:57.598399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:57.598399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:57.598399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:57.598399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:57.598399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:57.598399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:20:57.598399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:20:57.598399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 06 23:20:57.598399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:57.598399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 467/928] 10.222.0.60 () {56 vars in 1132 bytes} [Fri May 6 23:20:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:57.599271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d67b7-0f62-4fb9-8055-cc333920692f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:57.599271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d67b7-0f62-4fb9-8055-cc333920692f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:57.599406 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d67b7-0f62-4fb9-8055-cc333920692f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:57.617290 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-108d67b7-0f62-4fb9-8055-cc333920692f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:57.618491 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-108d67b7-0f62-4fb9-8055-cc333920692f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:57.663278 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f584a6c-f6b9-4f7a-a044-00d012591dc2 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:57.692562 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 468/929] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:20:57.692562 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d67b7-0f62-4fb9-8055-cc333920692f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:57.707935 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdb2da-f09b-4539-b780-92de38e40b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:57.708797 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdb2da-f09b-4539-b780-92de38e40b49 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:57.709452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdb2da-f09b-4539-b780-92de38e40b49 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:57.709737 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdb2da-f09b-4539-b780-92de38e40b49 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:57.711011 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdb2da-f09b-4539-b780-92de38e40b49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:57.713136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdb2da-f09b-4539-b780-92de38e40b49 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:57.719374 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 462/930] 10.222.0.60 () {56 vars in 1087 bytes} [Fri May 6 23:20:57 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:20:57.720161 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdb2da-f09b-4539-b780-92de38e40b49 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:57.797684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d67b7-0f62-4fb9-8055-cc333920692f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:57.832426 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdb2da-f09b-4539-b780-92de38e40b49 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:57.834888 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a22c1a-7e0e-4295-bd86-357d1af362f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:57.835874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a22c1a-7e0e-4295-bd86-357d1af362f0 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:57.836993 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a22c1a-7e0e-4295-bd86-357d1af362f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:57.837478 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a22c1a-7e0e-4295-bd86-357d1af362f0 None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:57.838400 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a22c1a-7e0e-4295-bd86-357d1af362f0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:57.838920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a22c1a-7e0e-4295-bd86-357d1af362f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:57.840803 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a22c1a-7e0e-4295-bd86-357d1af362f0 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:57.851624 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 469/931] 10.222.0.60 () {56 vars in 1126 bytes} [Fri May 6 23:20:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:57.852917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a22c1a-7e0e-4295-bd86-357d1af362f0 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:57.870938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961832b3-5b0d-41bb-97fc-ce0ffe258388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:57.871806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961832b3-5b0d-41bb-97fc-ce0ffe258388 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:57.872093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961832b3-5b0d-41bb-97fc-ce0ffe258388 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:57.872368 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961832b3-5b0d-41bb-97fc-ce0ffe258388 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:57.884615 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961832b3-5b0d-41bb-97fc-ce0ffe258388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:20:57.893284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-961832b3-5b0d-41bb-97fc-ce0ffe258388 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 06 23:20:57.893284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:57.893284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:57.893284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:57.893284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:57.893284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:57.893284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:57.893284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:57.893284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:57.893284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:57.893284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:57.893284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:57.893284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:20:57.893284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:20:57.893284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:20:57.893284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:20:57.894299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:20:57.894299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:20:57.894299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:20:57.894299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:20:57.894299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:57.894299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:57.894299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:57.894299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:57.894299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:57.894299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:57.894299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:57.894299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:57.894299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:57.894299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:57.894299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:57.894299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:57.895137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:57.895137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:57.895137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:57.895137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:57.895137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:20:57.895137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:20:57.895137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:20:57.895137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:20:57.895137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:20:57.895137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:20:57.895137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 06 23:20:57.895137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:57.899681 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 463/932] 10.222.0.60 () {56 vars in 1120 bytes} [Fri May 6 23:20:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:57.900849 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961832b3-5b0d-41bb-97fc-ce0ffe258388 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:57.970632 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a22c1a-7e0e-4295-bd86-357d1af362f0 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:58.004346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca1853-cbb6-41df-b05b-739498268643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:58.005085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca1853-cbb6-41df-b05b-739498268643 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:58.005362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca1853-cbb6-41df-b05b-739498268643 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:58.005642 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca1853-cbb6-41df-b05b-739498268643 None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:58.006325 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca1853-cbb6-41df-b05b-739498268643 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:58.006625 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca1853-cbb6-41df-b05b-739498268643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:58.007987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca1853-cbb6-41df-b05b-739498268643 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:58.012990 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 470/933] 10.222.0.60 () {56 vars in 1126 bytes} [Fri May 6 23:20:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:58.018323 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca1853-cbb6-41df-b05b-739498268643 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:58.026413 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961832b3-5b0d-41bb-97fc-ce0ffe258388 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:58.069171 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de257b-9f17-4ac8-aba9-ef60bdc21940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:58.070235 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de257b-9f17-4ac8-aba9-ef60bdc21940 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:58.071208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de257b-9f17-4ac8-aba9-ef60bdc21940 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:58.071695 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de257b-9f17-4ac8-aba9-ef60bdc21940 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:58.072935 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de257b-9f17-4ac8-aba9-ef60bdc21940 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:58.073642 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de257b-9f17-4ac8-aba9-ef60bdc21940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:58.075813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de257b-9f17-4ac8-aba9-ef60bdc21940 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:58.092982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 464/934] 10.222.0.60 () {56 vars in 1115 bytes} [Fri May 6 23:20:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:58.097015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de257b-9f17-4ac8-aba9-ef60bdc21940 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:58.122015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca1853-cbb6-41df-b05b-739498268643 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:58.155508 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a87b0-8ea5-4c74-b02a-b749bf8870c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:58.156272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a87b0-8ea5-4c74-b02a-b749bf8870c5 None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:58.156647 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a87b0-8ea5-4c74-b02a-b749bf8870c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:58.156984 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a87b0-8ea5-4c74-b02a-b749bf8870c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:58.157856 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a87b0-8ea5-4c74-b02a-b749bf8870c5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:58.159333 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a87b0-8ea5-4c74-b02a-b749bf8870c5 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:58.184616 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 471/935] 10.222.0.60 () {60 vars in 1144 bytes} [Fri May 6 23:20:58 2022] POST /identity/v3/endpoints => generated 347 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:20:58.224391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de257b-9f17-4ac8-aba9-ef60bdc21940 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:58.273456 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdec4e0-65bc-4fb3-abce-896c04350128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:58.274801 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdec4e0-65bc-4fb3-abce-896c04350128 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:58.275078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdec4e0-65bc-4fb3-abce-896c04350128 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:58.275348 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdec4e0-65bc-4fb3-abce-896c04350128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:58.287507 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdec4e0-65bc-4fb3-abce-896c04350128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:58.289023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdec4e0-65bc-4fb3-abce-896c04350128 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:58.308006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-4fdec4e0-65bc-4fb3-abce-896c04350128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:58.308006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:58.308006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:58.308006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:58.308006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:58.308006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:58.308006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:58.308006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:58.308006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:58.308006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:58.308006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:58.308006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:58.308006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:58.308006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:58.308006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:58.309023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:58.309023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:58.309023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:58.309023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:58.309023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:58.309023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:58.309023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:58.309023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:58.309023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:58.309023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:58.309023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:58.309023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:58.309023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:58.309023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:58.309023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:58.309023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:58.309023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:58.309940 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:58.309940 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:58.309940 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:58.309940 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:58.309940 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 465/936] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:58.316592 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a87b0-8ea5-4c74-b02a-b749bf8870c5 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:58.425877 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a87b0-8ea5-4c74-b02a-b749bf8870c5 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:58.461136 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6f1c1-7544-4455-b705-90e13fb5994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:58.461877 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6f1c1-7544-4455-b705-90e13fb5994f None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:58.462163 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6f1c1-7544-4455-b705-90e13fb5994f None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:58.462432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6f1c1-7544-4455-b705-90e13fb5994f None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:58.463144 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6f1c1-7544-4455-b705-90e13fb5994f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:58.463448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6f1c1-7544-4455-b705-90e13fb5994f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:58.465099 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6f1c1-7544-4455-b705-90e13fb5994f None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:58.477878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 472/937] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:58.485668 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdec4e0-65bc-4fb3-abce-896c04350128 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:58.584476 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdec4e0-65bc-4fb3-abce-896c04350128 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:58.627487 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c987b-ac04-4aff-8604-e6da9dbe9d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:58.628326 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c987b-ac04-4aff-8604-e6da9dbe9d1f None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:58.628638 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c987b-ac04-4aff-8604-e6da9dbe9d1f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:58.628915 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c987b-ac04-4aff-8604-e6da9dbe9d1f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:58.638078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c987b-ac04-4aff-8604-e6da9dbe9d1f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:58.639653 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c987b-ac04-4aff-8604-e6da9dbe9d1f None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:58.654644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-328c987b-ac04-4aff-8604-e6da9dbe9d1f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 06 23:20:58.654644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:58.654644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:58.654644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:58.654644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:58.654644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:58.654644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:58.654644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:58.654644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:58.654644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:58.654644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:58.654644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:58.654644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:20:58.654644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:20:58.654644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:20:58.654644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:20:58.655608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:58.655608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:58.655608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:20:58.655608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:58.655608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:20:58.655608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:20:58.655608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:58.655608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:58.655608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:58.655608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:58.655608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:58.655608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:58.655608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:58.655608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:58.655608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:58.655608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:58.655608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:58.655608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:58.656616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:58.656616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:58.656616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:20:58.656616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:20:58.656616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:20:58.656616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:20:58.656616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:20:58.656616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:20:58.656616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 06 23:20:58.656616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:58.656616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 466/938] 10.222.0.60 () {56 vars in 1117 bytes} [Fri May 6 23:20:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:58.663658 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6f1c1-7544-4455-b705-90e13fb5994f None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:58.765650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6f1c1-7544-4455-b705-90e13fb5994f None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:58.795071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfee85b-d354-4a6e-9922-0acceb6df0d5 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:58.795710 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfee85b-d354-4a6e-9922-0acceb6df0d5 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:58.796189 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfee85b-d354-4a6e-9922-0acceb6df0d5 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:58.798143 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 467/939] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:20:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:20:58.801073 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66544c-0b6b-4f00-bb1f-1e1046dbcfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:58.801730 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66544c-0b6b-4f00-bb1f-1e1046dbcfe7 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:58.802006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66544c-0b6b-4f00-bb1f-1e1046dbcfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:58.802274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66544c-0b6b-4f00-bb1f-1e1046dbcfe7 None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:58.803099 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66544c-0b6b-4f00-bb1f-1e1046dbcfe7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:58.803400 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66544c-0b6b-4f00-bb1f-1e1046dbcfe7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:58.804866 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66544c-0b6b-4f00-bb1f-1e1046dbcfe7 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:58.805973 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e1c88-3b5d-48d0-b780-b391579b152b None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:58.806481 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e1c88-3b5d-48d0-b780-b391579b152b None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:58.806951 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e1c88-3b5d-48d0-b780-b391579b152b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:58.827931 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 473/940] 10.222.0.60 () {56 vars in 1149 bytes} [Fri May 6 23:20:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:58.828984 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-3d2e1c88-3b5d-48d0-b780-b391579b152b None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:20:58.830186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-3d2e1c88-3b5d-48d0-b780-b391579b152b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:20:58.833060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66544c-0b6b-4f00-bb1f-1e1046dbcfe7 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:58.905009 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 468/941] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:20:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:20:58.925332 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e1c88-3b5d-48d0-b780-b391579b152b None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:58.940277 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66544c-0b6b-4f00-bb1f-1e1046dbcfe7 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:58.979724 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16980b50-5f38-443a-a825-f5c7c5c747fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:58.980937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16980b50-5f38-443a-a825-f5c7c5c747fd None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:58.981907 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16980b50-5f38-443a-a825-f5c7c5c747fd None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:58.982387 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16980b50-5f38-443a-a825-f5c7c5c747fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:58.996761 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16980b50-5f38-443a-a825-f5c7c5c747fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:58.998861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16980b50-5f38-443a-a825-f5c7c5c747fd None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:59.021742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-16980b50-5f38-443a-a825-f5c7c5c747fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:59.021742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:59.021742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:59.021742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:59.021742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:59.021742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:59.021742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:59.021742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:59.021742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:59.021742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:59.021742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:59.021742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:59.021742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:20:59.021742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:20:59.021742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:20:59.022752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:20:59.022752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:59.022752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:59.022752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:59.022752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:59.022752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:59.022752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:59.022752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:59.022752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:59.022752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:59.022752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:59.022752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:59.022752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:59.022752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:59.022752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:59.022752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:59.022752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:59.023631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:20:59.023631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:20:59.023631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:20:59.023631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:59.028824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 474/942] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:59.029660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16980b50-5f38-443a-a825-f5c7c5c747fd None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:59.037598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e1c88-3b5d-48d0-b780-b391579b152b None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:59.075840 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59ef1f-c67a-4979-af47-0727c6e770ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:59.076968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59ef1f-c67a-4979-af47-0727c6e770ab None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:59.077535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59ef1f-c67a-4979-af47-0727c6e770ab None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:59.078015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59ef1f-c67a-4979-af47-0727c6e770ab None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:59.078925 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59ef1f-c67a-4979-af47-0727c6e770ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:59.080730 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59ef1f-c67a-4979-af47-0727c6e770ab None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:59.082378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: WARNING keystone.server.flask.common [None req-ef59ef1f-c67a-4979-af47-0727c6e770ab None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 06 23:20:59.102672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.sql.core [None req-ef59ef1f-c67a-4979-af47-0727c6e770ab None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 06 23:20:59.102672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 06 23:20:59.102672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [parameters: {'id': '2321a04965c04b99b6fa116582ffd796', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 06 23:20:59.102672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79804) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 06 23:20:59.112866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-ef59ef1f-c67a-4979-af47-0727c6e770ab None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2321a04965c04b99b6fa116582ffd796.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2321a04965c04b99b6fa116582ffd796. May 06 23:20:59.112866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:59.112866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 06 23:20:59.112866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self.dialect.do_execute( May 06 23:20:59.112866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 06 23:20:59.112866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 06 23:20:59.112866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 06 23:20:59.112866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application result = self._query(query) May 06 23:20:59.112866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 06 23:20:59.112866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application conn.query(q) May 06 23:20:59.112866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 06 23:20:59.112866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 06 23:20:59.112866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 06 23:20:59.113704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application result.read() May 06 23:20:59.113704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 06 23:20:59.113704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 06 23:20:59.113704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 06 23:20:59.113704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application packet.raise_for_error() May 06 23:20:59.113704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 06 23:20:59.113704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 06 23:20:59.113704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 06 23:20:59.113704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 06 23:20:59.113704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 06 23:20:59.113704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:59.113704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 06 23:20:59.113704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:59.113704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:59.113704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 06 23:20:59.113704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 06 23:20:59.113704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 06 23:20:59.113704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return project_ref.to_dict() May 06 23:20:59.114701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 06 23:20:59.114701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application next(self.gen) May 06 23:20:59.114701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 06 23:20:59.114701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application yield resource May 06 23:20:59.114701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 06 23:20:59.114701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application next(self.gen) May 06 23:20:59.114701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 06 23:20:59.114701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self.session.rollback() May 06 23:20:59.114701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 06 23:20:59.114701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self.force_reraise() May 06 23:20:59.114701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 06 23:20:59.114701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise self.value May 06 23:20:59.114701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 06 23:20:59.114701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 06 23:20:59.114701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 06 23:20:59.114701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application session.commit() May 06 23:20:59.114701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 06 23:20:59.115628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 06 23:20:59.115628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 06 23:20:59.115628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._prepare_impl() May 06 23:20:59.115628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 06 23:20:59.115628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self.session.flush() May 06 23:20:59.115628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 06 23:20:59.115628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._flush(objects) May 06 23:20:59.115628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 06 23:20:59.115628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 06 23:20:59.115628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 06 23:20:59.115628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application compat.raise_( May 06 23:20:59.115628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 06 23:20:59.115628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception May 06 23:20:59.115628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 06 23:20:59.115628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application flush_context.execute() May 06 23:20:59.115628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 06 23:20:59.115628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rec.execute(self) May 06 23:20:59.116568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 06 23:20:59.116568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 06 23:20:59.116568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 06 23:20:59.116568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application _emit_insert_statements( May 06 23:20:59.116568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 06 23:20:59.116568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application c = connection._execute_20( May 06 23:20:59.116568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 06 23:20:59.116568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 06 23:20:59.116568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 06 23:20:59.116568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 06 23:20:59.116568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 06 23:20:59.116568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ret = self._execute_context( May 06 23:20:59.116568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 06 23:20:59.116568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 06 23:20:59.116568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 06 23:20:59.118527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 06 23:20:59.118527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 06 23:20:59.118527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception May 06 23:20:59.118527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 06 23:20:59.118527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self.dialect.do_execute( May 06 23:20:59.118527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 06 23:20:59.118527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 06 23:20:59.118527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 06 23:20:59.118527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application result = self._query(query) May 06 23:20:59.118527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 06 23:20:59.118527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application conn.query(q) May 06 23:20:59.118527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 06 23:20:59.118527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 06 23:20:59.118527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 06 23:20:59.118527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application result.read() May 06 23:20:59.118527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 06 23:20:59.118527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 06 23:20:59.119403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 06 23:20:59.119403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application packet.raise_for_error() May 06 23:20:59.119403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 06 23:20:59.119403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 06 23:20:59.119403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 06 23:20:59.119403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 06 23:20:59.119403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 06 23:20:59.119403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 06 23:20:59.119403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [parameters: {'id': '2321a04965c04b99b6fa116582ffd796', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 06 23:20:59.119403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 06 23:20:59.119403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:59.119403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:20:59.119403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:59.119403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:59.119403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 06 23:20:59.120263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 06 23:20:59.120263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 06 23:20:59.120263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 06 23:20:59.120263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 06 23:20:59.120263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:59.120263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:20:59.120263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:59.120263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:59.120263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:59.120263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:59.120263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:59.120263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:59.120263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:59.120263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:59.120263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:59.120263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:59.120263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:59.121227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:59.121227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 06 23:20:59.121227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 06 23:20:59.121227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:59.121227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:59.121227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 06 23:20:59.121227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.Conflict( May 06 23:20:59.121227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2321a04965c04b99b6fa116582ffd796. May 06 23:20:59.121227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:59.124875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 469/943] 10.222.0.60 () {60 vars in 1140 bytes} [Fri May 6 23:20:58 2022] POST /identity/v3/projects => generated 262 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 06 23:20:59.125914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59ef1f-c67a-4979-af47-0727c6e770ab None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:59.150715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16980b50-5f38-443a-a825-f5c7c5c747fd None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:59.186018 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90785b-8788-48b8-9b50-50336f2d12de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:59.186708 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90785b-8788-48b8-9b50-50336f2d12de None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:59.187029 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90785b-8788-48b8-9b50-50336f2d12de None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:59.187305 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90785b-8788-48b8-9b50-50336f2d12de None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:59.188122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90785b-8788-48b8-9b50-50336f2d12de None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:59.188427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90785b-8788-48b8-9b50-50336f2d12de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:59.189832 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90785b-8788-48b8-9b50-50336f2d12de None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:59.206448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 475/944] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:59.207320 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90785b-8788-48b8-9b50-50336f2d12de None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:59.246035 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59ef1f-c67a-4979-af47-0727c6e770ab None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:59.290421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db8bb2-ade5-455f-b9b7-9d7f66273adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:59.291653 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db8bb2-ade5-455f-b9b7-9d7f66273adc None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:59.292185 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db8bb2-ade5-455f-b9b7-9d7f66273adc None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:59.292702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db8bb2-ade5-455f-b9b7-9d7f66273adc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:59.301886 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db8bb2-ade5-455f-b9b7-9d7f66273adc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:59.304267 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db8bb2-ade5-455f-b9b7-9d7f66273adc None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:59.317874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90785b-8788-48b8-9b50-50336f2d12de None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:59.326076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-55db8bb2-ade5-455f-b9b7-9d7f66273adc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:59.326076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:59.326076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:59.326076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:59.326076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:59.326076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:59.326076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:59.326076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:59.326076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:59.326076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:59.326076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:59.326076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:59.326076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:59.326076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:59.326076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:59.326968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:59.326968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:59.326968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:59.326968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:59.326968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:59.326968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:59.326968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:59.326968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:59.326968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:20:59.326968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:59.326968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:59.326968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:59.326968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:59.326968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:59.326968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:59.326968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:59.326968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:59.327876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:59.327876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:59.327876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:59.327876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:59.327876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:59.327876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:59.327876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:59.327876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:20:59.330428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 470/945] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:59.335861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db8bb2-ade5-455f-b9b7-9d7f66273adc None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:59.364462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173f5a7-8b9f-4112-adb0-a83c81e29fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:59.365376 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173f5a7-8b9f-4112-adb0-a83c81e29fe4 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:59.365847 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173f5a7-8b9f-4112-adb0-a83c81e29fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:59.366129 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173f5a7-8b9f-4112-adb0-a83c81e29fe4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:59.375231 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173f5a7-8b9f-4112-adb0-a83c81e29fe4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:59.376729 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173f5a7-8b9f-4112-adb0-a83c81e29fe4 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:59.395076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-e173f5a7-8b9f-4112-adb0-a83c81e29fe4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:59.395076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:20:59.395076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:20:59.395076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:20:59.395076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:20:59.395076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:20:59.395076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:20:59.395076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:20:59.395076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:20:59.395076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:20:59.395076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:20:59.395076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:20:59.395076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:20:59.395076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:20:59.395076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:20:59.395994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:20:59.395994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:20:59.395994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:20:59.395994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:20:59.395994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:20:59.395994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:20:59.395994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:20:59.395994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:20:59.395994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:20:59.395994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:20:59.395994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:20:59.395994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:20:59.395994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:20:59.395994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:20:59.395994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:20:59.395994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:20:59.395994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:20:59.396899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:20:59.396899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:20:59.396899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:20:59.396899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:20:59.396899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:20:59.396899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:20:59.396899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:20:59.396899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:20:59.400601 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 476/946] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:20:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:20:59.402976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173f5a7-8b9f-4112-adb0-a83c81e29fe4 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:59.461884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db8bb2-ade5-455f-b9b7-9d7f66273adc None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:59.500911 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fbc38-7c83-47ea-bc7b-616e9fbcc45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:59.501954 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fbc38-7c83-47ea-bc7b-616e9fbcc45f None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:59.502447 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fbc38-7c83-47ea-bc7b-616e9fbcc45f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:59.502935 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fbc38-7c83-47ea-bc7b-616e9fbcc45f None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:59.503906 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fbc38-7c83-47ea-bc7b-616e9fbcc45f None admin] RBAC: Adding query filter params (name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:59.504422 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fbc38-7c83-47ea-bc7b-616e9fbcc45f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:59.506085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fbc38-7c83-47ea-bc7b-616e9fbcc45f None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:59.528511 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173f5a7-8b9f-4112-adb0-a83c81e29fe4 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:59.536844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 471/947] 10.222.0.60 () {56 vars in 1112 bytes} [Fri May 6 23:20:59 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:20:59.567252 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60c3a4-d306-4c8c-a47c-e8d713943905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:59.567891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60c3a4-d306-4c8c-a47c-e8d713943905 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:59.568172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60c3a4-d306-4c8c-a47c-e8d713943905 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:59.568442 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60c3a4-d306-4c8c-a47c-e8d713943905 None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:59.569346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60c3a4-d306-4c8c-a47c-e8d713943905 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:20:59.569647 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60c3a4-d306-4c8c-a47c-e8d713943905 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:59.571257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60c3a4-d306-4c8c-a47c-e8d713943905 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:59.584659 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 477/948] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:20:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:20:59.591104 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fbc38-7c83-47ea-bc7b-616e9fbcc45f None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:20:59.698824 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fbc38-7c83-47ea-bc7b-616e9fbcc45f None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:20:59.735459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a099d65-2e94-4d05-9480-f8796a09c47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:20:59.736348 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a099d65-2e94-4d05-9480-f8796a09c47f None admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:20:59.736657 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a099d65-2e94-4d05-9480-f8796a09c47f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:20:59.736932 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a099d65-2e94-4d05-9480-f8796a09c47f None admin] PATH_INFO: `/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/d211582f9fc34b0e815e27db081c50c9/roles/ba21f19c24814b0cb6fd00d728df4447` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:20:59.739387 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a099d65-2e94-4d05-9480-f8796a09c47f None admin] RBAC: Authorizing `identity:create_grant(project_id=4389eb256aba4b7182e33cb3720b1073, user_id=d211582f9fc34b0e815e27db081c50c9, role_id=ba21f19c24814b0cb6fd00d728df4447)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:20:59.740861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a099d65-2e94-4d05-9480-f8796a09c47f None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:20:59.756524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 472/949] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:20:59 2022] PUT /identity/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/d211582f9fc34b0e815e27db081c50c9/roles/ba21f19c24814b0cb6fd00d728df4447 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:21:00.051284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d330fff-33f4-4602-89e5-1f08b60c0d2c None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:00.051833 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d330fff-33f4-4602-89e5-1f08b60c0d2c None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:00.051833 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d330fff-33f4-4602-89e5-1f08b60c0d2c None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:00.053464 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 478/950] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:00.059156 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de1a88-5ae2-405c-9a84-3e2de1c9febe None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:00.059569 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de1a88-5ae2-405c-9a84-3e2de1c9febe None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:00.059766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de1a88-5ae2-405c-9a84-3e2de1c9febe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:00.077228 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-d4de1a88-5ae2-405c-9a84-3e2de1c9febe None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:00.078727 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d4de1a88-5ae2-405c-9a84-3e2de1c9febe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:00.150870 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 473/951] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:21:00.172926 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d330fff-33f4-4602-89e5-1f08b60c0d2c None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:00.272936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d330fff-33f4-4602-89e5-1f08b60c0d2c None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:00.306773 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740bc10-2130-4670-89f9-2d2941764780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:00.307570 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740bc10-2130-4670-89f9-2d2941764780 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:00.307846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740bc10-2130-4670-89f9-2d2941764780 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:00.308113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740bc10-2130-4670-89f9-2d2941764780 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:00.308791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740bc10-2130-4670-89f9-2d2941764780 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:00.310167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740bc10-2130-4670-89f9-2d2941764780 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:00.322085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-4740bc10-2130-4670-89f9-2d2941764780 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 06 23:21:00.322085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:00.322085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:21:00.322085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:21:00.322085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:21:00.322085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:21:00.322085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:21:00.322085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:21:00.322085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 06 23:21:00.322085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:00.322085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:21:00.322085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:00.322085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:00.322085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:00.322085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:00.322085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:00.322085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:00.323119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:00.323119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:00.323119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:00.323119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:00.323119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:00.323119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:00.323119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:21:00.323119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:21:00.323119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:21:00.323119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:21:00.323119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:00.323119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:00.323119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:00.323119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:00.323119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:00.323119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:00.323985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:00.323985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:21:00.323985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:00.323985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:00.323985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:00.323985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:00.323985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:00.323985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:00.323985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:00.323985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:00.323985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:21:00.323985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:21:00.323985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 06 23:21:00.323985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:00.323985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 479/952] 10.222.0.60 () {56 vars in 1126 bytes} [Fri May 6 23:21:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:00.329552 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de1a88-5ae2-405c-9a84-3e2de1c9febe None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:00.436653 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de1a88-5ae2-405c-9a84-3e2de1c9febe None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:00.471004 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8a0cc-2efe-4ad7-a011-13a0428e5ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:00.471673 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8a0cc-2efe-4ad7-a011-13a0428e5ac0 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:00.471954 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8a0cc-2efe-4ad7-a011-13a0428e5ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:00.472236 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8a0cc-2efe-4ad7-a011-13a0428e5ac0 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:00.472975 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8a0cc-2efe-4ad7-a011-13a0428e5ac0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:00.473282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8a0cc-2efe-4ad7-a011-13a0428e5ac0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:00.474660 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8a0cc-2efe-4ad7-a011-13a0428e5ac0 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:00.480590 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 474/953] 10.222.0.60 () {56 vars in 1122 bytes} [Fri May 6 23:21:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:00.485923 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740bc10-2130-4670-89f9-2d2941764780 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:00.585072 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d895c0-abc2-49da-bb2a-02e30f5d6354 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:00.585440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d895c0-abc2-49da-bb2a-02e30f5d6354 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:00.585619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d895c0-abc2-49da-bb2a-02e30f5d6354 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:00.586114 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740bc10-2130-4670-89f9-2d2941764780 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:00.587803 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 475/954] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:21:00.593178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e8d83-34c6-4e4c-811f-3275e3a480b0 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:00.593464 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e8d83-34c6-4e4c-811f-3275e3a480b0 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:00.593744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e8d83-34c6-4e4c-811f-3275e3a480b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:00.610193 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-de0e8d83-34c6-4e4c-811f-3275e3a480b0 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:00.611372 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-de0e8d83-34c6-4e4c-811f-3275e3a480b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:00.623094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe329d3c-5c19-4ac7-824d-6be9dc76d266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:00.624065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe329d3c-5c19-4ac7-824d-6be9dc76d266 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:00.624349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe329d3c-5c19-4ac7-824d-6be9dc76d266 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:00.624702 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe329d3c-5c19-4ac7-824d-6be9dc76d266 None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:00.625570 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe329d3c-5c19-4ac7-824d-6be9dc76d266 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:00.625874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe329d3c-5c19-4ac7-824d-6be9dc76d266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:00.627913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe329d3c-5c19-4ac7-824d-6be9dc76d266 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:00.634720 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 480/955] 10.222.0.60 () {56 vars in 1122 bytes} [Fri May 6 23:21:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:00.640142 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe329d3c-5c19-4ac7-824d-6be9dc76d266 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:00.687751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 476/956] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:21:00.705359 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e8d83-34c6-4e4c-811f-3275e3a480b0 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:00.737334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe329d3c-5c19-4ac7-824d-6be9dc76d266 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:00.770168 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f49db-2c57-495c-848c-91bfe89f8906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:00.770835 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f49db-2c57-495c-848c-91bfe89f8906 None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:00.771112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f49db-2c57-495c-848c-91bfe89f8906 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:00.771382 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f49db-2c57-495c-848c-91bfe89f8906 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:00.772126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f49db-2c57-495c-848c-91bfe89f8906 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:00.773605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f49db-2c57-495c-848c-91bfe89f8906 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:00.800626 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 481/957] 10.222.0.60 () {60 vars in 1144 bytes} [Fri May 6 23:21:00 2022] POST /identity/v3/endpoints => generated 349 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:21:00.815062 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e8d83-34c6-4e4c-811f-3275e3a480b0 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:00.871444 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78184503-9693-4732-bb9d-f961a343c15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:00.872267 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78184503-9693-4732-bb9d-f961a343c15f None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:00.872564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78184503-9693-4732-bb9d-f961a343c15f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:00.872853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78184503-9693-4732-bb9d-f961a343c15f None admin] PATH_INFO: `/v3/services/compute` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:00.873527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78184503-9693-4732-bb9d-f961a343c15f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:00.874947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78184503-9693-4732-bb9d-f961a343c15f None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:00.888338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-78184503-9693-4732-bb9d-f961a343c15f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 06 23:21:00.888338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:00.888338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:21:00.888338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:21:00.888338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:21:00.888338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:21:00.888338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:21:00.888338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:21:00.888338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 06 23:21:00.888338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:00.888338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:21:00.888338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:00.888338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:00.888338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:00.888338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:00.888338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:00.888338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:00.891288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:00.891288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:00.891288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:00.891288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:00.891288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:00.891288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:00.891288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:21:00.891288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:21:00.891288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:21:00.891288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:21:00.891288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:00.891288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:00.891288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:00.891288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:00.891288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:00.891288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:00.893534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:00.893534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:21:00.893534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:00.893534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:00.893534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:00.893534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:00.893534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:00.893534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:00.893534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:00.893534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:00.893534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:21:00.893534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:21:00.893534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 06 23:21:00.893534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:00.895364 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 477/958] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:21:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:21:00.900564 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f49db-2c57-495c-848c-91bfe89f8906 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:01.009202 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f49db-2c57-495c-848c-91bfe89f8906 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:01.046122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee122924-00da-4268-ab79-168201a8e53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:01.046791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee122924-00da-4268-ab79-168201a8e53e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:01.047074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee122924-00da-4268-ab79-168201a8e53e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:01.047343 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee122924-00da-4268-ab79-168201a8e53e None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:01.048045 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee122924-00da-4268-ab79-168201a8e53e None admin] RBAC: Adding query filter params (name=compute) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:01.048349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee122924-00da-4268-ab79-168201a8e53e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:01.049806 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee122924-00da-4268-ab79-168201a8e53e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:01.054584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 482/959] 10.222.0.60 () {56 vars in 1112 bytes} [Fri May 6 23:21:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:01.060678 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78184503-9693-4732-bb9d-f961a343c15f None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:01.160674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78184503-9693-4732-bb9d-f961a343c15f None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:01.194272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d45ea1-fdd0-4906-a18c-02c36471b4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:01.194941 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d45ea1-fdd0-4906-a18c-02c36471b4a8 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:01.195225 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d45ea1-fdd0-4906-a18c-02c36471b4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:01.195503 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d45ea1-fdd0-4906-a18c-02c36471b4a8 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:01.196810 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d45ea1-fdd0-4906-a18c-02c36471b4a8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:01.197102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d45ea1-fdd0-4906-a18c-02c36471b4a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:01.198467 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d45ea1-fdd0-4906-a18c-02c36471b4a8 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:01.208769 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 478/960] 10.222.0.60 () {56 vars in 1112 bytes} [Fri May 6 23:21:01 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:01.904867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9f8d1-c858-4f39-adb2-9d5214e88133 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:01.905217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9f8d1-c858-4f39-adb2-9d5214e88133 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:01.905429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9f8d1-c858-4f39-adb2-9d5214e88133 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:01.907141 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 483/961] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:01.915647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03673af1-346f-4167-b0e8-8123d290ba4d None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:01.915647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03673af1-346f-4167-b0e8-8123d290ba4d None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:01.915647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03673af1-346f-4167-b0e8-8123d290ba4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:01.932502 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-03673af1-346f-4167-b0e8-8123d290ba4d None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:01.934004 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-03673af1-346f-4167-b0e8-8123d290ba4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:02.001783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 479/962] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:21:02.026405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9f8d1-c858-4f39-adb2-9d5214e88133 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:02.074005 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b53ad-9100-4edf-a789-d7fbbfe5c382 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:02.075013 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b53ad-9100-4edf-a789-d7fbbfe5c382 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:02.075492 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b53ad-9100-4edf-a789-d7fbbfe5c382 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:02.077479 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 480/963] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:21:02.083369 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a47533-f626-4375-8d71-6286cf4c354d None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:02.083972 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a47533-f626-4375-8d71-6286cf4c354d None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:02.084444 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a47533-f626-4375-8d71-6286cf4c354d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:02.105229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-52a47533-f626-4375-8d71-6286cf4c354d None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:02.107544 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-52a47533-f626-4375-8d71-6286cf4c354d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:02.143340 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9f8d1-c858-4f39-adb2-9d5214e88133 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:02.183068 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e6ad4-b065-48b0-b090-4520b87e151b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:02.183980 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e6ad4-b065-48b0-b090-4520b87e151b None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:02.184432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e6ad4-b065-48b0-b090-4520b87e151b None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:02.184894 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e6ad4-b065-48b0-b090-4520b87e151b None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:02.185766 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e6ad4-b065-48b0-b090-4520b87e151b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:02.187336 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e6ad4-b065-48b0-b090-4520b87e151b None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:02.188961 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: WARNING keystone.server.flask.common [None req-eb2e6ad4-b065-48b0-b090-4520b87e151b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 06 23:21:02.192796 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 481/964] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:21:02.205090 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.sql.core [None req-eb2e6ad4-b065-48b0-b090-4520b87e151b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 06 23:21:02.205090 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 06 23:21:02.205090 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [parameters: {'user_id': 'ecfcc68fd2cf4a6ab06a865e5da3ec6d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 06 23:21:02.205090 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79803) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 06 23:21:02.211150 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a47533-f626-4375-8d71-6286cf4c354d None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:02.225527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-eb2e6ad4-b065-48b0-b090-4520b87e151b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 06 23:21:02.225527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:02.225527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 06 23:21:02.225527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self.dialect.do_execute( May 06 23:21:02.225527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 06 23:21:02.225527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 06 23:21:02.225527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 06 23:21:02.225527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application result = self._query(query) May 06 23:21:02.225527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 06 23:21:02.225527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application conn.query(q) May 06 23:21:02.225527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 06 23:21:02.225527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 06 23:21:02.225527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 06 23:21:02.225527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application result.read() May 06 23:21:02.225527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 06 23:21:02.226469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 06 23:21:02.226469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 06 23:21:02.226469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application packet.raise_for_error() May 06 23:21:02.226469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 06 23:21:02.226469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 06 23:21:02.226469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 06 23:21:02.226469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 06 23:21:02.226469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 06 23:21:02.226469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:02.226469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 06 23:21:02.226469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:02.226469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:02.226469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 06 23:21:02.226469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 06 23:21:02.226469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 06 23:21:02.226469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 06 23:21:02.226469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 06 23:21:02.226469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application next(self.gen) May 06 23:21:02.227987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 06 23:21:02.227987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application yield resource May 06 23:21:02.227987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 06 23:21:02.227987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application next(self.gen) May 06 23:21:02.227987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 06 23:21:02.227987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self.session.rollback() May 06 23:21:02.227987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 06 23:21:02.227987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self.force_reraise() May 06 23:21:02.227987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 06 23:21:02.227987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise self.value May 06 23:21:02.227987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 06 23:21:02.227987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 06 23:21:02.227987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 06 23:21:02.227987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application session.commit() May 06 23:21:02.227987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 06 23:21:02.227987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 06 23:21:02.227987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 06 23:21:02.228965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._prepare_impl() May 06 23:21:02.228965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 06 23:21:02.228965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self.session.flush() May 06 23:21:02.228965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 06 23:21:02.228965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._flush(objects) May 06 23:21:02.228965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 06 23:21:02.228965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 06 23:21:02.228965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 06 23:21:02.228965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application compat.raise_( May 06 23:21:02.228965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 06 23:21:02.228965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception May 06 23:21:02.228965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 06 23:21:02.228965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application flush_context.execute() May 06 23:21:02.228965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 06 23:21:02.228965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rec.execute(self) May 06 23:21:02.228965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 06 23:21:02.228965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 06 23:21:02.229874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 06 23:21:02.229874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application _emit_insert_statements( May 06 23:21:02.229874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 06 23:21:02.229874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application result = connection._execute_20( May 06 23:21:02.229874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 06 23:21:02.229874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 06 23:21:02.229874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 06 23:21:02.229874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 06 23:21:02.229874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 06 23:21:02.229874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ret = self._execute_context( May 06 23:21:02.229874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 06 23:21:02.229874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 06 23:21:02.229874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 06 23:21:02.229874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 06 23:21:02.229874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 06 23:21:02.229874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception May 06 23:21:02.232908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 06 23:21:02.232908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self.dialect.do_execute( May 06 23:21:02.232908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 06 23:21:02.232908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 06 23:21:02.232908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 06 23:21:02.232908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application result = self._query(query) May 06 23:21:02.232908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 06 23:21:02.232908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application conn.query(q) May 06 23:21:02.232908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 06 23:21:02.232908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 06 23:21:02.232908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 06 23:21:02.232908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application result.read() May 06 23:21:02.232908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 06 23:21:02.232908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 06 23:21:02.232908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 06 23:21:02.232908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application packet.raise_for_error() May 06 23:21:02.235684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 06 23:21:02.235684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 06 23:21:02.235684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 06 23:21:02.235684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 06 23:21:02.235684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 06 23:21:02.235684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 06 23:21:02.235684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ecfcc68fd2cf4a6ab06a865e5da3ec6d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 06 23:21:02.235684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 06 23:21:02.235684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:02.235684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:21:02.235684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:02.235684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:02.235684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:02.235684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:02.235684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:02.237977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:02.237977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:02.237977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:02.237977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:02.237977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:02.237977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:02.237977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:02.237977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 06 23:21:02.237977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 06 23:21:02.237977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:02.237977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:02.237977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:21:02.237977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:21:02.237977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:21:02.237977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:21:02.237977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 06 23:21:02.237977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 06 23:21:02.240316 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 06 23:21:02.240316 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 06 23:21:02.240316 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 06 23:21:02.240316 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 06 23:21:02.240316 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 06 23:21:02.240316 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:02.240316 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 484/965] 10.222.0.60 () {60 vars in 1131 bytes} [Fri May 6 23:21:02 2022] POST /identity/v3/users => generated 160 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:02.240316 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e6ad4-b065-48b0-b090-4520b87e151b None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:02.321964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a47533-f626-4375-8d71-6286cf4c354d None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:02.342744 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e6ad4-b065-48b0-b090-4520b87e151b None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:02.358164 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43893b-32a2-475c-bb94-c39c5c6eb094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:02.359347 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43893b-32a2-475c-bb94-c39c5c6eb094 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:02.359830 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43893b-32a2-475c-bb94-c39c5c6eb094 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:02.360327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43893b-32a2-475c-bb94-c39c5c6eb094 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:02.371217 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43893b-32a2-475c-bb94-c39c5c6eb094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:21:02.378483 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e021f-1da5-4daa-976a-18c5e39ea73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:02.379272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e021f-1da5-4daa-976a-18c5e39ea73c None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:02.379551 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e021f-1da5-4daa-976a-18c5e39ea73c None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:02.379823 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e021f-1da5-4daa-976a-18c5e39ea73c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:02.380429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-6e43893b-32a2-475c-bb94-c39c5c6eb094 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 06 23:21:02.380429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:02.380429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:02.380429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:02.380429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:02.380429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:02.380429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:02.380429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:02.380429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:02.380429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:02.380429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:02.380429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:02.380429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:21:02.380429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:21:02.380429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:21:02.380429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:21:02.381412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:21:02.381412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:21:02.381412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:21:02.381412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:21:02.381412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:02.381412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:02.381412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:02.381412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:02.381412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:02.381412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:02.381412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:02.381412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:21:02.381412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:02.381412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:02.381412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:02.381412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:02.382262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:02.382262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:02.382262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:02.382262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:02.382262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:21:02.382262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:21:02.382262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:21:02.382262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:21:02.382262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:21:02.382262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:21:02.382262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 06 23:21:02.382262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:02.387483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 482/966] 10.222.0.60 () {56 vars in 1120 bytes} [Fri May 6 23:21:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:21:02.388697 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43893b-32a2-475c-bb94-c39c5c6eb094 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:02.391511 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e021f-1da5-4daa-976a-18c5e39ea73c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:02.393393 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e021f-1da5-4daa-976a-18c5e39ea73c None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:02.407863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-236e021f-1da5-4daa-976a-18c5e39ea73c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 06 23:21:02.407863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:02.407863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:02.407863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:02.407863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:02.407863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:02.407863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:02.407863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:02.407863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:02.407863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:02.407863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:02.407863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:02.407863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:21:02.407863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:21:02.407863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:21:02.407863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:21:02.408836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:02.408836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:02.408836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:21:02.408836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:21:02.408836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:21:02.408836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:21:02.408836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:02.408836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:02.408836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:02.408836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:02.408836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:02.408836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:21:02.408836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:02.408836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:02.408836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:02.408836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:02.408836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:02.408836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:02.409755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:02.409755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:02.409755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:21:02.409755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:21:02.409755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:21:02.409755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:21:02.409755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:21:02.409755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:21:02.409755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 06 23:21:02.409755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:02.412389 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 485/967] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:21:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:02.420583 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e021f-1da5-4daa-976a-18c5e39ea73c None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:02.515145 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43893b-32a2-475c-bb94-c39c5c6eb094 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:02.528523 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e021f-1da5-4daa-976a-18c5e39ea73c None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:02.549849 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69875515-eff2-4ddd-ae77-6692cfc6eed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:02.550524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69875515-eff2-4ddd-ae77-6692cfc6eed4 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:02.550806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69875515-eff2-4ddd-ae77-6692cfc6eed4 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:02.551132 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69875515-eff2-4ddd-ae77-6692cfc6eed4 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:02.551891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69875515-eff2-4ddd-ae77-6692cfc6eed4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:02.552200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69875515-eff2-4ddd-ae77-6692cfc6eed4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:02.553752 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69875515-eff2-4ddd-ae77-6692cfc6eed4 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:02.567279 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 483/968] 10.222.0.60 () {56 vars in 1115 bytes} [Fri May 6 23:21:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:02.569284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69875515-eff2-4ddd-ae77-6692cfc6eed4 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:02.574495 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35f6de-f044-4399-b504-e4eb49d459a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:02.575247 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35f6de-f044-4399-b504-e4eb49d459a0 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:02.575599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35f6de-f044-4399-b504-e4eb49d459a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:02.575943 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35f6de-f044-4399-b504-e4eb49d459a0 None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:02.576916 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35f6de-f044-4399-b504-e4eb49d459a0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:02.577295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35f6de-f044-4399-b504-e4eb49d459a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:02.578840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35f6de-f044-4399-b504-e4eb49d459a0 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:02.624745 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 486/969] 10.222.0.60 () {56 vars in 1101 bytes} [Fri May 6 23:21:02 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:02.675197 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69875515-eff2-4ddd-ae77-6692cfc6eed4 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:02.713129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b055869-5ba4-4d71-8259-521d061ecbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:02.714488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b055869-5ba4-4d71-8259-521d061ecbd6 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:02.714918 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b055869-5ba4-4d71-8259-521d061ecbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:02.715335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b055869-5ba4-4d71-8259-521d061ecbd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:02.727702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b055869-5ba4-4d71-8259-521d061ecbd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:02.729472 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b055869-5ba4-4d71-8259-521d061ecbd6 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:02.748241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-1b055869-5ba4-4d71-8259-521d061ecbd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:21:02.748241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:02.748241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:02.748241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:02.748241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:02.748241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:02.748241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:02.748241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:02.748241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:02.748241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:02.748241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:02.748241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:02.748241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:21:02.748241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:21:02.748241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:21:02.749514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:21:02.749514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:02.749514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:02.749514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:02.749514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:02.749514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:02.749514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:02.749514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:02.749514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:21:02.749514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:02.749514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:02.749514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:02.749514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:02.749514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:02.749514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:02.749514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:02.749514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:02.750689 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:21:02.750689 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:21:02.750689 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:21:02.750689 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:02.756819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 484/970] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:21:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:21:02.758920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35f6de-f044-4399-b504-e4eb49d459a0 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:02.868480 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35f6de-f044-4399-b504-e4eb49d459a0 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:02.902823 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1da2c-932c-432c-8d24-b1f0f2e5f5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:02.903825 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1da2c-932c-432c-8d24-b1f0f2e5f5f2 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:02.904394 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1da2c-932c-432c-8d24-b1f0f2e5f5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:02.904893 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1da2c-932c-432c-8d24-b1f0f2e5f5f2 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:02.905823 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1da2c-932c-432c-8d24-b1f0f2e5f5f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:02.906342 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1da2c-932c-432c-8d24-b1f0f2e5f5f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:02.907897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1da2c-932c-432c-8d24-b1f0f2e5f5f2 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:02.920836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 487/971] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:02.926207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b055869-5ba4-4d71-8259-521d061ecbd6 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:03.024949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b055869-5ba4-4d71-8259-521d061ecbd6 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:03.061688 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb277715-4f80-4e99-9fa2-ba3dfdb45faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:03.062527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb277715-4f80-4e99-9fa2-ba3dfdb45faa None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:03.062804 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb277715-4f80-4e99-9fa2-ba3dfdb45faa None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:03.063077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb277715-4f80-4e99-9fa2-ba3dfdb45faa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:03.071997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb277715-4f80-4e99-9fa2-ba3dfdb45faa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:03.073494 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb277715-4f80-4e99-9fa2-ba3dfdb45faa None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:03.088742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-bb277715-4f80-4e99-9fa2-ba3dfdb45faa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 06 23:21:03.088742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:03.088742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:03.088742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:03.088742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:03.088742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:03.088742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:03.088742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:03.088742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:03.088742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:03.088742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:03.088742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:03.088742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:21:03.088742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:21:03.088742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:21:03.088742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:21:03.090388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:03.090388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:03.090388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:21:03.090388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:21:03.090388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:21:03.090388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:21:03.090388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:03.090388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:03.090388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:03.090388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:03.090388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:03.090388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:21:03.090388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:03.090388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:03.090388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:03.090388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:03.090388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:03.090388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:03.096425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:03.096425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:03.096425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:21:03.096425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:21:03.096425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:21:03.096425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:21:03.096425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:21:03.096425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:21:03.096425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 06 23:21:03.096425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:03.096425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 485/972] 10.222.0.60 () {56 vars in 1117 bytes} [Fri May 6 23:21:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:21:03.098531 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1da2c-932c-432c-8d24-b1f0f2e5f5f2 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:03.193221 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1da2c-932c-432c-8d24-b1f0f2e5f5f2 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:03.225985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8629f-d0ec-453b-ad24-1f8513f09eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:03.226859 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8629f-d0ec-453b-ad24-1f8513f09eaf None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:03.227140 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8629f-d0ec-453b-ad24-1f8513f09eaf None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:03.227412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8629f-d0ec-453b-ad24-1f8513f09eaf None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:03.228137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed2813-aba7-40de-b60a-be4639c73e58 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:03.228253 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8629f-d0ec-453b-ad24-1f8513f09eaf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:03.228420 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed2813-aba7-40de-b60a-be4639c73e58 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:03.228621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8629f-d0ec-453b-ad24-1f8513f09eaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:03.228720 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed2813-aba7-40de-b60a-be4639c73e58 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:03.229994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8629f-d0ec-453b-ad24-1f8513f09eaf None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:03.230312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 486/973] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:21:03.235098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9583e-358e-4dae-956e-ea580ae9b341 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:03.235392 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9583e-358e-4dae-956e-ea580ae9b341 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:03.235672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9583e-358e-4dae-956e-ea580ae9b341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:03.247819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 488/974] 10.222.0.60 () {56 vars in 1149 bytes} [Fri May 6 23:21:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:03.252412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-64c9583e-358e-4dae-956e-ea580ae9b341 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:03.253309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8629f-d0ec-453b-ad24-1f8513f09eaf None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:03.253602 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-64c9583e-358e-4dae-956e-ea580ae9b341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:03.323298 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 487/975] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:21:03.345864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9583e-358e-4dae-956e-ea580ae9b341 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:03.354226 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8629f-d0ec-453b-ad24-1f8513f09eaf None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:03.389643 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83b083-45c0-46a0-a44f-eed36f1326a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:03.390288 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83b083-45c0-46a0-a44f-eed36f1326a0 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:03.390569 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83b083-45c0-46a0-a44f-eed36f1326a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:03.390848 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83b083-45c0-46a0-a44f-eed36f1326a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:03.444807 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9583e-358e-4dae-956e-ea580ae9b341 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:03.456500 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83b083-45c0-46a0-a44f-eed36f1326a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:03.457988 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83b083-45c0-46a0-a44f-eed36f1326a0 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:03.480621 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6222c-169f-4848-a3ce-51c8fd4e4ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:03.481987 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6222c-169f-4848-a3ce-51c8fd4e4ecb None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:03.482279 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6222c-169f-4848-a3ce-51c8fd4e4ecb None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:03.482557 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6222c-169f-4848-a3ce-51c8fd4e4ecb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:03.483213 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6222c-169f-4848-a3ce-51c8fd4e4ecb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:03.484986 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6222c-169f-4848-a3ce-51c8fd4e4ecb None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:03.500605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-a4e6222c-169f-4848-a3ce-51c8fd4e4ecb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 06 23:21:03.500605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:03.500605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:21:03.500605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:21:03.500605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:21:03.500605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:21:03.500605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:21:03.500605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:21:03.500605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 06 23:21:03.500605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:03.500605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:21:03.500605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:03.500605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:03.500605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:03.500605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:03.500605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:03.500605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:03.501745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:03.501745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:03.501745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:03.501745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:03.501745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:03.501745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:03.501745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:21:03.501745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:21:03.501745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:21:03.501745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:21:03.501745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:03.501745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:03.501745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:03.501745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:03.501745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:03.501745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:03.502624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:03.502624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:21:03.502624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:03.502624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:03.502624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:03.502624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:03.502624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:03.502624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:03.502624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:03.502624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:03.502624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:21:03.502624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:21:03.502624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 06 23:21:03.502624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:03.502624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 488/976] 10.222.0.60 () {56 vars in 1126 bytes} [Fri May 6 23:21:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:21:03.503446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264a6c6-aff2-457b-af61-a3aa11a6405a None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:03.503446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264a6c6-aff2-457b-af61-a3aa11a6405a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:03.503712 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264a6c6-aff2-457b-af61-a3aa11a6405a None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:03.505137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 489/977] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:03.507621 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264a6c6-aff2-457b-af61-a3aa11a6405a None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:03.561383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 489/978] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:21:03 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 06 23:21:03.562841 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520693a7-2ce9-4122-919a-b2a203596e18 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:03.563131 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520693a7-2ce9-4122-919a-b2a203596e18 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:03.563415 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520693a7-2ce9-4122-919a-b2a203596e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:03.578770 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-520693a7-2ce9-4122-919a-b2a203596e18 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:03.580246 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-520693a7-2ce9-4122-919a-b2a203596e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:03.605929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264a6c6-aff2-457b-af61-a3aa11a6405a None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:03.637970 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b481461-08bc-47f2-8c7b-789e029563f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:03.638622 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b481461-08bc-47f2-8c7b-789e029563f9 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:03.638905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b481461-08bc-47f2-8c7b-789e029563f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:03.639180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b481461-08bc-47f2-8c7b-789e029563f9 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:03.639880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b481461-08bc-47f2-8c7b-789e029563f9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:03.640185 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b481461-08bc-47f2-8c7b-789e029563f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:03.641642 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b481461-08bc-47f2-8c7b-789e029563f9 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:03.642505 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 490/979] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:21:03.643407 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520693a7-2ce9-4122-919a-b2a203596e18 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:03.656399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 490/980] 10.222.0.60 () {56 vars in 1122 bytes} [Fri May 6 23:21:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:03.661853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b481461-08bc-47f2-8c7b-789e029563f9 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:03.734966 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520693a7-2ce9-4122-919a-b2a203596e18 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:03.754813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b481461-08bc-47f2-8c7b-789e029563f9 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:03.765942 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cda62-93e5-4af6-94c2-153d867ed2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:03.766719 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cda62-93e5-4af6-94c2-153d867ed2e1 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:03.766997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cda62-93e5-4af6-94c2-153d867ed2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:03.767267 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cda62-93e5-4af6-94c2-153d867ed2e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:03.777115 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cda62-93e5-4af6-94c2-153d867ed2e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:03.778548 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cda62-93e5-4af6-94c2-153d867ed2e1 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:03.787183 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77e72e-f3f1-4072-a902-4aa449ee9bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:03.787835 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77e72e-f3f1-4072-a902-4aa449ee9bc1 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:03.788167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77e72e-f3f1-4072-a902-4aa449ee9bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:03.788449 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77e72e-f3f1-4072-a902-4aa449ee9bc1 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:03.789729 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77e72e-f3f1-4072-a902-4aa449ee9bc1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:03.790043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77e72e-f3f1-4072-a902-4aa449ee9bc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:03.791389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77e72e-f3f1-4072-a902-4aa449ee9bc1 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:03.795126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-7c4cda62-93e5-4af6-94c2-153d867ed2e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:21:03.795126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:03.795126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:03.795126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:03.795126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:03.795126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:03.795126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:03.795126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:03.795126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:03.795126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:03.795126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:03.795126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:03.795126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:21:03.795126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:21:03.795126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:21:03.796016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:21:03.796016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:03.796016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:03.796016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:03.796016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:03.796016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:03.796016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:03.796016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:03.796016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:21:03.796016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:03.796016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:03.796016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:03.796016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:03.796016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:03.796016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:03.796016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:03.796016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:03.797448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:21:03.797448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:21:03.797448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:21:03.797448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:03.797739 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 491/981] 10.222.0.60 () {56 vars in 1122 bytes} [Fri May 6 23:21:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:03.797832 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 491/982] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:21:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:03.797928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77e72e-f3f1-4072-a902-4aa449ee9bc1 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:03.802254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cda62-93e5-4af6-94c2-153d867ed2e1 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:03.894297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77e72e-f3f1-4072-a902-4aa449ee9bc1 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:03.902220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cda62-93e5-4af6-94c2-153d867ed2e1 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:03.925802 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e2446-f722-4aac-9ccb-ff6d269cf345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:03.926452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e2446-f722-4aac-9ccb-ff6d269cf345 None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:03.926725 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e2446-f722-4aac-9ccb-ff6d269cf345 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:03.926997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e2446-f722-4aac-9ccb-ff6d269cf345 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:03.927706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e2446-f722-4aac-9ccb-ff6d269cf345 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:03.929100 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e2446-f722-4aac-9ccb-ff6d269cf345 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:03.934007 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cac3a-2dcf-49a0-9056-b91e6ec951e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:03.934656 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cac3a-2dcf-49a0-9056-b91e6ec951e3 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:03.934942 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cac3a-2dcf-49a0-9056-b91e6ec951e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:03.935210 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cac3a-2dcf-49a0-9056-b91e6ec951e3 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:03.935920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7cac3a-2dcf-49a0-9056-b91e6ec951e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:03.936225 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7cac3a-2dcf-49a0-9056-b91e6ec951e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:03.937607 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7cac3a-2dcf-49a0-9056-b91e6ec951e3 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:03.942274 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 492/983] 10.222.0.60 () {60 vars in 1141 bytes} [Fri May 6 23:21:03 2022] POST /identity/v3/services => generated 242 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:21:03.942878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e2446-f722-4aac-9ccb-ff6d269cf345 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:03.949442 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 492/984] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:03.955629 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cac3a-2dcf-49a0-9056-b91e6ec951e3 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:04.064760 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cac3a-2dcf-49a0-9056-b91e6ec951e3 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:04.065847 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e2446-f722-4aac-9ccb-ff6d269cf345 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:04.100506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda4b69-c80e-4136-a2ad-0edbe83b1681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:04.101178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132e2da-2562-4176-a869-4b6956e08963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:04.101652 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda4b69-c80e-4136-a2ad-0edbe83b1681 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:04.101652 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda4b69-c80e-4136-a2ad-0edbe83b1681 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:04.102474 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132e2da-2562-4176-a869-4b6956e08963 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:04.102582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda4b69-c80e-4136-a2ad-0edbe83b1681 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:04.102751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132e2da-2562-4176-a869-4b6956e08963 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:04.102972 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132e2da-2562-4176-a869-4b6956e08963 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:04.103789 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132e2da-2562-4176-a869-4b6956e08963 None admin] RBAC: Adding query filter params (interface=admin, service_id=7828608ab89c4d188ea571cb2c81ba22, region_id=RegionOne) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:04.104101 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132e2da-2562-4176-a869-4b6956e08963 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:04.105603 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132e2da-2562-4176-a869-4b6956e08963 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:04.110331 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda4b69-c80e-4136-a2ad-0edbe83b1681 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:04.115854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda4b69-c80e-4136-a2ad-0edbe83b1681 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:04.116000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 493/985] 10.222.0.60 () {56 vars in 1249 bytes} [Fri May 6 23:21:03 2022] GET /identity/v3/endpoints?service_id=7828608ab89c4d188ea571cb2c81ba22&interface=admin®ion_id=RegionOne => generated 193 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:04.116963 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132e2da-2562-4176-a869-4b6956e08963 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:04.126123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-adda4b69-c80e-4136-a2ad-0edbe83b1681 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:21:04.126123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:04.126123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:04.126123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:04.126123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:04.126123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:04.126123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:04.126123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:04.126123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:04.126123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:04.126123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:04.126123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:04.126123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:21:04.126123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:21:04.126123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:21:04.127031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:21:04.127031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:04.127031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:04.127031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:04.127031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:04.127031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:04.127031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:04.127031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:04.127031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:21:04.127031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:04.127031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:04.127031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:04.127031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:04.127031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:04.127031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:04.127031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:04.127031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:04.128005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:21:04.128005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:21:04.128005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:21:04.128005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:21:04.128005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:21:04.128005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:21:04.128005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:21:04.128005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:04.128005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 493/986] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:21:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:21:04.133025 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda4b69-c80e-4136-a2ad-0edbe83b1681 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:04.221533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132e2da-2562-4176-a869-4b6956e08963 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:04.243689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda4b69-c80e-4136-a2ad-0edbe83b1681 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:04.254586 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c353def-3e9a-485b-b966-923d271092b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:04.255336 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c353def-3e9a-485b-b966-923d271092b5 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:04.255613 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c353def-3e9a-485b-b966-923d271092b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:04.255881 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c353def-3e9a-485b-b966-923d271092b5 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:04.256578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c353def-3e9a-485b-b966-923d271092b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:04.257970 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c353def-3e9a-485b-b966-923d271092b5 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:04.264429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 494/987] 10.222.0.60 () {56 vars in 1087 bytes} [Fri May 6 23:21:04 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:21:04.278123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c696c-f107-47c6-b897-6336396d9a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:04.278808 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c696c-f107-47c6-b897-6336396d9a1c None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:04.279093 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c696c-f107-47c6-b897-6336396d9a1c None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:04.279371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c696c-f107-47c6-b897-6336396d9a1c None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:04.280181 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c696c-f107-47c6-b897-6336396d9a1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:04.280494 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c696c-f107-47c6-b897-6336396d9a1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:04.282024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c696c-f107-47c6-b897-6336396d9a1c None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:04.296842 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 494/988] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:21:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:04.302729 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c353def-3e9a-485b-b966-923d271092b5 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:04.407478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c353def-3e9a-485b-b966-923d271092b5 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:04.441293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317cd33-57e4-42ee-82ef-39555f57c43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:04.441966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317cd33-57e4-42ee-82ef-39555f57c43f None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:04.442245 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317cd33-57e4-42ee-82ef-39555f57c43f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:04.442521 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317cd33-57e4-42ee-82ef-39555f57c43f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:04.443358 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317cd33-57e4-42ee-82ef-39555f57c43f None admin] RBAC: Adding query filter params (role.id=ba21f19c24814b0cb6fd00d728df4447, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=d211582f9fc34b0e815e27db081c50c9) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:04.443668 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317cd33-57e4-42ee-82ef-39555f57c43f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:04.445153 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317cd33-57e4-42ee-82ef-39555f57c43f None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:04.452111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 495/989] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:21:04 2022] GET /identity/v3/role_assignments?user.id=d211582f9fc34b0e815e27db081c50c9&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=ba21f19c24814b0cb6fd00d728df4447 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:06.247454 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7446c-491a-4a3d-832c-9bec7f26dffc None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:06.247941 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7446c-491a-4a3d-832c-9bec7f26dffc None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:06.247941 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7446c-491a-4a3d-832c-9bec7f26dffc None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:06.249377 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 495/990] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:06.254566 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945c7e8-9aa6-4f94-a8ba-1c21e78eaae0 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:06.254988 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945c7e8-9aa6-4f94-a8ba-1c21e78eaae0 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:06.255184 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945c7e8-9aa6-4f94-a8ba-1c21e78eaae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:06.272493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-c945c7e8-9aa6-4f94-a8ba-1c21e78eaae0 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:06.274214 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c945c7e8-9aa6-4f94-a8ba-1c21e78eaae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:06.343468 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 496/991] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:21:06.365271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7446c-491a-4a3d-832c-9bec7f26dffc None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:06.463730 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7446c-491a-4a3d-832c-9bec7f26dffc None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:06.477963 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8c912-4ab8-40b3-9c1f-0dbea67b0044 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:06.478247 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8c912-4ab8-40b3-9c1f-0dbea67b0044 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:06.478517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8c912-4ab8-40b3-9c1f-0dbea67b0044 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:06.480584 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 497/992] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:21:06.484818 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae36d8-fc24-41b2-8853-3bc9373078b2 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:06.485109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae36d8-fc24-41b2-8853-3bc9373078b2 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:06.485388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae36d8-fc24-41b2-8853-3bc9373078b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:06.499563 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0e708-c352-4e5d-93d4-14a860edcd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:06.500279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0e708-c352-4e5d-93d4-14a860edcd1f None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:06.500569 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0e708-c352-4e5d-93d4-14a860edcd1f None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:06.500848 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0e708-c352-4e5d-93d4-14a860edcd1f None admin] PATH_INFO: `/v3/services/compute` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:06.501497 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0e708-c352-4e5d-93d4-14a860edcd1f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:06.502224 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-30ae36d8-fc24-41b2-8853-3bc9373078b2 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:06.502865 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0e708-c352-4e5d-93d4-14a860edcd1f None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:06.503419 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-30ae36d8-fc24-41b2-8853-3bc9373078b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:06.515606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-3cd0e708-c352-4e5d-93d4-14a860edcd1f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 06 23:21:06.515606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:06.515606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:21:06.515606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:21:06.515606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:21:06.515606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:21:06.515606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:21:06.515606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:21:06.515606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 06 23:21:06.515606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:06.515606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:21:06.515606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:06.515606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:06.515606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:06.515606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:06.515606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:06.515606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:06.516648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:06.516648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:06.516648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:06.516648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:06.516648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:06.516648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:06.516648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:21:06.516648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:21:06.516648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:21:06.516648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:21:06.516648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:06.516648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:06.516648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:06.516648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:06.516648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:06.516648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:06.517504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:06.517504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:21:06.517504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:06.517504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:06.517504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:06.517504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:06.517504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:06.517504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:06.517504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:06.517504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:06.517504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:21:06.517504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:21:06.517504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 06 23:21:06.517504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:06.520861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 496/993] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:21:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:06.522653 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0e708-c352-4e5d-93d4-14a860edcd1f None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:06.574029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 498/994] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:21:06.596145 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae36d8-fc24-41b2-8853-3bc9373078b2 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:06.621759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0e708-c352-4e5d-93d4-14a860edcd1f None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:06.654717 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ecaf4-68f6-42d0-aadb-c367a33b1f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:06.655379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ecaf4-68f6-42d0-aadb-c367a33b1f27 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:06.655662 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ecaf4-68f6-42d0-aadb-c367a33b1f27 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:06.655941 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ecaf4-68f6-42d0-aadb-c367a33b1f27 None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:06.656674 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ecaf4-68f6-42d0-aadb-c367a33b1f27 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:06.656985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ecaf4-68f6-42d0-aadb-c367a33b1f27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:06.658359 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ecaf4-68f6-42d0-aadb-c367a33b1f27 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:06.668288 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 497/995] 10.222.0.60 () {56 vars in 1112 bytes} [Fri May 6 23:21:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:06.669299 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ecaf4-68f6-42d0-aadb-c367a33b1f27 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:06.690478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae36d8-fc24-41b2-8853-3bc9373078b2 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:06.724231 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b4cae-806a-4077-8216-fc2903238bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:06.725057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b4cae-806a-4077-8216-fc2903238bf1 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:06.725332 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b4cae-806a-4077-8216-fc2903238bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:06.725600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b4cae-806a-4077-8216-fc2903238bf1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:06.726246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b4cae-806a-4077-8216-fc2903238bf1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:06.728136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b4cae-806a-4077-8216-fc2903238bf1 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:06.739650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-714b4cae-806a-4077-8216-fc2903238bf1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 06 23:21:06.739650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:06.739650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:21:06.739650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:21:06.739650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:21:06.739650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:21:06.739650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:21:06.739650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:21:06.739650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 06 23:21:06.739650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:06.739650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:21:06.739650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:06.739650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:06.739650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:06.739650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:06.739650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:06.739650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:06.740756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:06.740756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:06.740756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:06.740756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:06.740756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:06.740756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:06.740756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:21:06.740756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:21:06.740756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:21:06.740756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:21:06.740756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:06.740756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:06.740756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:06.740756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:06.740756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:06.740756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:06.741600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:06.741600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:21:06.741600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:06.741600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:06.741600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:06.741600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:06.741600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:06.741600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:06.741600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:06.741600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:06.741600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:21:06.741600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:21:06.741600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 06 23:21:06.741600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:06.741600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 499/996] 10.222.0.60 () {56 vars in 1126 bytes} [Fri May 6 23:21:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:21:06.743035 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f6291-be32-4ee7-aecf-ac3ccd409f6b None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:06.743154 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f6291-be32-4ee7-aecf-ac3ccd409f6b None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:06.744571 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f6291-be32-4ee7-aecf-ac3ccd409f6b None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:06.744918 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 500/997] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:06.747111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f6291-be32-4ee7-aecf-ac3ccd409f6b None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:06.768375 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ecaf4-68f6-42d0-aadb-c367a33b1f27 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:06.800338 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5a728-3893-4bd6-adc0-dfce76aabaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:06.801009 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5a728-3893-4bd6-adc0-dfce76aabaa8 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:06.801294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5a728-3893-4bd6-adc0-dfce76aabaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:06.801570 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5a728-3893-4bd6-adc0-dfce76aabaa8 None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:06.802272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5a728-3893-4bd6-adc0-dfce76aabaa8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:06.802579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5a728-3893-4bd6-adc0-dfce76aabaa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:06.803945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5a728-3893-4bd6-adc0-dfce76aabaa8 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:06.809158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 498/998] 10.222.0.60 () {56 vars in 1112 bytes} [Fri May 6 23:21:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:06.810312 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843dc77-b394-4d68-8475-116643a895d9 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:06.810598 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843dc77-b394-4d68-8475-116643a895d9 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:06.810875 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843dc77-b394-4d68-8475-116643a895d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:06.826279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-6843dc77-b394-4d68-8475-116643a895d9 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:06.827459 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-6843dc77-b394-4d68-8475-116643a895d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:06.842107 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f6291-be32-4ee7-aecf-ac3ccd409f6b None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:06.874637 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbac2b6-5410-4970-8172-bb3698fad4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:06.875286 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbac2b6-5410-4970-8172-bb3698fad4fc None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:06.875563 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbac2b6-5410-4970-8172-bb3698fad4fc None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:06.875832 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbac2b6-5410-4970-8172-bb3698fad4fc None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:06.876528 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbac2b6-5410-4970-8172-bb3698fad4fc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:06.876859 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbac2b6-5410-4970-8172-bb3698fad4fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:06.878211 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbac2b6-5410-4970-8172-bb3698fad4fc None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:06.882724 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 501/999] 10.222.0.60 () {56 vars in 1122 bytes} [Fri May 6 23:21:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:06.883511 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbac2b6-5410-4970-8172-bb3698fad4fc None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:06.894733 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 499/1000] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:21:06.895571 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843dc77-b394-4d68-8475-116643a895d9 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:06.975953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbac2b6-5410-4970-8172-bb3698fad4fc None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:06.987169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843dc77-b394-4d68-8475-116643a895d9 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:07.008698 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07422506-ee41-4867-bd6f-65137be1b707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:07.009352 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07422506-ee41-4867-bd6f-65137be1b707 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:07.009633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07422506-ee41-4867-bd6f-65137be1b707 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:07.009904 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07422506-ee41-4867-bd6f-65137be1b707 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:07.010713 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07422506-ee41-4867-bd6f-65137be1b707 None admin] RBAC: Adding query filter params (interface=public, service_id=e4198bb4250049f99b86ec70fcb9ee75, region_id=RegionOne) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:07.011025 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07422506-ee41-4867-bd6f-65137be1b707 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:07.012386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07422506-ee41-4867-bd6f-65137be1b707 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:07.017218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 502/1001] 10.222.0.60 () {56 vars in 1251 bytes} [Fri May 6 23:21:06 2022] GET /identity/v3/endpoints?service_id=e4198bb4250049f99b86ec70fcb9ee75&interface=public®ion_id=RegionOne => generated 194 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:07.017987 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07422506-ee41-4867-bd6f-65137be1b707 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:07.023056 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6829dbe-742a-4dfc-8fb3-0e114cad4c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:07.024189 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6829dbe-742a-4dfc-8fb3-0e114cad4c2b None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:07.024471 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6829dbe-742a-4dfc-8fb3-0e114cad4c2b None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:07.024774 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6829dbe-742a-4dfc-8fb3-0e114cad4c2b None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:07.025475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6829dbe-742a-4dfc-8fb3-0e114cad4c2b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:07.025779 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6829dbe-742a-4dfc-8fb3-0e114cad4c2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:07.027138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6829dbe-742a-4dfc-8fb3-0e114cad4c2b None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:07.036287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 500/1002] 10.222.0.60 () {56 vars in 1122 bytes} [Fri May 6 23:21:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:07.036287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6829dbe-742a-4dfc-8fb3-0e114cad4c2b None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:07.110302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07422506-ee41-4867-bd6f-65137be1b707 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:07.129318 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6829dbe-742a-4dfc-8fb3-0e114cad4c2b None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:07.141049 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b069fd-8382-430d-8381-707731a0612d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:07.141820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b069fd-8382-430d-8381-707731a0612d None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:07.142097 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b069fd-8382-430d-8381-707731a0612d None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:07.142369 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b069fd-8382-430d-8381-707731a0612d None admin] PATH_INFO: `/v3/services/image` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:07.143015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b069fd-8382-430d-8381-707731a0612d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:07.144374 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b069fd-8382-430d-8381-707731a0612d None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:07.155927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-d4b069fd-8382-430d-8381-707731a0612d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 06 23:21:07.155927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:07.155927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:21:07.155927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:21:07.155927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:21:07.155927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:21:07.155927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:21:07.155927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:21:07.155927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 06 23:21:07.155927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:07.155927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:21:07.155927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:07.155927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:07.155927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:07.155927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:07.155927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:07.155927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:07.156938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:07.156938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:07.156938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:07.156938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:07.156938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:07.156938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:07.156938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:21:07.156938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:21:07.156938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:21:07.156938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:21:07.156938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:07.156938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:07.156938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:07.156938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:07.156938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:07.156938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:07.157781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:07.157781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:21:07.157781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:07.157781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:07.157781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:07.157781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:07.157781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:07.157781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:07.157781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:07.157781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:07.157781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:21:07.157781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:21:07.157781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 06 23:21:07.157781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:07.157781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 503/1003] 10.222.0.60 () {56 vars in 1105 bytes} [Fri May 6 23:21:07 2022] GET /identity/v3/services/image => generated 86 bytes in 139 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:07.158576 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b069fd-8382-430d-8381-707731a0612d None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:07.162006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54202e5a-9785-45f0-893f-1c03bbe943a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:07.162667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54202e5a-9785-45f0-893f-1c03bbe943a3 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:07.162945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54202e5a-9785-45f0-893f-1c03bbe943a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:07.163215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54202e5a-9785-45f0-893f-1c03bbe943a3 None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:07.163886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54202e5a-9785-45f0-893f-1c03bbe943a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:07.165988 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54202e5a-9785-45f0-893f-1c03bbe943a3 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:07.172216 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 501/1004] 10.222.0.60 () {56 vars in 1087 bytes} [Fri May 6 23:21:07 2022] GET /identity/v3/services => generated 1727 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:21:07.173013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54202e5a-9785-45f0-893f-1c03bbe943a3 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:07.259691 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b069fd-8382-430d-8381-707731a0612d None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:07.275912 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54202e5a-9785-45f0-893f-1c03bbe943a3 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:07.298052 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c771d1-8c32-4d0c-b6fd-e412018aa8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:07.298728 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c771d1-8c32-4d0c-b6fd-e412018aa8aa None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:07.299009 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c771d1-8c32-4d0c-b6fd-e412018aa8aa None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:07.299281 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c771d1-8c32-4d0c-b6fd-e412018aa8aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:07.300039 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c771d1-8c32-4d0c-b6fd-e412018aa8aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:07.301483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c771d1-8c32-4d0c-b6fd-e412018aa8aa None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:07.311354 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1855d-9caf-463c-a207-436566f4e9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:07.312039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1855d-9caf-463c-a207-436566f4e9cb None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:07.312465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1855d-9caf-463c-a207-436566f4e9cb None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:07.312678 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1855d-9caf-463c-a207-436566f4e9cb None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:07.313542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1855d-9caf-463c-a207-436566f4e9cb None admin] RBAC: Adding query filter params (name=image) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:07.313885 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1855d-9caf-463c-a207-436566f4e9cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:07.315337 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1855d-9caf-463c-a207-436566f4e9cb None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:07.328817 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 504/1005] 10.222.0.60 () {60 vars in 1144 bytes} [Fri May 6 23:21:07 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:21:07.329035 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 502/1006] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:21:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:07.329146 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c771d1-8c32-4d0c-b6fd-e412018aa8aa None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:07.441209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c771d1-8c32-4d0c-b6fd-e412018aa8aa None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:07.481231 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799040b7-46cc-461c-a81e-d62d35a9493e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:07.481914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799040b7-46cc-461c-a81e-d62d35a9493e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:07.482194 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799040b7-46cc-461c-a81e-d62d35a9493e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:07.482533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799040b7-46cc-461c-a81e-d62d35a9493e None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:07.483306 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799040b7-46cc-461c-a81e-d62d35a9493e None admin] RBAC: Adding query filter params (type=image) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:07.483704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799040b7-46cc-461c-a81e-d62d35a9493e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:07.485162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799040b7-46cc-461c-a81e-d62d35a9493e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:07.496389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 505/1007] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:21:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:09.413240 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970bf10-42be-4009-ab80-71289d79a466 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:09.413786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970bf10-42be-4009-ab80-71289d79a466 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:09.413786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970bf10-42be-4009-ab80-71289d79a466 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:09.415273 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 503/1008] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:09.420394 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9e265-90db-4e9e-859e-13faae4335a3 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:09.420864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9e265-90db-4e9e-859e-13faae4335a3 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:09.421018 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9e265-90db-4e9e-859e-13faae4335a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:09.437739 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-1be9e265-90db-4e9e-859e-13faae4335a3 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:09.438912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-1be9e265-90db-4e9e-859e-13faae4335a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:09.508592 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 506/1009] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:09 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:21:09.527916 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970bf10-42be-4009-ab80-71289d79a466 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:09.543780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d76e66-eeeb-4caa-adfc-72660949ca29 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:09.544070 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d76e66-eeeb-4caa-adfc-72660949ca29 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:09.544332 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d76e66-eeeb-4caa-adfc-72660949ca29 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:09.545754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 507/1010] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:21:09.550789 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85147ebd-6cc7-4707-9d01-9a65e475dcd3 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:09.551072 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85147ebd-6cc7-4707-9d01-9a65e475dcd3 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:09.551344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85147ebd-6cc7-4707-9d01-9a65e475dcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:09.567294 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-85147ebd-6cc7-4707-9d01-9a65e475dcd3 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:09.568456 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-85147ebd-6cc7-4707-9d01-9a65e475dcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:09.633551 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970bf10-42be-4009-ab80-71289d79a466 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:09.633770 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 508/1011] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:09 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:21:09.656280 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85147ebd-6cc7-4707-9d01-9a65e475dcd3 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:09.668281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b0291-4c1e-4f54-b60e-f86d7dd506a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:09.669038 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b0291-4c1e-4f54-b60e-f86d7dd506a0 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:09.669314 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b0291-4c1e-4f54-b60e-f86d7dd506a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:09.669581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b0291-4c1e-4f54-b60e-f86d7dd506a0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:09.670228 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b0291-4c1e-4f54-b60e-f86d7dd506a0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:09.671585 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b0291-4c1e-4f54-b60e-f86d7dd506a0 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:09.683525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-599b0291-4c1e-4f54-b60e-f86d7dd506a0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 06 23:21:09.683525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:09.683525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:21:09.683525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:21:09.683525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:21:09.683525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:21:09.683525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:21:09.683525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:21:09.683525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 06 23:21:09.683525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:09.683525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:21:09.683525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:09.683525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:09.683525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:09.683525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:09.683525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:09.683525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:09.684605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:09.684605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:09.684605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:09.684605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:09.684605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:09.684605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:09.684605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:21:09.684605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:21:09.684605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:21:09.684605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:21:09.684605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:09.684605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:09.684605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:09.684605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:09.684605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:09.684605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:09.685463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:09.685463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:21:09.685463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:09.685463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:09.685463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:09.685463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:09.685463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:09.685463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:09.685463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:09.685463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:09.685463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:21:09.685463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:21:09.685463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 06 23:21:09.685463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:09.685463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 504/1012] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:21:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:09.686255 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faa433-00ec-4903-85a2-6cfd29eb3174 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:09.686255 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faa433-00ec-4903-85a2-6cfd29eb3174 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:09.687107 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faa433-00ec-4903-85a2-6cfd29eb3174 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:09.687818 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 505/1013] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:09.691422 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3faa433-00ec-4903-85a2-6cfd29eb3174 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:09.751466 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85147ebd-6cc7-4707-9d01-9a65e475dcd3 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:09.783277 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee80438-65d7-4124-b89e-1b5c4e801cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:09.784066 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee80438-65d7-4124-b89e-1b5c4e801cd8 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:09.784351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee80438-65d7-4124-b89e-1b5c4e801cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:09.784711 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee80438-65d7-4124-b89e-1b5c4e801cd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:09.785879 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee80438-65d7-4124-b89e-1b5c4e801cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:09.787041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3faa433-00ec-4903-85a2-6cfd29eb3174 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:09.787342 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee80438-65d7-4124-b89e-1b5c4e801cd8 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:09.788997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 509/1014] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:21:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:09.790688 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4898528-1b73-42f1-a404-3f65f2940f80 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:09.790974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4898528-1b73-42f1-a404-3f65f2940f80 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:09.791247 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4898528-1b73-42f1-a404-3f65f2940f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:09.806983 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-b4898528-1b73-42f1-a404-3f65f2940f80 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:09.808156 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b4898528-1b73-42f1-a404-3f65f2940f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:09.819382 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d649c0-78fb-4af4-b01d-d2ea8d62a107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:09.820029 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d649c0-78fb-4af4-b01d-d2ea8d62a107 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:09.820818 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d649c0-78fb-4af4-b01d-d2ea8d62a107 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:09.821108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d649c0-78fb-4af4-b01d-d2ea8d62a107 None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:09.821797 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d649c0-78fb-4af4-b01d-d2ea8d62a107 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:09.822096 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d649c0-78fb-4af4-b01d-d2ea8d62a107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:09.826132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d649c0-78fb-4af4-b01d-d2ea8d62a107 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:09.832877 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 506/1015] 10.222.0.60 () {56 vars in 1112 bytes} [Fri May 6 23:21:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:09.832877 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d649c0-78fb-4af4-b01d-d2ea8d62a107 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:09.873143 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 510/1016] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:09 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:21:09.873982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4898528-1b73-42f1-a404-3f65f2940f80 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:09.926484 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d649c0-78fb-4af4-b01d-d2ea8d62a107 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:09.957604 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7c7c2-358f-4bcb-a74b-cc78e06fbc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:09.958243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7c7c2-358f-4bcb-a74b-cc78e06fbc6a None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:09.958524 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7c7c2-358f-4bcb-a74b-cc78e06fbc6a None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:09.958797 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7c7c2-358f-4bcb-a74b-cc78e06fbc6a None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:09.959490 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7c7c2-358f-4bcb-a74b-cc78e06fbc6a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:09.960984 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7c7c2-358f-4bcb-a74b-cc78e06fbc6a None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:09.965052 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4898528-1b73-42f1-a404-3f65f2940f80 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:09.986697 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 507/1017] 10.222.0.60 () {60 vars in 1141 bytes} [Fri May 6 23:21:09 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:21:09.987487 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7c7c2-358f-4bcb-a74b-cc78e06fbc6a None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:10.000692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca4640-3a03-4c66-a43b-a8a37f31e1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:10.001465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca4640-3a03-4c66-a43b-a8a37f31e1c3 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:10.001749 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca4640-3a03-4c66-a43b-a8a37f31e1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:10.002023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca4640-3a03-4c66-a43b-a8a37f31e1c3 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:10.002749 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca4640-3a03-4c66-a43b-a8a37f31e1c3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:10.003054 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca4640-3a03-4c66-a43b-a8a37f31e1c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:10.004483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca4640-3a03-4c66-a43b-a8a37f31e1c3 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:10.010114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 511/1018] 10.222.0.60 () {56 vars in 1112 bytes} [Fri May 6 23:21:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:10.015957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca4640-3a03-4c66-a43b-a8a37f31e1c3 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:10.093279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7c7c2-358f-4bcb-a74b-cc78e06fbc6a None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:10.123338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca4640-3a03-4c66-a43b-a8a37f31e1c3 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:10.128612 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaaf775-cd6b-4832-9a8f-8623ab16afd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:10.129292 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaaf775-cd6b-4832-9a8f-8623ab16afd8 None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:10.129572 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaaf775-cd6b-4832-9a8f-8623ab16afd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:10.129849 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaaf775-cd6b-4832-9a8f-8623ab16afd8 None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:10.130575 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaaf775-cd6b-4832-9a8f-8623ab16afd8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:10.131968 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaaf775-cd6b-4832-9a8f-8623ab16afd8 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:10.147520 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 508/1019] 10.222.0.60 () {60 vars in 1141 bytes} [Fri May 6 23:21:09 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:21:10.170575 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2a86f-ff51-46dd-b457-924dd847be19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:10.171249 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2a86f-ff51-46dd-b457-924dd847be19 None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:10.171533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2a86f-ff51-46dd-b457-924dd847be19 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:10.171807 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2a86f-ff51-46dd-b457-924dd847be19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:10.172602 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2a86f-ff51-46dd-b457-924dd847be19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:10.174022 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2a86f-ff51-46dd-b457-924dd847be19 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:10.195123 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 512/1020] 10.222.0.60 () {60 vars in 1144 bytes} [Fri May 6 23:21:10 2022] POST /identity/v3/endpoints => generated 334 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:21:12.280838 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31f15b-2a35-4999-847b-529abd924367 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:12.281381 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31f15b-2a35-4999-847b-529abd924367 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:12.281381 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31f15b-2a35-4999-847b-529abd924367 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:12.282804 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 509/1021] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:12.289089 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b5e88-4a8c-41bf-9b20-e0e12a305743 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:12.289615 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b5e88-4a8c-41bf-9b20-e0e12a305743 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:12.289694 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b5e88-4a8c-41bf-9b20-e0e12a305743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:12.307562 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-0b5b5e88-4a8c-41bf-9b20-e0e12a305743 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:12.308808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-0b5b5e88-4a8c-41bf-9b20-e0e12a305743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:12.381791 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 513/1022] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:21:12.408389 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31f15b-2a35-4999-847b-529abd924367 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:12.450059 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d13bd0-0289-447e-b7d4-79588047a796 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:12.450362 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d13bd0-0289-447e-b7d4-79588047a796 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:12.450620 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d13bd0-0289-447e-b7d4-79588047a796 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:12.452008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 514/1023] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:12.457009 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d3a1b-ee28-44ee-ab63-5eb73f67aea4 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:12.457296 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d3a1b-ee28-44ee-ab63-5eb73f67aea4 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:12.457576 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d3a1b-ee28-44ee-ab63-5eb73f67aea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:12.474385 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-df9d3a1b-ee28-44ee-ab63-5eb73f67aea4 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:12.475554 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-df9d3a1b-ee28-44ee-ab63-5eb73f67aea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:12.511807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31f15b-2a35-4999-847b-529abd924367 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:12.546816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 515/1024] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:21:12.547315 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf1b1a-79e1-4ef4-a508-45d97158299c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:12.548050 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdb36a-4fae-4198-821f-87fe08f5e1a1 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:12.548161 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf1b1a-79e1-4ef4-a508-45d97158299c None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:12.548338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdb36a-4fae-4198-821f-87fe08f5e1a1 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:12.548433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf1b1a-79e1-4ef4-a508-45d97158299c None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:12.548641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdb36a-4fae-4198-821f-87fe08f5e1a1 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:12.548738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf1b1a-79e1-4ef4-a508-45d97158299c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:12.549901 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 516/1025] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:12.553290 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf1b1a-79e1-4ef4-a508-45d97158299c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:12.554764 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf1b1a-79e1-4ef4-a508-45d97158299c None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:12.555453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428f291-0403-4ec4-912b-9e97ac1fbe97 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:12.555741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428f291-0403-4ec4-912b-9e97ac1fbe97 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:12.556020 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428f291-0403-4ec4-912b-9e97ac1fbe97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:12.561171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 510/1026] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:21:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:12.561948 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf1b1a-79e1-4ef4-a508-45d97158299c None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:12.573364 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-b428f291-0403-4ec4-912b-9e97ac1fbe97 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:12.574627 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b428f291-0403-4ec4-912b-9e97ac1fbe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:12.637992 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 517/1027] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:21:12.638805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428f291-0403-4ec4-912b-9e97ac1fbe97 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:12.656042 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf1b1a-79e1-4ef4-a508-45d97158299c None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:12.688955 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50a525-b860-4c7d-a5dd-2dd2ddf57ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:12.689611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50a525-b860-4c7d-a5dd-2dd2ddf57ef3 None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:12.689894 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50a525-b860-4c7d-a5dd-2dd2ddf57ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:12.690160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50a525-b860-4c7d-a5dd-2dd2ddf57ef3 None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:12.690856 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50a525-b860-4c7d-a5dd-2dd2ddf57ef3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:12.692301 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50a525-b860-4c7d-a5dd-2dd2ddf57ef3 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:12.711987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 511/1028] 10.222.0.60 () {60 vars in 1132 bytes} [Fri May 6 23:21:12 2022] POST /identity/v3/users => generated 285 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:21:12.713089 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50a525-b860-4c7d-a5dd-2dd2ddf57ef3 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:12.740355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428f291-0403-4ec4-912b-9e97ac1fbe97 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:12.776452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66db26-be2b-4fd3-b059-856e4593bb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:12.777303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66db26-be2b-4fd3-b059-856e4593bb1d None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:12.777586 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66db26-be2b-4fd3-b059-856e4593bb1d None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:12.777869 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66db26-be2b-4fd3-b059-856e4593bb1d None admin] PATH_INFO: `/v3/services/image` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:12.778530 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66db26-be2b-4fd3-b059-856e4593bb1d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:12.779961 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66db26-be2b-4fd3-b059-856e4593bb1d None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:12.792616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-dc66db26-be2b-4fd3-b059-856e4593bb1d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 06 23:21:12.792616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:12.792616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:21:12.792616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:21:12.792616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:21:12.792616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:21:12.792616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:21:12.792616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:21:12.792616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 06 23:21:12.792616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:12.792616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:21:12.792616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:12.792616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:12.792616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:12.792616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:12.792616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:12.792616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:12.793755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:12.793755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:12.793755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:12.793755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:12.793755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:12.793755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:12.793755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:21:12.793755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:21:12.793755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:21:12.793755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:21:12.793755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:12.793755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:12.793755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:12.793755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:12.793755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:12.793755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:12.794619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:12.794619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:21:12.794619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:12.794619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:12.794619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:12.794619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:12.794619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:12.794619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:12.794619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:12.794619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:12.794619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:21:12.794619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:21:12.794619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 06 23:21:12.794619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:12.794619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 518/1029] 10.222.0.60 () {56 vars in 1105 bytes} [Fri May 6 23:21:12 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:12.800167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66db26-be2b-4fd3-b059-856e4593bb1d None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:12.824109 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50a525-b860-4c7d-a5dd-2dd2ddf57ef3 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:12.861741 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38eec8-ed4d-4816-a3d9-809922870328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:12.862561 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38eec8-ed4d-4816-a3d9-809922870328 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:12.862891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38eec8-ed4d-4816-a3d9-809922870328 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:12.863167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38eec8-ed4d-4816-a3d9-809922870328 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:12.874660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38eec8-ed4d-4816-a3d9-809922870328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:21:12.883034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-af38eec8-ed4d-4816-a3d9-809922870328 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 06 23:21:12.883034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:12.883034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:12.883034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:12.883034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:12.883034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:12.883034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:12.883034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:12.883034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:12.883034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:12.883034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:12.883034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:12.883034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:21:12.883034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:21:12.883034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:21:12.883034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:21:12.884054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:21:12.884054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:21:12.884054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:21:12.884054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:21:12.884054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:12.884054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:12.884054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:12.884054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:12.884054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:12.884054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:12.884054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:12.884054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:21:12.884054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:12.884054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:12.884054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:12.884054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:12.890023 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:12.890023 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:12.890023 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:12.890023 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:12.890023 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:21:12.890023 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:21:12.890023 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:21:12.890023 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:21:12.890023 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:21:12.890023 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:21:12.890023 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 06 23:21:12.890023 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:12.890023 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 512/1030] 10.222.0.60 () {56 vars in 1120 bytes} [Fri May 6 23:21:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:12.890734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38eec8-ed4d-4816-a3d9-809922870328 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:12.906357 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66db26-be2b-4fd3-b059-856e4593bb1d None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:12.940999 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131a655-fd86-4b6d-8a62-0839b2a22f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:12.941649 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131a655-fd86-4b6d-8a62-0839b2a22f2b None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:12.941935 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131a655-fd86-4b6d-8a62-0839b2a22f2b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:12.942214 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131a655-fd86-4b6d-8a62-0839b2a22f2b None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:12.942932 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131a655-fd86-4b6d-8a62-0839b2a22f2b None admin] RBAC: Adding query filter params (name=image) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:12.943239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131a655-fd86-4b6d-8a62-0839b2a22f2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:12.944684 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131a655-fd86-4b6d-8a62-0839b2a22f2b None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:12.950158 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 519/1031] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:21:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:12.955885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131a655-fd86-4b6d-8a62-0839b2a22f2b None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:12.999114 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38eec8-ed4d-4816-a3d9-809922870328 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:13.031635 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef25e5b-1c95-40e1-971f-e79bc54cb804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:13.032298 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef25e5b-1c95-40e1-971f-e79bc54cb804 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:13.032616 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef25e5b-1c95-40e1-971f-e79bc54cb804 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:13.032867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef25e5b-1c95-40e1-971f-e79bc54cb804 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:13.033616 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef25e5b-1c95-40e1-971f-e79bc54cb804 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:13.033918 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef25e5b-1c95-40e1-971f-e79bc54cb804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:13.035288 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef25e5b-1c95-40e1-971f-e79bc54cb804 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:13.044028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 513/1032] 10.222.0.60 () {56 vars in 1115 bytes} [Fri May 6 23:21:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:13.049319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef25e5b-1c95-40e1-971f-e79bc54cb804 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:13.056237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131a655-fd86-4b6d-8a62-0839b2a22f2b None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:13.088488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16971c4b-30e2-4b4b-b65d-66db225263bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:13.089254 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16971c4b-30e2-4b4b-b65d-66db225263bf None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:13.089991 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16971c4b-30e2-4b4b-b65d-66db225263bf None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:13.090103 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16971c4b-30e2-4b4b-b65d-66db225263bf None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:13.090736 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16971c4b-30e2-4b4b-b65d-66db225263bf None admin] RBAC: Adding query filter params (type=image) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:13.091043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16971c4b-30e2-4b4b-b65d-66db225263bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:13.092471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16971c4b-30e2-4b4b-b65d-66db225263bf None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:13.097217 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 520/1033] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:21:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:13.103665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16971c4b-30e2-4b4b-b65d-66db225263bf None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:13.149671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef25e5b-1c95-40e1-971f-e79bc54cb804 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:13.182299 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a999bf-31cd-428e-9ae3-edadda2b02a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:13.183410 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a999bf-31cd-428e-9ae3-edadda2b02a0 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:13.183893 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a999bf-31cd-428e-9ae3-edadda2b02a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:13.184336 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a999bf-31cd-428e-9ae3-edadda2b02a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:13.194627 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a999bf-31cd-428e-9ae3-edadda2b02a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:13.196856 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a999bf-31cd-428e-9ae3-edadda2b02a0 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:13.200186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16971c4b-30e2-4b4b-b65d-66db225263bf None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:13.213429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-70a999bf-31cd-428e-9ae3-edadda2b02a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:21:13.213429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:13.213429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:13.213429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:13.213429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:13.213429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:13.213429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:13.213429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:13.213429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:13.213429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:13.213429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:13.213429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:13.213429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:21:13.213429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:21:13.213429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:21:13.214553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:21:13.214553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:13.214553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:13.214553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:13.214553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:13.214553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:13.214553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:13.214553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:13.214553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:21:13.214553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:13.214553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:13.214553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:13.214553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:13.214553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:13.214553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:13.214553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:13.214553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:13.215431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:21:13.215431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:21:13.215431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:21:13.215431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:13.221665 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 514/1034] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:21:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:21:13.222653 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a999bf-31cd-428e-9ae3-edadda2b02a0 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:13.232564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1001ab-f558-4d8c-ae1f-b1146fd45ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:13.233241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1001ab-f558-4d8c-ae1f-b1146fd45ca8 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:13.233524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1001ab-f558-4d8c-ae1f-b1146fd45ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:13.233803 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1001ab-f558-4d8c-ae1f-b1146fd45ca8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:13.234594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1001ab-f558-4d8c-ae1f-b1146fd45ca8 None admin] RBAC: Adding query filter params (interface=public, service_id=8639034c6e74456c960dec24abecea28, region_id=RegionOne) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:13.234907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1001ab-f558-4d8c-ae1f-b1146fd45ca8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:13.236275 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1001ab-f558-4d8c-ae1f-b1146fd45ca8 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:13.241445 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 521/1035] 10.222.0.60 () {56 vars in 1251 bytes} [Fri May 6 23:21:13 2022] GET /identity/v3/endpoints?service_id=8639034c6e74456c960dec24abecea28&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:13.247633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1001ab-f558-4d8c-ae1f-b1146fd45ca8 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:13.324056 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a999bf-31cd-428e-9ae3-edadda2b02a0 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:13.345081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1001ab-f558-4d8c-ae1f-b1146fd45ca8 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:13.356619 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e1ecc-abb5-49d9-9d17-6eae9e653c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:13.357273 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e1ecc-abb5-49d9-9d17-6eae9e653c2b None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:13.357551 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e1ecc-abb5-49d9-9d17-6eae9e653c2b None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:13.357820 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e1ecc-abb5-49d9-9d17-6eae9e653c2b None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:13.358525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e1ecc-abb5-49d9-9d17-6eae9e653c2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:13.358824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e1ecc-abb5-49d9-9d17-6eae9e653c2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:13.360181 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e1ecc-abb5-49d9-9d17-6eae9e653c2b None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:13.371617 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 515/1036] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:13.376990 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e1ecc-abb5-49d9-9d17-6eae9e653c2b None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:13.386808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300098ea-6551-44e5-bb15-370b9412348b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:13.387486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300098ea-6551-44e5-bb15-370b9412348b None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:13.387768 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300098ea-6551-44e5-bb15-370b9412348b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:13.388045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300098ea-6551-44e5-bb15-370b9412348b None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:13.389009 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300098ea-6551-44e5-bb15-370b9412348b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:13.390141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300098ea-6551-44e5-bb15-370b9412348b None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:13.397086 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 522/1037] 10.222.0.60 () {56 vars in 1087 bytes} [Fri May 6 23:21:13 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:21:13.482499 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e1ecc-abb5-49d9-9d17-6eae9e653c2b None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:13.517272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7431ad-f228-48b1-8f80-25c84f08f834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:13.518076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7431ad-f228-48b1-8f80-25c84f08f834 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:13.518358 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7431ad-f228-48b1-8f80-25c84f08f834 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:13.518631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7431ad-f228-48b1-8f80-25c84f08f834 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:13.527224 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7431ad-f228-48b1-8f80-25c84f08f834 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:13.528781 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7431ad-f228-48b1-8f80-25c84f08f834 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:13.544284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-2f7431ad-f228-48b1-8f80-25c84f08f834 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 06 23:21:13.544284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:13.544284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:13.544284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:13.544284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:13.544284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:13.544284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:13.544284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:13.544284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:13.544284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:13.544284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:13.544284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:13.544284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:21:13.544284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:21:13.544284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:21:13.544284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:21:13.545423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:13.545423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:13.545423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:21:13.545423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:21:13.545423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:21:13.545423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:21:13.545423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:13.545423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:13.545423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:13.545423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:13.545423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:13.545423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:21:13.545423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:13.545423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:13.545423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:13.545423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:13.545423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:13.545423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:13.546376 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:13.546376 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:13.546376 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:21:13.546376 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:21:13.546376 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:21:13.546376 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:21:13.546376 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:21:13.546376 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:21:13.546376 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 06 23:21:13.546376 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:13.546376 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 516/1038] 10.222.0.60 () {56 vars in 1093 bytes} [Fri May 6 23:21:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:21:13.553407 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300098ea-6551-44e5-bb15-370b9412348b None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:13.656322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300098ea-6551-44e5-bb15-370b9412348b None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:13.688750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf780f-5502-4168-bb94-5ce3660beb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:13.689417 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf780f-5502-4168-bb94-5ce3660beb79 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:13.689698 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf780f-5502-4168-bb94-5ce3660beb79 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:13.689975 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf780f-5502-4168-bb94-5ce3660beb79 None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:13.690808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf780f-5502-4168-bb94-5ce3660beb79 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:13.691120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf780f-5502-4168-bb94-5ce3660beb79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:13.692576 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf780f-5502-4168-bb94-5ce3660beb79 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:13.711088 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 523/1039] 10.222.0.60 () {56 vars in 1133 bytes} [Fri May 6 23:21:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:13.716432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7431ad-f228-48b1-8f80-25c84f08f834 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:13.811476 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7431ad-f228-48b1-8f80-25c84f08f834 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:13.853760 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f33e4-355c-45af-9b23-9fa583763e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:13.854413 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f33e4-355c-45af-9b23-9fa583763e26 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:13.854695 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f33e4-355c-45af-9b23-9fa583763e26 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:13.854970 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f33e4-355c-45af-9b23-9fa583763e26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:13.920925 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f33e4-355c-45af-9b23-9fa583763e26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:13.922305 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f33e4-355c-45af-9b23-9fa583763e26 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:14.018845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 517/1040] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:21:13 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 06 23:21:14.020667 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf780f-5502-4168-bb94-5ce3660beb79 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:14.115755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf780f-5502-4168-bb94-5ce3660beb79 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:14.150398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569abfc7-17dd-4b8e-909d-3642eb9acc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:14.151188 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569abfc7-17dd-4b8e-909d-3642eb9acc52 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:14.151465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569abfc7-17dd-4b8e-909d-3642eb9acc52 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:14.151735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569abfc7-17dd-4b8e-909d-3642eb9acc52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:14.161402 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569abfc7-17dd-4b8e-909d-3642eb9acc52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:14.162837 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569abfc7-17dd-4b8e-909d-3642eb9acc52 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:14.179605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-569abfc7-17dd-4b8e-909d-3642eb9acc52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:21:14.179605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:14.179605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:14.179605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:14.179605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:14.179605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:14.179605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:14.179605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:14.179605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:14.179605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:14.179605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:14.179605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:14.179605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:21:14.179605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:21:14.179605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:21:14.180527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:21:14.180527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:14.180527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:14.180527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:14.180527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:14.180527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:14.180527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:14.180527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:14.180527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:21:14.180527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:14.180527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:14.180527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:14.180527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:14.180527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:14.180527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:14.180527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:14.180527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:14.186479 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:21:14.186479 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:21:14.186479 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:21:14.186479 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:14.186479 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 524/1041] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:21:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:21:14.188256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f33e4-355c-45af-9b23-9fa583763e26 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:14.280511 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f33e4-355c-45af-9b23-9fa583763e26 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:14.311440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b973129-bc47-4c42-95a9-f38fada64618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:14.312093 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b973129-bc47-4c42-95a9-f38fada64618 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:14.312375 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b973129-bc47-4c42-95a9-f38fada64618 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:14.312676 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b973129-bc47-4c42-95a9-f38fada64618 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:14.313385 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b973129-bc47-4c42-95a9-f38fada64618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:14.313688 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b973129-bc47-4c42-95a9-f38fada64618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:14.315101 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b973129-bc47-4c42-95a9-f38fada64618 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:14.330894 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 518/1042] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:14.332521 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569abfc7-17dd-4b8e-909d-3642eb9acc52 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:14.425703 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569abfc7-17dd-4b8e-909d-3642eb9acc52 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:14.457885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2f6ec-5db6-4a48-b9d6-68578c0b407a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:14.458603 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2f6ec-5db6-4a48-b9d6-68578c0b407a None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:14.458877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2f6ec-5db6-4a48-b9d6-68578c0b407a None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:14.459142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2f6ec-5db6-4a48-b9d6-68578c0b407a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:14.466390 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2f6ec-5db6-4a48-b9d6-68578c0b407a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:14.467837 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2f6ec-5db6-4a48-b9d6-68578c0b407a None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:14.482597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-fdd2f6ec-5db6-4a48-b9d6-68578c0b407a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:21:14.482597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:14.482597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:14.482597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:14.482597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:14.482597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:14.482597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:14.482597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:14.482597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:14.482597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:14.482597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:14.482597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:14.482597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:21:14.482597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:21:14.482597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:21:14.483578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:21:14.483578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:14.483578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:14.483578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:14.483578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:14.483578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:14.483578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:14.483578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:14.483578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:21:14.483578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:14.483578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:14.483578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:14.483578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:14.483578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:14.483578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:14.483578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:14.483578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:14.484524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:21:14.484524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:21:14.484524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:21:14.484524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:21:14.484524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:21:14.484524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:21:14.484524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:21:14.484524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:14.485821 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 525/1043] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:21:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:14.489709 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b973129-bc47-4c42-95a9-f38fada64618 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:14.587634 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b973129-bc47-4c42-95a9-f38fada64618 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:14.620257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234071e-e031-48c9-8789-fe26ce81fccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:14.620940 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234071e-e031-48c9-8789-fe26ce81fccf None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:14.621220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234071e-e031-48c9-8789-fe26ce81fccf None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:14.621493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234071e-e031-48c9-8789-fe26ce81fccf None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:14.622268 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234071e-e031-48c9-8789-fe26ce81fccf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:14.622572 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234071e-e031-48c9-8789-fe26ce81fccf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:14.624018 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234071e-e031-48c9-8789-fe26ce81fccf None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:14.635880 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 519/1044] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:21:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:14.641773 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2f6ec-5db6-4a48-b9d6-68578c0b407a None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:14.736309 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2f6ec-5db6-4a48-b9d6-68578c0b407a None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:14.768049 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8f9af-bd29-4166-8c56-71e342d25241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:14.768724 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8f9af-bd29-4166-8c56-71e342d25241 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:14.769007 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8f9af-bd29-4166-8c56-71e342d25241 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:14.769281 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8f9af-bd29-4166-8c56-71e342d25241 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:14.770101 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8f9af-bd29-4166-8c56-71e342d25241 None admin] RBAC: Adding query filter params (role.id=ba21f19c24814b0cb6fd00d728df4447, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=9b74631c6e1547d991753a65c41bc7e7) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:14.770409 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8f9af-bd29-4166-8c56-71e342d25241 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:14.771832 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8f9af-bd29-4166-8c56-71e342d25241 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:14.784566 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 526/1045] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:21:14 2022] GET /identity/v3/role_assignments?user.id=9b74631c6e1547d991753a65c41bc7e7&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=ba21f19c24814b0cb6fd00d728df4447 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:15.032703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a7080-113f-4587-a3db-2045072c3db9 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:15.033056 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a7080-113f-4587-a3db-2045072c3db9 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:15.033273 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a7080-113f-4587-a3db-2045072c3db9 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:15.034801 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 520/1046] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:15.040427 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed0894-7520-4373-b217-ac205cc1d79b None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:15.040751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed0894-7520-4373-b217-ac205cc1d79b None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:15.041029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed0894-7520-4373-b217-ac205cc1d79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:15.057893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-6eed0894-7520-4373-b217-ac205cc1d79b None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:15.059059 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-6eed0894-7520-4373-b217-ac205cc1d79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:15.123105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 527/1047] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:21:15.145742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a7080-113f-4587-a3db-2045072c3db9 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:15.263968 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a7080-113f-4587-a3db-2045072c3db9 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:15.303710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68347b41-195d-4fe1-8767-cfba35f44d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:15.304429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68347b41-195d-4fe1-8767-cfba35f44d5c None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:15.304774 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68347b41-195d-4fe1-8767-cfba35f44d5c None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:15.305052 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68347b41-195d-4fe1-8767-cfba35f44d5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:15.317338 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68347b41-195d-4fe1-8767-cfba35f44d5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:21:15.324920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-68347b41-195d-4fe1-8767-cfba35f44d5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:21:15.324920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:15.324920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:15.324920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:15.324920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:15.324920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:15.324920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:15.324920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:15.324920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:15.324920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:15.324920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:15.324920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:15.324920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:21:15.324920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:21:15.324920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:21:15.324920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:21:15.325855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:21:15.325855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:21:15.325855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:21:15.325855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:21:15.325855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:15.325855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:15.325855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:15.325855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:15.325855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:15.325855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:15.325855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:15.325855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:21:15.325855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:15.325855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:15.325855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:15.325855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:15.326715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:15.326715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:15.326715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:15.326715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:15.326715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:21:15.326715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:21:15.326715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:21:15.326715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:21:15.326715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:21:15.326715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:21:15.326715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:21:15.326715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:15.332584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 521/1048] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:21:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:15.333154 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed0894-7520-4373-b217-ac205cc1d79b None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:15.433710 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed0894-7520-4373-b217-ac205cc1d79b None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:15.473156 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015068de-678d-4f6d-91ff-2cafea6cd77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:15.473841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015068de-678d-4f6d-91ff-2cafea6cd77b None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:15.474127 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015068de-678d-4f6d-91ff-2cafea6cd77b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:15.474404 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015068de-678d-4f6d-91ff-2cafea6cd77b None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:15.475170 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015068de-678d-4f6d-91ff-2cafea6cd77b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:15.475476 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015068de-678d-4f6d-91ff-2cafea6cd77b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:15.477473 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015068de-678d-4f6d-91ff-2cafea6cd77b None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:15.491366 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 528/1049] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:21:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:15.493771 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68347b41-195d-4fe1-8767-cfba35f44d5c None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:15.604874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68347b41-195d-4fe1-8767-cfba35f44d5c None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:15.637187 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd69334-a2a8-458d-9fd3-148932d763a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:15.638055 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd69334-a2a8-458d-9fd3-148932d763a8 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:15.638336 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd69334-a2a8-458d-9fd3-148932d763a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:15.638441 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d94d97-5034-49ac-ae82-eb769e128664 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:15.638604 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd69334-a2a8-458d-9fd3-148932d763a8 None admin] PATH_INFO: `/v3/users/69c018c7c89b4bd89bac748e44583fe5` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:15.638697 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d94d97-5034-49ac-ae82-eb769e128664 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:15.638928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d94d97-5034-49ac-ae82-eb769e128664 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:15.640309 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 529/1050] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:21:15.645245 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbc72f-4d5c-4fe0-baa4-72cf586f091b None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:15.645538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbc72f-4d5c-4fe0-baa4-72cf586f091b None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:15.645816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbc72f-4d5c-4fe0-baa4-72cf586f091b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:15.652614 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd69334-a2a8-458d-9fd3-148932d763a8 None admin] RBAC: Authorizing `identity:get_user(user_id=69c018c7c89b4bd89bac748e44583fe5)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:15.654059 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd69334-a2a8-458d-9fd3-148932d763a8 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:15.655868 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 522/1051] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:21:15 2022] GET /identity/v3/users/69c018c7c89b4bd89bac748e44583fe5 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:15.661283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd69334-a2a8-458d-9fd3-148932d763a8 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:15.662549 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-6bfbc72f-4d5c-4fe0-baa4-72cf586f091b None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:15.663735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-6bfbc72f-4d5c-4fe0-baa4-72cf586f091b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:15.728428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 530/1052] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:21:15.751450 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbc72f-4d5c-4fe0-baa4-72cf586f091b None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:15.756854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd69334-a2a8-458d-9fd3-148932d763a8 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:15.790078 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f6656-5bf4-4b19-adfe-981c717f61e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:15.790727 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f6656-5bf4-4b19-adfe-981c717f61e6 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:15.791010 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f6656-5bf4-4b19-adfe-981c717f61e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:15.791281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f6656-5bf4-4b19-adfe-981c717f61e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:15.846265 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbc72f-4d5c-4fe0-baa4-72cf586f091b None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:15.868666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f6656-5bf4-4b19-adfe-981c717f61e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:15.870033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f6656-5bf4-4b19-adfe-981c717f61e6 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:15.881218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4c951-abde-41c1-b60b-6cd6fa0e9550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:15.882021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4c951-abde-41c1-b60b-6cd6fa0e9550 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:15.882298 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4c951-abde-41c1-b60b-6cd6fa0e9550 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:15.882566 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4c951-abde-41c1-b60b-6cd6fa0e9550 None admin] PATH_INFO: `/v3/services/image` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:15.883269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4c951-abde-41c1-b60b-6cd6fa0e9550 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:15.884704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4c951-abde-41c1-b60b-6cd6fa0e9550 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:15.896841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-68a4c951-abde-41c1-b60b-6cd6fa0e9550 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 06 23:21:15.896841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:15.896841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:21:15.896841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:21:15.896841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:21:15.896841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:21:15.896841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:21:15.896841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:21:15.896841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 06 23:21:15.896841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:15.896841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:21:15.896841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:15.896841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:15.896841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:15.896841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:15.896841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:15.896841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:15.898208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:15.898208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:15.898208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:15.898208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:15.898208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:15.898208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:15.898208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:21:15.898208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:21:15.898208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:21:15.898208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:21:15.898208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:15.898208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:15.898208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:15.898208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:15.898208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:15.898208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:15.899043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:15.899043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:21:15.899043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:15.899043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:15.899043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:15.899043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:15.899043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:15.899043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:15.899043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:15.899043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:15.899043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:21:15.899043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:21:15.899043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 06 23:21:15.899043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:15.899043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 531/1053] 10.222.0.60 () {56 vars in 1105 bytes} [Fri May 6 23:21:15 2022] GET /identity/v3/services/image => generated 86 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:15.903919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4c951-abde-41c1-b60b-6cd6fa0e9550 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:15.973113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 523/1054] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:21:15 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 06 23:21:15.979330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f6656-5bf4-4b19-adfe-981c717f61e6 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:16.000080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4c951-abde-41c1-b60b-6cd6fa0e9550 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:16.033668 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6a487-9c84-4501-a131-bc19c8fe6329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:16.034611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6a487-9c84-4501-a131-bc19c8fe6329 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:16.035076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6a487-9c84-4501-a131-bc19c8fe6329 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:16.035529 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6a487-9c84-4501-a131-bc19c8fe6329 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:16.036418 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6a487-9c84-4501-a131-bc19c8fe6329 None admin] RBAC: Adding query filter params (name=image) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:16.036927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6a487-9c84-4501-a131-bc19c8fe6329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:16.038292 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6a487-9c84-4501-a131-bc19c8fe6329 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:16.044099 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 532/1055] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:21:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:16.049459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6a487-9c84-4501-a131-bc19c8fe6329 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:16.074157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f6656-5bf4-4b19-adfe-981c717f61e6 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:16.107162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f87ca3-3884-4eef-b9eb-16599abf9a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:16.108012 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f87ca3-3884-4eef-b9eb-16599abf9a14 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:16.108294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f87ca3-3884-4eef-b9eb-16599abf9a14 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:16.108580 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f87ca3-3884-4eef-b9eb-16599abf9a14 None admin] PATH_INFO: `/v3/projects/85e344056efb44fe9adc06f9888c82d4` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:16.109760 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f87ca3-3884-4eef-b9eb-16599abf9a14 None admin] RBAC: Authorizing `identity:get_project(project_id=85e344056efb44fe9adc06f9888c82d4)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:16.111208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f87ca3-3884-4eef-b9eb-16599abf9a14 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:16.113078 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 524/1056] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:21:15 2022] GET /identity/v3/projects/85e344056efb44fe9adc06f9888c82d4 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:16.119325 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f87ca3-3884-4eef-b9eb-16599abf9a14 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:16.145285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6a487-9c84-4501-a131-bc19c8fe6329 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:16.178509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fe42f-28e9-4590-8a2e-50b45d567b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:16.179167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fe42f-28e9-4590-8a2e-50b45d567b96 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:16.179452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fe42f-28e9-4590-8a2e-50b45d567b96 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:16.179755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fe42f-28e9-4590-8a2e-50b45d567b96 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:16.180469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fe42f-28e9-4590-8a2e-50b45d567b96 None admin] RBAC: Adding query filter params (type=image) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:16.180799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fe42f-28e9-4590-8a2e-50b45d567b96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:16.182165 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fe42f-28e9-4590-8a2e-50b45d567b96 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:16.191478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 533/1057] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:21:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:16.192263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fe42f-28e9-4590-8a2e-50b45d567b96 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:16.213004 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f87ca3-3884-4eef-b9eb-16599abf9a14 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:16.246629 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d10575-e2fd-4439-89f7-edc89ea6936d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:16.247277 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d10575-e2fd-4439-89f7-edc89ea6936d None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:16.247561 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d10575-e2fd-4439-89f7-edc89ea6936d None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:16.247833 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d10575-e2fd-4439-89f7-edc89ea6936d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:16.248688 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d10575-e2fd-4439-89f7-edc89ea6936d None admin] RBAC: Adding query filter params (role.id=408ee9a3a38640a48dbcdb2c377efcd8, scope.project.id=85e344056efb44fe9adc06f9888c82d4, user.id=69c018c7c89b4bd89bac748e44583fe5) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:16.248998 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d10575-e2fd-4439-89f7-edc89ea6936d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:16.250419 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d10575-e2fd-4439-89f7-edc89ea6936d None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:16.264685 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 525/1058] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:21:16 2022] GET /identity/v3/role_assignments?user.id=69c018c7c89b4bd89bac748e44583fe5&scope.project.id=85e344056efb44fe9adc06f9888c82d4&role.id=408ee9a3a38640a48dbcdb2c377efcd8 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:16.289615 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fe42f-28e9-4590-8a2e-50b45d567b96 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:16.325151 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb13ae-60b6-43aa-b64f-87e3111f3ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:16.325830 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb13ae-60b6-43aa-b64f-87e3111f3ab4 None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:16.326113 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb13ae-60b6-43aa-b64f-87e3111f3ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:16.326388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb13ae-60b6-43aa-b64f-87e3111f3ab4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:16.327145 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb13ae-60b6-43aa-b64f-87e3111f3ab4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:16.328523 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb13ae-60b6-43aa-b64f-87e3111f3ab4 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:16.351239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 534/1059] 10.222.0.60 () {60 vars in 1144 bytes} [Fri May 6 23:21:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:21:17.013978 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6daf2a-1a7a-437e-a79c-0d9742c56044 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:17.014488 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6daf2a-1a7a-437e-a79c-0d9742c56044 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:17.014565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6daf2a-1a7a-437e-a79c-0d9742c56044 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:17.015936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 526/1060] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:17.021240 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204e2a9-b7b6-4533-a502-73ada5832e72 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:17.021664 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204e2a9-b7b6-4533-a502-73ada5832e72 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:17.021807 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204e2a9-b7b6-4533-a502-73ada5832e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:17.040195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-d204e2a9-b7b6-4533-a502-73ada5832e72 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:17.041398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d204e2a9-b7b6-4533-a502-73ada5832e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:17.110903 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 535/1061] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:21:17.132261 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6daf2a-1a7a-437e-a79c-0d9742c56044 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:17.228968 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6daf2a-1a7a-437e-a79c-0d9742c56044 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:17.260162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d44e7-608d-4cc4-8a46-83f4122470be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:17.260972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d44e7-608d-4cc4-8a46-83f4122470be None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:17.261251 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d44e7-608d-4cc4-8a46-83f4122470be None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:17.261519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d44e7-608d-4cc4-8a46-83f4122470be None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:17.271561 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d44e7-608d-4cc4-8a46-83f4122470be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:21:17.279660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-213d44e7-608d-4cc4-8a46-83f4122470be None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 06 23:21:17.279660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:17.279660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:17.279660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:17.279660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:17.279660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:17.279660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:17.279660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:17.279660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:17.279660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:17.279660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:17.279660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:17.279660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:21:17.279660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:21:17.279660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:21:17.279660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:21:17.280620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:21:17.280620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:21:17.280620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:21:17.280620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:21:17.280620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:17.280620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:17.280620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:17.280620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:17.280620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:17.280620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:17.280620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:17.280620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:21:17.280620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:17.280620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:17.280620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:17.280620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:17.281470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:17.281470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:17.281470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:17.281470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:17.281470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:21:17.281470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:21:17.281470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:21:17.281470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:21:17.281470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:21:17.281470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:21:17.281470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 06 23:21:17.281470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:17.282866 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 527/1062] 10.222.0.60 () {56 vars in 1120 bytes} [Fri May 6 23:21:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:17.286748 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204e2a9-b7b6-4533-a502-73ada5832e72 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:17.381609 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204e2a9-b7b6-4533-a502-73ada5832e72 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:17.413526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a765827-455e-49d4-8fd6-628b42bdeee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:17.414714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a765827-455e-49d4-8fd6-628b42bdeee0 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:17.414991 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a765827-455e-49d4-8fd6-628b42bdeee0 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:17.415259 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a765827-455e-49d4-8fd6-628b42bdeee0 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:17.416097 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a765827-455e-49d4-8fd6-628b42bdeee0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:17.416400 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a765827-455e-49d4-8fd6-628b42bdeee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:17.417774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a765827-455e-49d4-8fd6-628b42bdeee0 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:17.430666 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 536/1063] 10.222.0.60 () {56 vars in 1115 bytes} [Fri May 6 23:21:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:17.431892 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d44e7-608d-4cc4-8a46-83f4122470be None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:17.531267 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d44e7-608d-4cc4-8a46-83f4122470be None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:17.564129 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e409b-107c-4c6e-982d-d2093c13c568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:17.564953 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e409b-107c-4c6e-982d-d2093c13c568 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:17.565238 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e409b-107c-4c6e-982d-d2093c13c568 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:17.565514 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e409b-107c-4c6e-982d-d2093c13c568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:17.576619 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e409b-107c-4c6e-982d-d2093c13c568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:17.578082 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e409b-107c-4c6e-982d-d2093c13c568 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:17.595191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-ae7e409b-107c-4c6e-982d-d2093c13c568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:21:17.595191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:17.595191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:17.595191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:17.595191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:17.595191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:17.595191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:17.595191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:17.595191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:17.595191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:17.595191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:17.595191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:17.595191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:21:17.595191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:21:17.595191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:21:17.596094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:21:17.596094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:17.596094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:17.596094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:17.596094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:17.596094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:17.596094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:17.596094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:17.596094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:21:17.596094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:17.596094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:17.596094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:17.596094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:17.596094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:17.596094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:17.596094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:17.596094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:17.597040 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:21:17.597040 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:21:17.597040 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:21:17.597040 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:17.597040 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 528/1064] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:21:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:21:17.602037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a765827-455e-49d4-8fd6-628b42bdeee0 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:17.696895 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a765827-455e-49d4-8fd6-628b42bdeee0 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:17.728517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639d0d7-6bd9-46aa-bfe5-373f6aacdaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:17.729223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639d0d7-6bd9-46aa-bfe5-373f6aacdaf7 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:17.729505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639d0d7-6bd9-46aa-bfe5-373f6aacdaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:17.729779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639d0d7-6bd9-46aa-bfe5-373f6aacdaf7 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:17.730495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639d0d7-6bd9-46aa-bfe5-373f6aacdaf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:17.730801 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639d0d7-6bd9-46aa-bfe5-373f6aacdaf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:17.732167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639d0d7-6bd9-46aa-bfe5-373f6aacdaf7 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:17.744116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 537/1065] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:17.749496 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e409b-107c-4c6e-982d-d2093c13c568 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:17.845418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e409b-107c-4c6e-982d-d2093c13c568 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:17.877396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c82feb-7534-4e31-b59b-fc9168ebca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:17.878180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c82feb-7534-4e31-b59b-fc9168ebca3d None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:17.878461 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c82feb-7534-4e31-b59b-fc9168ebca3d None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:17.878734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c82feb-7534-4e31-b59b-fc9168ebca3d None admin] PATH_INFO: `/v3/users/nova` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:17.887466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c82feb-7534-4e31-b59b-fc9168ebca3d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:17.888942 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c82feb-7534-4e31-b59b-fc9168ebca3d None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:17.905283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-c9c82feb-7534-4e31-b59b-fc9168ebca3d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 06 23:21:17.905283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:17.905283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:17.905283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:17.905283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:17.905283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:17.905283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:17.905283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:17.905283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:17.905283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:17.905283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:17.905283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:17.905283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:21:17.905283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:21:17.905283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:21:17.905283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:21:17.906397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:17.906397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:17.906397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:21:17.906397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:21:17.906397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:21:17.906397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:21:17.906397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:17.906397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:17.906397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:17.906397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:17.906397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:17.906397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:21:17.906397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:17.906397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:17.906397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:17.906397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:17.906397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:17.906397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:17.907371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:17.907371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:17.907371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:21:17.907371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:21:17.907371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:21:17.907371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:21:17.907371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:21:17.907371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:21:17.907371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 06 23:21:17.907371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:17.907371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 529/1066] 10.222.0.60 () {56 vars in 1093 bytes} [Fri May 6 23:21:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:17.913704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639d0d7-6bd9-46aa-bfe5-373f6aacdaf7 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:18.008098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639d0d7-6bd9-46aa-bfe5-373f6aacdaf7 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:18.040845 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4572bcf-2978-4583-8620-820d9b061093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:18.041628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4572bcf-2978-4583-8620-820d9b061093 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:18.041816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4572bcf-2978-4583-8620-820d9b061093 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:18.042060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4572bcf-2978-4583-8620-820d9b061093 None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:18.042893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4572bcf-2978-4583-8620-820d9b061093 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:18.043197 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4572bcf-2978-4583-8620-820d9b061093 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:18.044641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4572bcf-2978-4583-8620-820d9b061093 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:18.067238 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 538/1067] 10.222.0.60 () {56 vars in 1133 bytes} [Fri May 6 23:21:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:18.068478 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c82feb-7534-4e31-b59b-fc9168ebca3d None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:18.167756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c82feb-7534-4e31-b59b-fc9168ebca3d None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:18.200923 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae71a55-7f3d-41a7-8a2c-b30f2c54508f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:18.201944 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae71a55-7f3d-41a7-8a2c-b30f2c54508f None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:18.202467 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae71a55-7f3d-41a7-8a2c-b30f2c54508f None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:18.202888 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae71a55-7f3d-41a7-8a2c-b30f2c54508f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:18.213758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae71a55-7f3d-41a7-8a2c-b30f2c54508f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:18.215721 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae71a55-7f3d-41a7-8a2c-b30f2c54508f None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:18.233171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-6ae71a55-7f3d-41a7-8a2c-b30f2c54508f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:21:18.233171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:18.233171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:18.233171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:18.233171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:18.233171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:18.233171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:18.233171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:18.233171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:18.233171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:18.233171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:18.233171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:18.233171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:21:18.233171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:21:18.233171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:21:18.234164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:21:18.234164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:18.234164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:18.234164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:18.234164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:18.234164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:18.234164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:18.234164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:18.234164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:21:18.234164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:18.234164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:18.234164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:18.234164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:18.234164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:18.234164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:18.234164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:18.234164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:18.235057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:21:18.235057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:21:18.235057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:21:18.235057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:18.235057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 530/1068] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:21:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:18.240903 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4572bcf-2978-4583-8620-820d9b061093 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:18.343202 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4572bcf-2978-4583-8620-820d9b061093 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:18.376035 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe915b2-f2b3-4846-8675-2e00f283dc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:18.376733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe915b2-f2b3-4846-8675-2e00f283dc39 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:18.377017 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe915b2-f2b3-4846-8675-2e00f283dc39 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:18.377291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe915b2-f2b3-4846-8675-2e00f283dc39 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:18.378012 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe915b2-f2b3-4846-8675-2e00f283dc39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:18.378318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe915b2-f2b3-4846-8675-2e00f283dc39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:18.379684 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe915b2-f2b3-4846-8675-2e00f283dc39 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:18.396199 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 539/1069] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:18.397602 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae71a55-7f3d-41a7-8a2c-b30f2c54508f None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:18.491387 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fc16d-315f-4ff6-a736-4ffda878dd8d None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:18.491674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fc16d-315f-4ff6-a736-4ffda878dd8d None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:18.492469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fc16d-315f-4ff6-a736-4ffda878dd8d None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:18.493998 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 540/1070] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:21:18.498903 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737629c-24d8-47a0-8162-1afdf247dd1c None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:18.499192 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737629c-24d8-47a0-8162-1afdf247dd1c None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:18.499461 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737629c-24d8-47a0-8162-1afdf247dd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:18.500573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae71a55-7f3d-41a7-8a2c-b30f2c54508f None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:18.517074 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-8737629c-24d8-47a0-8162-1afdf247dd1c None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:18.518380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-8737629c-24d8-47a0-8162-1afdf247dd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:18.539987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd41e1f-f839-41f6-9767-7075ed6b7f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:18.540800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd41e1f-f839-41f6-9767-7075ed6b7f40 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:18.541075 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd41e1f-f839-41f6-9767-7075ed6b7f40 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:18.541343 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd41e1f-f839-41f6-9767-7075ed6b7f40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:18.548161 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd41e1f-f839-41f6-9767-7075ed6b7f40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:18.549726 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd41e1f-f839-41f6-9767-7075ed6b7f40 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:18.564584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-1fd41e1f-f839-41f6-9767-7075ed6b7f40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:21:18.564584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:18.564584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:18.564584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:18.564584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:18.564584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:18.564584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:18.564584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:18.564584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:18.564584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:18.564584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:18.564584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:18.564584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:21:18.564584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:21:18.564584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:21:18.565522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:21:18.565522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:18.565522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:18.565522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:18.565522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:18.565522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:18.565522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:18.565522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:18.565522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:21:18.565522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:18.565522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:18.565522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:18.565522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:18.565522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:18.565522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:18.565522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:18.565522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:18.566455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:21:18.566455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:21:18.566455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:21:18.566455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:21:18.566455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:21:18.566455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:21:18.566455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:21:18.566455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:18.567261 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 531/1071] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:21:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:18.573168 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd41e1f-f839-41f6-9767-7075ed6b7f40 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:18.590028 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 541/1072] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:21:18.602643 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9da23-8873-482e-b3ff-5e5d3d183d5a None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:18.602866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9da23-8873-482e-b3ff-5e5d3d183d5a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:18.603145 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9da23-8873-482e-b3ff-5e5d3d183d5a None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:18.604664 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 542/1073] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:18.609542 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5cf9e-7d7a-4cb9-9f33-048cefe2fa28 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:18.609834 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5cf9e-7d7a-4cb9-9f33-048cefe2fa28 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:18.610111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5cf9e-7d7a-4cb9-9f33-048cefe2fa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:18.626280 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-9dd5cf9e-7d7a-4cb9-9f33-048cefe2fa28 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:18.627466 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-9dd5cf9e-7d7a-4cb9-9f33-048cefe2fa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:18.667649 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd41e1f-f839-41f6-9767-7075ed6b7f40 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:18.693701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 543/1074] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:21:18.694791 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5cf9e-7d7a-4cb9-9f33-048cefe2fa28 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:18.703911 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b11fa-c861-464d-82bf-89b176d46756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:18.704658 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b11fa-c861-464d-82bf-89b176d46756 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:18.704941 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b11fa-c861-464d-82bf-89b176d46756 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:18.705259 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b11fa-c861-464d-82bf-89b176d46756 None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:18.706042 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b11fa-c861-464d-82bf-89b176d46756 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:18.706350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b11fa-c861-464d-82bf-89b176d46756 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:18.707828 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b11fa-c861-464d-82bf-89b176d46756 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:18.720411 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 532/1075] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:21:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:18.721269 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b11fa-c861-464d-82bf-89b176d46756 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:18.789897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5cf9e-7d7a-4cb9-9f33-048cefe2fa28 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:18.816743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b11fa-c861-464d-82bf-89b176d46756 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:18.822074 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8aa3e4-a8e0-42b2-9c6c-8bc758b42202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:18.822855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8aa3e4-a8e0-42b2-9c6c-8bc758b42202 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:18.823137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8aa3e4-a8e0-42b2-9c6c-8bc758b42202 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:18.823417 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8aa3e4-a8e0-42b2-9c6c-8bc758b42202 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:18.833331 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8aa3e4-a8e0-42b2-9c6c-8bc758b42202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:21:18.841844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-dd8aa3e4-a8e0-42b2-9c6c-8bc758b42202 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:21:18.841844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:18.841844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:18.841844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:18.841844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:18.841844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:18.841844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:18.841844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:18.841844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:18.841844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:18.841844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:18.841844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:18.841844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:21:18.841844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:21:18.841844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:21:18.841844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:21:18.843027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:21:18.843027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:21:18.843027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:21:18.843027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:21:18.843027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:18.843027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:18.843027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:18.843027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:18.843027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:18.843027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:18.843027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:18.843027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:21:18.843027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:18.843027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:18.843027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:18.843027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:18.845685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:18.845685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:18.845685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:18.845685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:18.845685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:21:18.845685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:21:18.845685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:21:18.845685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:21:18.845685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:21:18.845685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:21:18.845685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:21:18.845685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:18.845685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 544/1076] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:21:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:18.845685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8aa3e4-a8e0-42b2-9c6c-8bc758b42202 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:18.853074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3d4ab-359b-4547-bae6-b1d39d9ca75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:18.853666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3d4ab-359b-4547-bae6-b1d39d9ca75e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:18.853946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3d4ab-359b-4547-bae6-b1d39d9ca75e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:18.854219 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3d4ab-359b-4547-bae6-b1d39d9ca75e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:18.916398 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3d4ab-359b-4547-bae6-b1d39d9ca75e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:18.917870 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3d4ab-359b-4547-bae6-b1d39d9ca75e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:18.937729 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8aa3e4-a8e0-42b2-9c6c-8bc758b42202 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:18.970814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9b0b9-3a95-4fcc-9774-3450dc54cb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:18.971689 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9b0b9-3a95-4fcc-9774-3450dc54cb4c None admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:18.971964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9b0b9-3a95-4fcc-9774-3450dc54cb4c None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:18.972240 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9b0b9-3a95-4fcc-9774-3450dc54cb4c None admin] PATH_INFO: `/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/9b74631c6e1547d991753a65c41bc7e7/roles/ba21f19c24814b0cb6fd00d728df4447` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:18.974479 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9b0b9-3a95-4fcc-9774-3450dc54cb4c None admin] RBAC: Authorizing `identity:create_grant(project_id=4389eb256aba4b7182e33cb3720b1073, user_id=9b74631c6e1547d991753a65c41bc7e7, role_id=ba21f19c24814b0cb6fd00d728df4447)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:18.975917 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9b0b9-3a95-4fcc-9774-3450dc54cb4c None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:18.989265 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 545/1077] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:21:18 2022] PUT /identity/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/9b74631c6e1547d991753a65c41bc7e7/roles/ba21f19c24814b0cb6fd00d728df4447 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:21:18.990056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9b0b9-3a95-4fcc-9774-3450dc54cb4c None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:19.024594 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 533/1078] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:21:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 06 23:21:19.027466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3d4ab-359b-4547-bae6-b1d39d9ca75e None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:19.100479 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9b0b9-3a95-4fcc-9774-3450dc54cb4c None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:19.128369 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3d4ab-359b-4547-bae6-b1d39d9ca75e None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:19.136931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fecfcb-bfb1-40b5-9730-c0bccc4c72ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:19.137945 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fecfcb-bfb1-40b5-9730-c0bccc4c72ab None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:19.138225 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fecfcb-bfb1-40b5-9730-c0bccc4c72ab None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:19.138504 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fecfcb-bfb1-40b5-9730-c0bccc4c72ab None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:19.139265 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fecfcb-bfb1-40b5-9730-c0bccc4c72ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:19.139574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fecfcb-bfb1-40b5-9730-c0bccc4c72ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:19.141028 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fecfcb-bfb1-40b5-9730-c0bccc4c72ab None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:19.155282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 546/1079] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:21:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:19.156465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fecfcb-bfb1-40b5-9730-c0bccc4c72ab None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:19.163458 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886917a4-27af-4019-9730-f2a7a81a7df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:19.164317 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886917a4-27af-4019-9730-f2a7a81a7df0 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:19.164625 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886917a4-27af-4019-9730-f2a7a81a7df0 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:19.164900 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886917a4-27af-4019-9730-f2a7a81a7df0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:19.175350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886917a4-27af-4019-9730-f2a7a81a7df0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:19.176842 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886917a4-27af-4019-9730-f2a7a81a7df0 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:19.195160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-886917a4-27af-4019-9730-f2a7a81a7df0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:21:19.195160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:19.195160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:19.195160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:19.195160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:19.195160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:19.195160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:19.195160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:19.195160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:19.195160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:19.195160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:19.195160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:19.195160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:21:19.195160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:21:19.195160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:21:19.196611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:21:19.196611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:19.196611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:19.196611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:19.196611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:19.196611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:19.196611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:19.196611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:19.196611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:21:19.196611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:19.196611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:19.196611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:19.196611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:19.196611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:19.196611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:19.196611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:19.196611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:19.197735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:21:19.197735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:21:19.197735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:21:19.197735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:19.199784 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 534/1080] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:21:19.206611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886917a4-27af-4019-9730-f2a7a81a7df0 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:19.266245 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fecfcb-bfb1-40b5-9730-c0bccc4c72ab None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:19.304982 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886917a4-27af-4019-9730-f2a7a81a7df0 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:19.307871 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78547afc-b726-4dc7-b45e-39f26d539620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:19.308806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78547afc-b726-4dc7-b45e-39f26d539620 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:19.309092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78547afc-b726-4dc7-b45e-39f26d539620 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:19.309371 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78547afc-b726-4dc7-b45e-39f26d539620 None admin] PATH_INFO: `/v3/users/69c018c7c89b4bd89bac748e44583fe5` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:19.310614 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78547afc-b726-4dc7-b45e-39f26d539620 None admin] RBAC: Authorizing `identity:get_user(user_id=69c018c7c89b4bd89bac748e44583fe5)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:19.313455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78547afc-b726-4dc7-b45e-39f26d539620 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:19.320512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 547/1081] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:21:19 2022] GET /identity/v3/users/69c018c7c89b4bd89bac748e44583fe5 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:19.321671 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78547afc-b726-4dc7-b45e-39f26d539620 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:19.342204 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de5a69-43fd-410e-a857-357363230541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:19.343103 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de5a69-43fd-410e-a857-357363230541 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:19.343386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de5a69-43fd-410e-a857-357363230541 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:19.343664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de5a69-43fd-410e-a857-357363230541 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:19.344383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de5a69-43fd-410e-a857-357363230541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:19.344725 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de5a69-43fd-410e-a857-357363230541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:19.346127 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de5a69-43fd-410e-a857-357363230541 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:19.357934 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 535/1082] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:19.424629 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78547afc-b726-4dc7-b45e-39f26d539620 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:19.459553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da66ae-bfa5-441c-abd3-153ac7598cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:19.460426 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da66ae-bfa5-441c-abd3-153ac7598cbd None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:19.461323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da66ae-bfa5-441c-abd3-153ac7598cbd None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:19.461579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da66ae-bfa5-441c-abd3-153ac7598cbd None admin] PATH_INFO: `/v3/projects/85e344056efb44fe9adc06f9888c82d4` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:19.462817 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da66ae-bfa5-441c-abd3-153ac7598cbd None admin] RBAC: Authorizing `identity:get_project(project_id=85e344056efb44fe9adc06f9888c82d4)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:19.464268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da66ae-bfa5-441c-abd3-153ac7598cbd None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:19.466571 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 548/1083] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:21:19 2022] GET /identity/v3/projects/85e344056efb44fe9adc06f9888c82d4 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:19.472342 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de5a69-43fd-410e-a857-357363230541 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:19.577549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de5a69-43fd-410e-a857-357363230541 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:19.616857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803522d-1f2a-4e17-9023-48b023fe9a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:19.618159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803522d-1f2a-4e17-9023-48b023fe9a1b None admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:19.618440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803522d-1f2a-4e17-9023-48b023fe9a1b None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:19.618713 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803522d-1f2a-4e17-9023-48b023fe9a1b None admin] PATH_INFO: `/v3/projects/85e344056efb44fe9adc06f9888c82d4/users/69c018c7c89b4bd89bac748e44583fe5/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:19.620749 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803522d-1f2a-4e17-9023-48b023fe9a1b None admin] RBAC: Authorizing `identity:create_grant(project_id=85e344056efb44fe9adc06f9888c82d4, user_id=69c018c7c89b4bd89bac748e44583fe5, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:19.622185 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803522d-1f2a-4e17-9023-48b023fe9a1b None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:19.636311 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 536/1084] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:21:19 2022] PUT /identity/v3/projects/85e344056efb44fe9adc06f9888c82d4/users/69c018c7c89b4bd89bac748e44583fe5/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:21:21.248180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96b68-fd9c-4720-948c-7e1fecde0f29 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:21.248705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96b68-fd9c-4720-948c-7e1fecde0f29 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:21.248705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96b68-fd9c-4720-948c-7e1fecde0f29 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:21.250223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 549/1085] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:21.255364 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bc6bd-4e92-4079-8d8c-6b31832de82c None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:21.255822 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bc6bd-4e92-4079-8d8c-6b31832de82c None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:21.255926 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bc6bd-4e92-4079-8d8c-6b31832de82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:21.272945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-466bc6bd-4e92-4079-8d8c-6b31832de82c None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:21.274628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-466bc6bd-4e92-4079-8d8c-6b31832de82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:21.337526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 537/1086] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:21:21.360890 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e96b68-fd9c-4720-948c-7e1fecde0f29 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:21.455598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e96b68-fd9c-4720-948c-7e1fecde0f29 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:21.488188 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8ae32-def6-48f5-bb70-28029d1aa5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:21.489014 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8ae32-def6-48f5-bb70-28029d1aa5a9 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:21.489292 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8ae32-def6-48f5-bb70-28029d1aa5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:21.489560 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8ae32-def6-48f5-bb70-28029d1aa5a9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:21.499295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8ae32-def6-48f5-bb70-28029d1aa5a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:21:21.507207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-93d8ae32-def6-48f5-bb70-28029d1aa5a9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 06 23:21:21.507207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:21.507207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:21.507207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:21.507207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:21.507207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:21.507207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:21.507207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:21.507207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:21.507207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:21.507207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:21.507207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:21.507207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:21:21.507207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:21:21.507207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:21:21.507207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:21:21.508129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:21:21.508129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:21:21.508129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:21:21.508129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:21:21.508129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:21.508129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:21.508129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:21.508129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:21.508129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:21.508129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:21.508129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:21.508129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:21:21.508129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:21.508129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:21.508129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:21.508129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:21.509006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:21.509006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:21.509006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:21.509006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:21.509006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:21:21.509006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:21:21.509006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:21:21.509006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:21:21.509006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:21:21.509006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:21:21.509006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 06 23:21:21.509006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:21.509006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 550/1087] 10.222.0.60 () {56 vars in 1120 bytes} [Fri May 6 23:21:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:21.514288 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bc6bd-4e92-4079-8d8c-6b31832de82c None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:21.614370 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bc6bd-4e92-4079-8d8c-6b31832de82c None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:21.647477 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b890c0d-1708-45a1-bb4a-e7eb8099f1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:21.648257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b890c0d-1708-45a1-bb4a-e7eb8099f1e1 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:21.649069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b890c0d-1708-45a1-bb4a-e7eb8099f1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:21.649343 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b890c0d-1708-45a1-bb4a-e7eb8099f1e1 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:21.650118 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b890c0d-1708-45a1-bb4a-e7eb8099f1e1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:21.650433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b890c0d-1708-45a1-bb4a-e7eb8099f1e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:21.651879 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b890c0d-1708-45a1-bb4a-e7eb8099f1e1 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:21.661014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 538/1088] 10.222.0.60 () {56 vars in 1115 bytes} [Fri May 6 23:21:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:21.666830 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8ae32-def6-48f5-bb70-28029d1aa5a9 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:21.763564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8ae32-def6-48f5-bb70-28029d1aa5a9 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:21.796298 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46dd5f-0099-4b7a-b0cd-d0230e1f30ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:21.797104 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46dd5f-0099-4b7a-b0cd-d0230e1f30ec None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:21.797387 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46dd5f-0099-4b7a-b0cd-d0230e1f30ec None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:21.797660 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46dd5f-0099-4b7a-b0cd-d0230e1f30ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:21.807950 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46dd5f-0099-4b7a-b0cd-d0230e1f30ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:21.809424 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46dd5f-0099-4b7a-b0cd-d0230e1f30ec None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:21.826323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-4e46dd5f-0099-4b7a-b0cd-d0230e1f30ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:21:21.826323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:21.826323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:21.826323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:21.826323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:21.826323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:21.826323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:21.826323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:21.826323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:21.826323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:21.826323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:21.826323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:21.826323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:21:21.826323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:21:21.826323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:21:21.827186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:21:21.827186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:21.827186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:21.827186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:21.827186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:21.827186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:21.827186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:21.827186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:21.827186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:21:21.827186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:21.827186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:21.827186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:21.827186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:21.827186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:21.827186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:21.827186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:21.827186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:21.828082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:21:21.828082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:21:21.828082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:21:21.828082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:21.828082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 551/1089] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:21:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:21.833135 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b890c0d-1708-45a1-bb4a-e7eb8099f1e1 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:21.839156 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a37126-cce9-452c-a1d9-cb3d571decaa None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:21.839698 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a37126-cce9-452c-a1d9-cb3d571decaa None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:21.839977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a37126-cce9-452c-a1d9-cb3d571decaa None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:21.841521 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 552/1090] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:21:21.846590 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef1eb4-558b-42a4-9b04-5fc2da91aa85 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:21.846872 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef1eb4-558b-42a4-9b04-5fc2da91aa85 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:21.847152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef1eb4-558b-42a4-9b04-5fc2da91aa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:21.863877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-2bef1eb4-558b-42a4-9b04-5fc2da91aa85 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:21.865075 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-2bef1eb4-558b-42a4-9b04-5fc2da91aa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:21.928312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 553/1091] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:21:21.929599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b890c0d-1708-45a1-bb4a-e7eb8099f1e1 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:21.951660 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef1eb4-558b-42a4-9b04-5fc2da91aa85 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:21.962018 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1ef7e-e301-42c3-a317-799a22739ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:21.962682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1ef7e-e301-42c3-a317-799a22739ecc None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:21.962960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1ef7e-e301-42c3-a317-799a22739ecc None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:21.963268 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1ef7e-e301-42c3-a317-799a22739ecc None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:21.963989 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1ef7e-e301-42c3-a317-799a22739ecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:21.964293 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1ef7e-e301-42c3-a317-799a22739ecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:21.965951 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1ef7e-e301-42c3-a317-799a22739ecc None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:21.977318 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 539/1092] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:21.982856 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1ef7e-e301-42c3-a317-799a22739ecc None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:22.045509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef1eb4-558b-42a4-9b04-5fc2da91aa85 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:22.074152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1ef7e-e301-42c3-a317-799a22739ecc None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:22.077706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b72f2-f126-4c22-ab6d-c03021cc4cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:22.078484 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b72f2-f126-4c22-ab6d-c03021cc4cfb None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:22.078763 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b72f2-f126-4c22-ab6d-c03021cc4cfb None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:22.079034 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b72f2-f126-4c22-ab6d-c03021cc4cfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:22.089120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b72f2-f126-4c22-ab6d-c03021cc4cfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:21:22.096862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-954b72f2-f126-4c22-ab6d-c03021cc4cfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:21:22.096862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:22.096862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:22.096862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:22.096862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:22.096862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:22.096862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:22.096862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:22.096862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:22.096862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:22.096862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:22.096862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:22.096862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:21:22.096862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:21:22.096862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:21:22.096862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:21:22.098037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:21:22.098037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:21:22.098037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:21:22.098037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:21:22.098037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:22.098037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:22.098037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:22.098037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:22.098037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:22.098037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:22.098037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:22.098037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:21:22.098037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:22.098037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:22.098037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:22.098037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:22.099117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:22.099117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:22.099117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:22.099117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:22.099117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:21:22.099117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:21:22.099117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:21:22.099117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:21:22.099117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:21:22.099117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:21:22.099117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:21:22.099117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:22.099117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 554/1093] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:21:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:21:22.104663 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b72f2-f126-4c22-ab6d-c03021cc4cfb None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:22.110244 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8da465-4753-4f39-b51a-f2254107f807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:22.111028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8da465-4753-4f39-b51a-f2254107f807 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:22.111309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8da465-4753-4f39-b51a-f2254107f807 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:22.111583 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8da465-4753-4f39-b51a-f2254107f807 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:22.118518 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8da465-4753-4f39-b51a-f2254107f807 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:22.119949 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8da465-4753-4f39-b51a-f2254107f807 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:22.133858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-eb8da465-4753-4f39-b51a-f2254107f807 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 06 23:21:22.133858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:22.133858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:22.133858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:22.133858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:22.133858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:22.133858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:22.133858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:22.133858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:22.133858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:22.133858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:22.133858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:22.133858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:21:22.133858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:21:22.133858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:21:22.133858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:21:22.135119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:22.135119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:22.135119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:21:22.135119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:21:22.135119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:21:22.135119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:21:22.135119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:22.135119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:22.135119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:22.135119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:22.135119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:22.135119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:21:22.135119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:22.135119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:22.135119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:22.135119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:22.135119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:22.135119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:22.136319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:22.136319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:22.136319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:21:22.136319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:21:22.136319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:21:22.136319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:21:22.136319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:21:22.136319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:21:22.136319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 06 23:21:22.136319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:22.136319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 540/1094] 10.222.0.60 () {56 vars in 1093 bytes} [Fri May 6 23:21:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:21:22.140569 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8da465-4753-4f39-b51a-f2254107f807 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:22.200117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b72f2-f126-4c22-ab6d-c03021cc4cfb None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:22.230972 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3292b-87d0-4cf7-b6e1-a531687901be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:22.231616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3292b-87d0-4cf7-b6e1-a531687901be None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:22.231891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3292b-87d0-4cf7-b6e1-a531687901be None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:22.232161 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3292b-87d0-4cf7-b6e1-a531687901be None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:22.232445 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8da465-4753-4f39-b51a-f2254107f807 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:22.232926 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3292b-87d0-4cf7-b6e1-a531687901be None admin] RBAC: Adding query filter params (name=admin) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:22.233228 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3292b-87d0-4cf7-b6e1-a531687901be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:22.234587 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3292b-87d0-4cf7-b6e1-a531687901be None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:22.242771 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 555/1095] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:21:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:22.248313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3292b-87d0-4cf7-b6e1-a531687901be None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:22.267447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db2e05-4f47-42af-be80-caee8a89fdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:22.268126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db2e05-4f47-42af-be80-caee8a89fdc7 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:22.268409 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db2e05-4f47-42af-be80-caee8a89fdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:22.268721 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db2e05-4f47-42af-be80-caee8a89fdc7 None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:22.269556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db2e05-4f47-42af-be80-caee8a89fdc7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:22.269859 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db2e05-4f47-42af-be80-caee8a89fdc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:22.271290 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db2e05-4f47-42af-be80-caee8a89fdc7 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:22.287852 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 541/1096] 10.222.0.60 () {56 vars in 1133 bytes} [Fri May 6 23:21:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:22.293538 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db2e05-4f47-42af-be80-caee8a89fdc7 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:22.343737 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3292b-87d0-4cf7-b6e1-a531687901be None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:22.375061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee205629-d917-4d01-b2c2-bc51bf78c48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:22.375921 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee205629-d917-4d01-b2c2-bc51bf78c48d None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:22.376203 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee205629-d917-4d01-b2c2-bc51bf78c48d None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:22.376480 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee205629-d917-4d01-b2c2-bc51bf78c48d None admin] PATH_INFO: `/v3/users/69c018c7c89b4bd89bac748e44583fe5` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:22.377703 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee205629-d917-4d01-b2c2-bc51bf78c48d None admin] RBAC: Authorizing `identity:get_user(user_id=69c018c7c89b4bd89bac748e44583fe5)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:22.379128 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee205629-d917-4d01-b2c2-bc51bf78c48d None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:22.380794 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 556/1097] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:21:22 2022] GET /identity/v3/users/69c018c7c89b4bd89bac748e44583fe5 => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:22.385448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db2e05-4f47-42af-be80-caee8a89fdc7 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:22.386975 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee205629-d917-4d01-b2c2-bc51bf78c48d None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:22.418046 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58ec96-f27c-4115-b8e4-24b82109c961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:22.418684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58ec96-f27c-4115-b8e4-24b82109c961 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:22.418962 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58ec96-f27c-4115-b8e4-24b82109c961 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:22.419239 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58ec96-f27c-4115-b8e4-24b82109c961 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:22.479301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee205629-d917-4d01-b2c2-bc51bf78c48d None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:22.482525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58ec96-f27c-4115-b8e4-24b82109c961 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:22.483966 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58ec96-f27c-4115-b8e4-24b82109c961 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:22.510746 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b28422-a57a-47ed-9839-ea5311bee976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:22.511382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b28422-a57a-47ed-9839-ea5311bee976 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:22.511664 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b28422-a57a-47ed-9839-ea5311bee976 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:22.511938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b28422-a57a-47ed-9839-ea5311bee976 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:22.574496 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b28422-a57a-47ed-9839-ea5311bee976 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:22.574656 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 542/1098] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:21:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 06 23:21:22.576129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b28422-a57a-47ed-9839-ea5311bee976 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:22.580316 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58ec96-f27c-4115-b8e4-24b82109c961 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:22.667232 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 557/1099] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:21:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 06 23:21:22.670839 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58ec96-f27c-4115-b8e4-24b82109c961 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:22.673148 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b28422-a57a-47ed-9839-ea5311bee976 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:22.703039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7678bc1-3d56-4f73-9fdc-0193078af161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:22.703977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7678bc1-3d56-4f73-9fdc-0193078af161 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:22.704259 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7678bc1-3d56-4f73-9fdc-0193078af161 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:22.704562 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7678bc1-3d56-4f73-9fdc-0193078af161 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:22.714863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7678bc1-3d56-4f73-9fdc-0193078af161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:22.716295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7678bc1-3d56-4f73-9fdc-0193078af161 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:22.732935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-e7678bc1-3d56-4f73-9fdc-0193078af161 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:21:22.732935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:22.732935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:22.732935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:22.732935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:22.732935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:22.732935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:22.732935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:22.732935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:22.732935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:22.732935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:22.732935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:22.732935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:21:22.732935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:21:22.732935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:21:22.734014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:21:22.734014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:22.734014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:22.734014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:22.734014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:22.734014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:22.734014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:22.734014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:22.734014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:21:22.734014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:22.734014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:22.734014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:22.734014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:22.734014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:22.734014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:22.734014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:22.734014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:22.735179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:21:22.735179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:21:22.735179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:21:22.735179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:22.735179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 543/1100] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:21:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:21:22.739465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7678bc1-3d56-4f73-9fdc-0193078af161 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:22.767125 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b28422-a57a-47ed-9839-ea5311bee976 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:22.798148 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266c4ba-ad4d-4f28-a1ff-a2640b7e8781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:22.798994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266c4ba-ad4d-4f28-a1ff-a2640b7e8781 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:22.799272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266c4ba-ad4d-4f28-a1ff-a2640b7e8781 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:22.799545 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266c4ba-ad4d-4f28-a1ff-a2640b7e8781 None admin] PATH_INFO: `/v3/projects/85e344056efb44fe9adc06f9888c82d4` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:22.800745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266c4ba-ad4d-4f28-a1ff-a2640b7e8781 None admin] RBAC: Authorizing `identity:get_project(project_id=85e344056efb44fe9adc06f9888c82d4)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:22.802173 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266c4ba-ad4d-4f28-a1ff-a2640b7e8781 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:22.803850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 558/1101] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:21:22 2022] GET /identity/v3/projects/85e344056efb44fe9adc06f9888c82d4 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:22.810383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266c4ba-ad4d-4f28-a1ff-a2640b7e8781 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:22.832608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7678bc1-3d56-4f73-9fdc-0193078af161 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:22.867866 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ae542-29d6-436c-805f-0c9a43809c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:22.868520 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ae542-29d6-436c-805f-0c9a43809c6d None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:22.868835 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ae542-29d6-436c-805f-0c9a43809c6d None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:22.869107 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ae542-29d6-436c-805f-0c9a43809c6d None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:22.869820 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ae542-29d6-436c-805f-0c9a43809c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:22.870119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ae542-29d6-436c-805f-0c9a43809c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:22.871478 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ae542-29d6-436c-805f-0c9a43809c6d None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:22.882146 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 544/1102] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:22.888102 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ae542-29d6-436c-805f-0c9a43809c6d None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:22.903166 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266c4ba-ad4d-4f28-a1ff-a2640b7e8781 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:22.937302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab0594-f2b6-4285-a2d3-61dbf24666db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:22.937866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab0594-f2b6-4285-a2d3-61dbf24666db None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:22.938141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab0594-f2b6-4285-a2d3-61dbf24666db None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:22.938408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab0594-f2b6-4285-a2d3-61dbf24666db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:22.939228 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab0594-f2b6-4285-a2d3-61dbf24666db None admin] RBAC: Adding query filter params (role.id=408ee9a3a38640a48dbcdb2c377efcd8, scope.project.id=85e344056efb44fe9adc06f9888c82d4, user.id=69c018c7c89b4bd89bac748e44583fe5) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:22.939532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab0594-f2b6-4285-a2d3-61dbf24666db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:22.940997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab0594-f2b6-4285-a2d3-61dbf24666db None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:22.947215 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 559/1103] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:21:22 2022] GET /identity/v3/role_assignments?user.id=69c018c7c89b4bd89bac748e44583fe5&scope.project.id=85e344056efb44fe9adc06f9888c82d4&role.id=408ee9a3a38640a48dbcdb2c377efcd8 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:22.988302 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ae542-29d6-436c-805f-0c9a43809c6d None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:23.023484 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585f2d0-f6d3-401d-8805-edf6b6d987b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:23.024284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585f2d0-f6d3-401d-8805-edf6b6d987b6 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:23.024584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585f2d0-f6d3-401d-8805-edf6b6d987b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:23.024857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585f2d0-f6d3-401d-8805-edf6b6d987b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:23.032123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585f2d0-f6d3-401d-8805-edf6b6d987b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:23.033632 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585f2d0-f6d3-401d-8805-edf6b6d987b6 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:23.048334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-d585f2d0-f6d3-401d-8805-edf6b6d987b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:21:23.048334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:23.048334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:23.048334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:23.048334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:23.048334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:23.048334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:23.048334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:23.048334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:23.048334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:23.048334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:23.048334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:23.048334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:21:23.048334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:21:23.048334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:21:23.049519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:21:23.049519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:23.049519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:23.049519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:23.049519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:23.049519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:23.049519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:23.049519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:23.049519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:21:23.049519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:23.049519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:23.049519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:23.049519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:23.049519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:23.049519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:23.049519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:23.049519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:23.050435 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:21:23.050435 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:21:23.050435 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:21:23.050435 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:21:23.050435 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:21:23.050435 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:21:23.050435 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:21:23.050435 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:23.050435 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 545/1104] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:21:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:21:23.056140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab0594-f2b6-4285-a2d3-61dbf24666db None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:23.154551 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab0594-f2b6-4285-a2d3-61dbf24666db None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:23.186837 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01ab26-f074-4b88-928d-d3235774269b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:23.187541 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01ab26-f074-4b88-928d-d3235774269b None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:23.187769 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01ab26-f074-4b88-928d-d3235774269b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:23.188042 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01ab26-f074-4b88-928d-d3235774269b None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:23.188863 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01ab26-f074-4b88-928d-d3235774269b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:23.189169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01ab26-f074-4b88-928d-d3235774269b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:23.190593 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01ab26-f074-4b88-928d-d3235774269b None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:23.202123 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 560/1105] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:21:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:23.208135 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585f2d0-f6d3-401d-8805-edf6b6d987b6 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:23.312477 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585f2d0-f6d3-401d-8805-edf6b6d987b6 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:23.344718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3464e3-5cdb-407a-86eb-26c98bfd984f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:23.345369 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3464e3-5cdb-407a-86eb-26c98bfd984f None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:23.345648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3464e3-5cdb-407a-86eb-26c98bfd984f None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:23.345917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3464e3-5cdb-407a-86eb-26c98bfd984f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:23.346730 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3464e3-5cdb-407a-86eb-26c98bfd984f None admin] RBAC: Adding query filter params (role.id=ba21f19c24814b0cb6fd00d728df4447, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=9b74631c6e1547d991753a65c41bc7e7) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:23.347037 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3464e3-5cdb-407a-86eb-26c98bfd984f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:23.348456 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3464e3-5cdb-407a-86eb-26c98bfd984f None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:23.354575 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 546/1106] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:21:23 2022] GET /identity/v3/role_assignments?user.id=9b74631c6e1547d991753a65c41bc7e7&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=ba21f19c24814b0cb6fd00d728df4447 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:25.181799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d917401-4eef-4872-a5a4-5ad2ac6bc796 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:25.182302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d917401-4eef-4872-a5a4-5ad2ac6bc796 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:25.182302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d917401-4eef-4872-a5a4-5ad2ac6bc796 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:25.183608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 561/1107] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:25.188950 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3c2e8-5b01-4ba9-b722-323f6b5d6eb1 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:25.189324 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3c2e8-5b01-4ba9-b722-323f6b5d6eb1 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:25.189506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3c2e8-5b01-4ba9-b722-323f6b5d6eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:25.206230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-34f3c2e8-5b01-4ba9-b722-323f6b5d6eb1 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:25.207413 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-34f3c2e8-5b01-4ba9-b722-323f6b5d6eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:25.271474 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 547/1108] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:21:25.295296 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d917401-4eef-4872-a5a4-5ad2ac6bc796 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:25.389305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d917401-4eef-4872-a5a4-5ad2ac6bc796 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:25.420725 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea20991-4297-481a-886f-8cd0ac7adcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:25.421488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea20991-4297-481a-886f-8cd0ac7adcb4 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:25.421767 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea20991-4297-481a-886f-8cd0ac7adcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:25.422037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea20991-4297-481a-886f-8cd0ac7adcb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:25.423176 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea20991-4297-481a-886f-8cd0ac7adcb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:25.424607 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea20991-4297-481a-886f-8cd0ac7adcb4 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:25.426168 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 562/1109] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:21:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:25.432166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3c2e8-5b01-4ba9-b722-323f6b5d6eb1 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:25.522455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3c2e8-5b01-4ba9-b722-323f6b5d6eb1 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:25.557186 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da86b7-34c3-49ca-9221-c52cc199ae90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:25.557842 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da86b7-34c3-49ca-9221-c52cc199ae90 None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:25.558118 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da86b7-34c3-49ca-9221-c52cc199ae90 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:25.558386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da86b7-34c3-49ca-9221-c52cc199ae90 None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:25.559087 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da86b7-34c3-49ca-9221-c52cc199ae90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:25.560500 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da86b7-34c3-49ca-9221-c52cc199ae90 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:25.578845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 548/1110] 10.222.0.60 () {60 vars in 1132 bytes} [Fri May 6 23:21:25 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:21:27.818455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeb928-6761-4c91-a8b3-07d10e04bc68 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:27.819008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeb928-6761-4c91-a8b3-07d10e04bc68 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:27.819008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeb928-6761-4c91-a8b3-07d10e04bc68 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:27.820899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 563/1111] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:27.826171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58627c87-014c-4de0-918e-066636bce33b None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:27.826564 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58627c87-014c-4de0-918e-066636bce33b None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:27.826716 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58627c87-014c-4de0-918e-066636bce33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:27.843988 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-58627c87-014c-4de0-918e-066636bce33b None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:27.844912 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-58627c87-014c-4de0-918e-066636bce33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:27.906376 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 549/1112] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:21:27.929019 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eeb928-6761-4c91-a8b3-07d10e04bc68 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:28.025494 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eeb928-6761-4c91-a8b3-07d10e04bc68 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:28.056456 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ee34a-d600-4741-ad80-54b96d3931b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:28.057309 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ee34a-d600-4741-ad80-54b96d3931b6 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:28.057583 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ee34a-d600-4741-ad80-54b96d3931b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:28.057851 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ee34a-d600-4741-ad80-54b96d3931b6 None admin] PATH_INFO: `/v3/roles/2cfb5ae0e4244117845519425cb9235e` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:28.059287 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ee34a-d600-4741-ad80-54b96d3931b6 None admin] RBAC: Authorizing `identity:get_role(role_id=2cfb5ae0e4244117845519425cb9235e)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:28.060671 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ee34a-d600-4741-ad80-54b96d3931b6 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:28.062023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 564/1113] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:21:27 2022] GET /identity/v3/roles/2cfb5ae0e4244117845519425cb9235e => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:28.067802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58627c87-014c-4de0-918e-066636bce33b None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:28.161150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58627c87-014c-4de0-918e-066636bce33b None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:28.192200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e503b78-83c5-4bcf-9692-70a1e558694b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:28.193085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e503b78-83c5-4bcf-9692-70a1e558694b None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:28.193363 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e503b78-83c5-4bcf-9692-70a1e558694b None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:28.193635 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e503b78-83c5-4bcf-9692-70a1e558694b None admin] PATH_INFO: `/v3/users/02229723887e4760b7af494bb3e629cf` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:28.206318 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e503b78-83c5-4bcf-9692-70a1e558694b None admin] RBAC: Authorizing `identity:get_user(user_id=02229723887e4760b7af494bb3e629cf)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:28.207753 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e503b78-83c5-4bcf-9692-70a1e558694b None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:28.209395 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 550/1114] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:21:28 2022] GET /identity/v3/users/02229723887e4760b7af494bb3e629cf => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:28.215331 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ee34a-d600-4741-ad80-54b96d3931b6 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:28.314105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ee34a-d600-4741-ad80-54b96d3931b6 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:28.345499 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d074ed0-bcaf-40cc-9e5a-44c46708fef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:28.346124 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d074ed0-bcaf-40cc-9e5a-44c46708fef5 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:28.346400 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d074ed0-bcaf-40cc-9e5a-44c46708fef5 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:28.346668 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d074ed0-bcaf-40cc-9e5a-44c46708fef5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:28.407905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d074ed0-bcaf-40cc-9e5a-44c46708fef5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:28.409351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d074ed0-bcaf-40cc-9e5a-44c46708fef5 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:28.499863 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 565/1115] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:21:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 06 23:21:28.505876 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e503b78-83c5-4bcf-9692-70a1e558694b None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:28.596646 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e503b78-83c5-4bcf-9692-70a1e558694b None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:28.628360 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786d78b-462c-400b-b2b1-299231388e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:28.629210 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786d78b-462c-400b-b2b1-299231388e42 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:28.629485 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786d78b-462c-400b-b2b1-299231388e42 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:28.629752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786d78b-462c-400b-b2b1-299231388e42 None admin] PATH_INFO: `/v3/projects/85e344056efb44fe9adc06f9888c82d4` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:28.630897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786d78b-462c-400b-b2b1-299231388e42 None admin] RBAC: Authorizing `identity:get_project(project_id=85e344056efb44fe9adc06f9888c82d4)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:28.632338 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786d78b-462c-400b-b2b1-299231388e42 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:28.634004 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 551/1116] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:21:28 2022] GET /identity/v3/projects/85e344056efb44fe9adc06f9888c82d4 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:28.639807 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d074ed0-bcaf-40cc-9e5a-44c46708fef5 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:28.731122 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d074ed0-bcaf-40cc-9e5a-44c46708fef5 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:28.762680 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a79584-6741-4516-b25a-e8be1a4775a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:28.763251 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a79584-6741-4516-b25a-e8be1a4775a8 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:28.763533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a79584-6741-4516-b25a-e8be1a4775a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:28.763808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a79584-6741-4516-b25a-e8be1a4775a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:28.764651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a79584-6741-4516-b25a-e8be1a4775a8 None admin] RBAC: Adding query filter params (role.id=2cfb5ae0e4244117845519425cb9235e, scope.project.id=85e344056efb44fe9adc06f9888c82d4, user.id=02229723887e4760b7af494bb3e629cf) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:28.764961 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a79584-6741-4516-b25a-e8be1a4775a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:28.766379 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a79584-6741-4516-b25a-e8be1a4775a8 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:28.771496 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 566/1117] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:21:28 2022] GET /identity/v3/role_assignments?user.id=02229723887e4760b7af494bb3e629cf&scope.project.id=85e344056efb44fe9adc06f9888c82d4&role.id=2cfb5ae0e4244117845519425cb9235e => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:30.952211 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00101eb3-e6c6-4081-a9bf-8ce10ccf5757 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:30.952794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00101eb3-e6c6-4081-a9bf-8ce10ccf5757 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:30.952794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00101eb3-e6c6-4081-a9bf-8ce10ccf5757 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:30.954154 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 552/1118] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:30.959578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e1df3-0fc5-4eb0-b954-e98c676efc61 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:30.960009 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e1df3-0fc5-4eb0-b954-e98c676efc61 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:30.960103 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e1df3-0fc5-4eb0-b954-e98c676efc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:30.976853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-307e1df3-0fc5-4eb0-b954-e98c676efc61 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:30.978094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-307e1df3-0fc5-4eb0-b954-e98c676efc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:31.040047 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 567/1119] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:21:31.062113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00101eb3-e6c6-4081-a9bf-8ce10ccf5757 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:31.157446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00101eb3-e6c6-4081-a9bf-8ce10ccf5757 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:31.188793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db429e-d868-42a0-b1e7-1082a6749521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:31.189623 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db429e-d868-42a0-b1e7-1082a6749521 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:31.189905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db429e-d868-42a0-b1e7-1082a6749521 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:31.190179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db429e-d868-42a0-b1e7-1082a6749521 None admin] PATH_INFO: `/v3/roles/2cfb5ae0e4244117845519425cb9235e` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:31.191630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db429e-d868-42a0-b1e7-1082a6749521 None admin] RBAC: Authorizing `identity:get_role(role_id=2cfb5ae0e4244117845519425cb9235e)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:31.193023 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db429e-d868-42a0-b1e7-1082a6749521 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:31.194370 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 553/1120] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:21:31 2022] GET /identity/v3/roles/2cfb5ae0e4244117845519425cb9235e => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:31.200245 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e1df3-0fc5-4eb0-b954-e98c676efc61 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:31.299957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e1df3-0fc5-4eb0-b954-e98c676efc61 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:31.331928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197586cf-adf1-4f44-813c-0a4d60796250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:31.332807 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197586cf-adf1-4f44-813c-0a4d60796250 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:31.333083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197586cf-adf1-4f44-813c-0a4d60796250 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:31.333352 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197586cf-adf1-4f44-813c-0a4d60796250 None admin] PATH_INFO: `/v3/users/02229723887e4760b7af494bb3e629cf` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:31.334526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197586cf-adf1-4f44-813c-0a4d60796250 None admin] RBAC: Authorizing `identity:get_user(user_id=02229723887e4760b7af494bb3e629cf)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:31.336491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197586cf-adf1-4f44-813c-0a4d60796250 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:31.338145 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 568/1121] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:21:31 2022] GET /identity/v3/users/02229723887e4760b7af494bb3e629cf => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:31.344226 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db429e-d868-42a0-b1e7-1082a6749521 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:31.436870 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db429e-d868-42a0-b1e7-1082a6749521 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:31.469326 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dca7f-b033-4740-8809-b6ecd1361564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:31.470159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dca7f-b033-4740-8809-b6ecd1361564 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:31.470441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dca7f-b033-4740-8809-b6ecd1361564 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:31.470716 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dca7f-b033-4740-8809-b6ecd1361564 None admin] PATH_INFO: `/v3/projects/85e344056efb44fe9adc06f9888c82d4` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:31.471871 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908dca7f-b033-4740-8809-b6ecd1361564 None admin] RBAC: Authorizing `identity:get_project(project_id=85e344056efb44fe9adc06f9888c82d4)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:31.473328 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908dca7f-b033-4740-8809-b6ecd1361564 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:31.475000 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 554/1122] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:21:31 2022] GET /identity/v3/projects/85e344056efb44fe9adc06f9888c82d4 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:31.480671 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197586cf-adf1-4f44-813c-0a4d60796250 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:31.572929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197586cf-adf1-4f44-813c-0a4d60796250 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:31.605422 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea406aa9-2f5c-48b6-93d7-76b8cc5b0e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:31.606279 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea406aa9-2f5c-48b6-93d7-76b8cc5b0e88 None admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:31.606557 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea406aa9-2f5c-48b6-93d7-76b8cc5b0e88 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:31.606828 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea406aa9-2f5c-48b6-93d7-76b8cc5b0e88 None admin] PATH_INFO: `/v3/projects/85e344056efb44fe9adc06f9888c82d4/users/02229723887e4760b7af494bb3e629cf/roles/2cfb5ae0e4244117845519425cb9235e` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:31.609004 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea406aa9-2f5c-48b6-93d7-76b8cc5b0e88 None admin] RBAC: Authorizing `identity:create_grant(project_id=85e344056efb44fe9adc06f9888c82d4, user_id=02229723887e4760b7af494bb3e629cf, role_id=2cfb5ae0e4244117845519425cb9235e)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:31.610409 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea406aa9-2f5c-48b6-93d7-76b8cc5b0e88 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:31.622326 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 569/1123] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:21:31 2022] PUT /identity/v3/projects/85e344056efb44fe9adc06f9888c82d4/users/02229723887e4760b7af494bb3e629cf/roles/2cfb5ae0e4244117845519425cb9235e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:21:33.806758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc8968-55db-49f7-8d35-47071e78d8e9 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:33.807289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc8968-55db-49f7-8d35-47071e78d8e9 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:33.807289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc8968-55db-49f7-8d35-47071e78d8e9 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:33.808705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 555/1124] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:33.814021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef1b27-be16-4cd3-91e9-3e993fee0817 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:33.814445 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef1b27-be16-4cd3-91e9-3e993fee0817 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:33.814564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef1b27-be16-4cd3-91e9-3e993fee0817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:33.831263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-09ef1b27-be16-4cd3-91e9-3e993fee0817 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:33.832408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-09ef1b27-be16-4cd3-91e9-3e993fee0817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:33.893952 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 570/1125] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:21:33.916871 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc8968-55db-49f7-8d35-47071e78d8e9 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:34.009669 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc8968-55db-49f7-8d35-47071e78d8e9 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:34.041673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8785fe3-f534-4f62-bee2-429317ba14cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:34.042498 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8785fe3-f534-4f62-bee2-429317ba14cb None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:34.042777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8785fe3-f534-4f62-bee2-429317ba14cb None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:34.043050 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8785fe3-f534-4f62-bee2-429317ba14cb None admin] PATH_INFO: `/v3/roles/2cfb5ae0e4244117845519425cb9235e` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:34.044493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8785fe3-f534-4f62-bee2-429317ba14cb None admin] RBAC: Authorizing `identity:get_role(role_id=2cfb5ae0e4244117845519425cb9235e)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:34.045886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8785fe3-f534-4f62-bee2-429317ba14cb None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:34.047228 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 556/1126] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:21:33 2022] GET /identity/v3/roles/2cfb5ae0e4244117845519425cb9235e => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:34.053034 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef1b27-be16-4cd3-91e9-3e993fee0817 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:34.143242 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef1b27-be16-4cd3-91e9-3e993fee0817 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:34.175483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203cc51-8fe8-47da-a33a-94ed5a962734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:34.176325 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203cc51-8fe8-47da-a33a-94ed5a962734 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:34.176628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203cc51-8fe8-47da-a33a-94ed5a962734 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:34.176901 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203cc51-8fe8-47da-a33a-94ed5a962734 None admin] PATH_INFO: `/v3/users/02229723887e4760b7af494bb3e629cf` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:34.178064 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203cc51-8fe8-47da-a33a-94ed5a962734 None admin] RBAC: Authorizing `identity:get_user(user_id=02229723887e4760b7af494bb3e629cf)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:34.179516 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203cc51-8fe8-47da-a33a-94ed5a962734 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:34.181145 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 571/1127] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:21:34 2022] GET /identity/v3/users/02229723887e4760b7af494bb3e629cf => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:34.186589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8785fe3-f534-4f62-bee2-429317ba14cb None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:34.278893 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8785fe3-f534-4f62-bee2-429317ba14cb None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:34.310071 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04272d2e-14ed-42bc-ae77-cc3c6b5f03c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:34.310691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04272d2e-14ed-42bc-ae77-cc3c6b5f03c7 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:34.310970 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04272d2e-14ed-42bc-ae77-cc3c6b5f03c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:34.311244 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04272d2e-14ed-42bc-ae77-cc3c6b5f03c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:34.377575 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04272d2e-14ed-42bc-ae77-cc3c6b5f03c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:34.379025 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04272d2e-14ed-42bc-ae77-cc3c6b5f03c7 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:34.469701 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 557/1128] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:21:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 06 23:21:34.475465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203cc51-8fe8-47da-a33a-94ed5a962734 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:34.566163 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203cc51-8fe8-47da-a33a-94ed5a962734 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:34.598117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005509ad-faf2-433e-9ef2-3965ce4edd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:34.598950 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005509ad-faf2-433e-9ef2-3965ce4edd5e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:34.599228 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005509ad-faf2-433e-9ef2-3965ce4edd5e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:34.599501 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005509ad-faf2-433e-9ef2-3965ce4edd5e None admin] PATH_INFO: `/v3/projects/85e344056efb44fe9adc06f9888c82d4` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:34.600698 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005509ad-faf2-433e-9ef2-3965ce4edd5e None admin] RBAC: Authorizing `identity:get_project(project_id=85e344056efb44fe9adc06f9888c82d4)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:34.602149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005509ad-faf2-433e-9ef2-3965ce4edd5e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:34.603793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 572/1129] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:21:34 2022] GET /identity/v3/projects/85e344056efb44fe9adc06f9888c82d4 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:34.609642 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04272d2e-14ed-42bc-ae77-cc3c6b5f03c7 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:34.701325 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04272d2e-14ed-42bc-ae77-cc3c6b5f03c7 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:34.735030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a069df9-f323-4b10-b866-9593492f3759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:34.735602 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a069df9-f323-4b10-b866-9593492f3759 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:34.735880 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a069df9-f323-4b10-b866-9593492f3759 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:34.736154 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a069df9-f323-4b10-b866-9593492f3759 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:34.737008 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a069df9-f323-4b10-b866-9593492f3759 None admin] RBAC: Adding query filter params (role.id=2cfb5ae0e4244117845519425cb9235e, scope.project.id=85e344056efb44fe9adc06f9888c82d4, user.id=02229723887e4760b7af494bb3e629cf) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:34.737317 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a069df9-f323-4b10-b866-9593492f3759 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:34.738751 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a069df9-f323-4b10-b866-9593492f3759 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:34.744799 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 558/1130] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:21:34 2022] GET /identity/v3/role_assignments?user.id=02229723887e4760b7af494bb3e629cf&scope.project.id=85e344056efb44fe9adc06f9888c82d4&role.id=2cfb5ae0e4244117845519425cb9235e => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:36.960082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73605506-1e0a-40a4-adf9-6ae74b5594fc None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:36.960652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73605506-1e0a-40a4-adf9-6ae74b5594fc None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:36.960767 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73605506-1e0a-40a4-adf9-6ae74b5594fc None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:36.962620 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 573/1131] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:36.968246 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472dc05-baa8-463e-8563-d20c767909c9 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:36.968707 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472dc05-baa8-463e-8563-d20c767909c9 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:36.968827 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472dc05-baa8-463e-8563-d20c767909c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:36.985979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-9472dc05-baa8-463e-8563-d20c767909c9 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:36.987063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9472dc05-baa8-463e-8563-d20c767909c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:37.048653 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 559/1132] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:21:37.072269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73605506-1e0a-40a4-adf9-6ae74b5594fc None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:37.166452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73605506-1e0a-40a4-adf9-6ae74b5594fc None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:37.197953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db22fc9-23aa-4697-a40a-6cc359bb1a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:37.198718 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db22fc9-23aa-4697-a40a-6cc359bb1a16 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:37.198997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db22fc9-23aa-4697-a40a-6cc359bb1a16 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:37.199271 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db22fc9-23aa-4697-a40a-6cc359bb1a16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:37.200421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db22fc9-23aa-4697-a40a-6cc359bb1a16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:37.201870 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db22fc9-23aa-4697-a40a-6cc359bb1a16 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:37.203452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 574/1133] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:21:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:37.209099 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472dc05-baa8-463e-8563-d20c767909c9 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:37.304789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472dc05-baa8-463e-8563-d20c767909c9 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:37.336076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60a6ab-2042-4659-9285-6f53622a078e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:37.336748 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60a6ab-2042-4659-9285-6f53622a078e None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:37.337026 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60a6ab-2042-4659-9285-6f53622a078e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:37.337294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60a6ab-2042-4659-9285-6f53622a078e None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:37.337986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60a6ab-2042-4659-9285-6f53622a078e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:37.339409 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60a6ab-2042-4659-9285-6f53622a078e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:37.365415 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 560/1134] 10.222.0.60 () {60 vars in 1141 bytes} [Fri May 6 23:21:37 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:21:39.607628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332677bb-4120-4bfc-bdf8-b9c96fc83d82 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:39.608206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332677bb-4120-4bfc-bdf8-b9c96fc83d82 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:39.608206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332677bb-4120-4bfc-bdf8-b9c96fc83d82 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:39.609545 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 575/1135] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:39.614674 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cecd5a-3eeb-4017-9a3a-04c4fd4a88e4 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:39.615058 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cecd5a-3eeb-4017-9a3a-04c4fd4a88e4 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:39.615225 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cecd5a-3eeb-4017-9a3a-04c4fd4a88e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:39.631898 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-e9cecd5a-3eeb-4017-9a3a-04c4fd4a88e4 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:39.633143 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e9cecd5a-3eeb-4017-9a3a-04c4fd4a88e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:39.696014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 561/1136] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:21:39.720305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332677bb-4120-4bfc-bdf8-b9c96fc83d82 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:39.815167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332677bb-4120-4bfc-bdf8-b9c96fc83d82 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:39.846625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4cb0a-5b07-4964-863f-ad4bccd564c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:39.847405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4cb0a-5b07-4964-863f-ad4bccd564c6 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:39.847684 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4cb0a-5b07-4964-863f-ad4bccd564c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:39.847956 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4cb0a-5b07-4964-863f-ad4bccd564c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:39.849134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4cb0a-5b07-4964-863f-ad4bccd564c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:39.850562 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4cb0a-5b07-4964-863f-ad4bccd564c6 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:39.852712 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 576/1137] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:21:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:39.858379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cecd5a-3eeb-4017-9a3a-04c4fd4a88e4 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:39.949804 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cecd5a-3eeb-4017-9a3a-04c4fd4a88e4 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:39.981452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c359ee-8378-4b3d-999c-cf494a80dbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:39.982095 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c359ee-8378-4b3d-999c-cf494a80dbcc None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:39.982376 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c359ee-8378-4b3d-999c-cf494a80dbcc None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:39.982649 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c359ee-8378-4b3d-999c-cf494a80dbcc None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:39.983341 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c359ee-8378-4b3d-999c-cf494a80dbcc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:39.984790 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c359ee-8378-4b3d-999c-cf494a80dbcc None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:40.004033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 562/1138] 10.222.0.60 () {60 vars in 1132 bytes} [Fri May 6 23:21:39 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:21:42.232514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dab7a-4f07-4ac7-a863-f5249e8caf64 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:42.233046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dab7a-4f07-4ac7-a863-f5249e8caf64 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:42.233046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dab7a-4f07-4ac7-a863-f5249e8caf64 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:42.234387 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 577/1139] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:42.239517 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ec250-c9db-4f11-875a-d81a95a84753 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:42.239945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ec250-c9db-4f11-875a-d81a95a84753 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:42.240076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ec250-c9db-4f11-875a-d81a95a84753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:42.256814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-e78ec250-c9db-4f11-875a-d81a95a84753 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:42.258030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e78ec250-c9db-4f11-875a-d81a95a84753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:42.320715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 563/1140] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:21:42.343783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742dab7a-4f07-4ac7-a863-f5249e8caf64 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:42.437367 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742dab7a-4f07-4ac7-a863-f5249e8caf64 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:42.468857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a32f-1f34-40c9-851d-39f514656d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:42.469618 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a32f-1f34-40c9-851d-39f514656d70 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:42.469898 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a32f-1f34-40c9-851d-39f514656d70 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:42.470168 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a32f-1f34-40c9-851d-39f514656d70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:42.480240 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02a32f-1f34-40c9-851d-39f514656d70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:21:42.487857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-be02a32f-1f34-40c9-851d-39f514656d70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:21:42.487857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:42.487857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:42.487857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:42.487857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:42.487857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:42.487857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:42.487857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:42.487857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:42.487857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:42.487857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:42.487857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:42.487857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:21:42.487857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:21:42.487857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:21:42.487857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:21:42.489045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:21:42.489045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:21:42.489045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:21:42.489045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:21:42.489045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:42.489045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:42.489045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:42.489045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:42.489045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:42.489045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:42.489045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:42.489045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:21:42.489045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:42.489045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:42.489045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:42.489045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:42.490120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:42.490120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:42.490120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:42.490120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:42.490120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:21:42.490120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:21:42.490120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:21:42.490120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:21:42.490120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:21:42.490120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:21:42.490120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:21:42.490120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:42.490120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 578/1141] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:21:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:42.494809 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ec250-c9db-4f11-875a-d81a95a84753 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:42.583786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ec250-c9db-4f11-875a-d81a95a84753 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:42.616416 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db93b3-3048-424f-bc5c-97ec73216bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:42.617086 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db93b3-3048-424f-bc5c-97ec73216bdc None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:42.617361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db93b3-3048-424f-bc5c-97ec73216bdc None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:42.617628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db93b3-3048-424f-bc5c-97ec73216bdc None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:42.618356 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db93b3-3048-424f-bc5c-97ec73216bdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:42.618655 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db93b3-3048-424f-bc5c-97ec73216bdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:42.620010 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db93b3-3048-424f-bc5c-97ec73216bdc None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:42.627449 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 564/1142] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:21:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:42.633442 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a32f-1f34-40c9-851d-39f514656d70 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:42.732855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a32f-1f34-40c9-851d-39f514656d70 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:42.764019 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc38c6-63be-490f-a439-a296db52ecb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:42.764833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc38c6-63be-490f-a439-a296db52ecb0 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:42.765111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc38c6-63be-490f-a439-a296db52ecb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:42.765381 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc38c6-63be-490f-a439-a296db52ecb0 None admin] PATH_INFO: `/v3/users/d1077026544d437ba718e785b89ceb4d` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:42.778247 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc38c6-63be-490f-a439-a296db52ecb0 None admin] RBAC: Authorizing `identity:get_user(user_id=d1077026544d437ba718e785b89ceb4d)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:42.779697 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc38c6-63be-490f-a439-a296db52ecb0 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:42.781359 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 579/1143] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:21:42 2022] GET /identity/v3/users/d1077026544d437ba718e785b89ceb4d => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:42.787096 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db93b3-3048-424f-bc5c-97ec73216bdc None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:42.878492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db93b3-3048-424f-bc5c-97ec73216bdc None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:42.909577 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453245f4-4806-486d-8eb2-ef574b5bbba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:42.910200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453245f4-4806-486d-8eb2-ef574b5bbba1 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:42.910476 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453245f4-4806-486d-8eb2-ef574b5bbba1 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:42.910745 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453245f4-4806-486d-8eb2-ef574b5bbba1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:42.987755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453245f4-4806-486d-8eb2-ef574b5bbba1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:42.989224 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453245f4-4806-486d-8eb2-ef574b5bbba1 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:43.080493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 565/1144] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:21:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 06 23:21:43.086885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc38c6-63be-490f-a439-a296db52ecb0 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:43.181001 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc38c6-63be-490f-a439-a296db52ecb0 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:43.212693 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44bb64-d8fe-4fe0-a8f1-4d82f0c5a798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:43.213536 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44bb64-d8fe-4fe0-a8f1-4d82f0c5a798 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:43.213817 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44bb64-d8fe-4fe0-a8f1-4d82f0c5a798 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:43.214094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44bb64-d8fe-4fe0-a8f1-4d82f0c5a798 None admin] PATH_INFO: `/v3/projects/87ce32d2b1ce4be6a9f6f5702c3fd60e` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:43.215513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44bb64-d8fe-4fe0-a8f1-4d82f0c5a798 None admin] RBAC: Authorizing `identity:get_project(project_id=87ce32d2b1ce4be6a9f6f5702c3fd60e)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:43.216963 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44bb64-d8fe-4fe0-a8f1-4d82f0c5a798 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:43.218645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 580/1145] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:21:43 2022] GET /identity/v3/projects/87ce32d2b1ce4be6a9f6f5702c3fd60e => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:43.224596 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453245f4-4806-486d-8eb2-ef574b5bbba1 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:43.316276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453245f4-4806-486d-8eb2-ef574b5bbba1 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:43.349704 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0adbf8-4ab4-48cc-877d-2325ce637966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:43.350271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0adbf8-4ab4-48cc-877d-2325ce637966 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:43.350547 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0adbf8-4ab4-48cc-877d-2325ce637966 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:43.351394 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0adbf8-4ab4-48cc-877d-2325ce637966 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:43.352207 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0adbf8-4ab4-48cc-877d-2325ce637966 None admin] RBAC: Adding query filter params (role.id=408ee9a3a38640a48dbcdb2c377efcd8, scope.project.id=87ce32d2b1ce4be6a9f6f5702c3fd60e, user.id=d1077026544d437ba718e785b89ceb4d) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:43.352513 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0adbf8-4ab4-48cc-877d-2325ce637966 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:43.353961 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0adbf8-4ab4-48cc-877d-2325ce637966 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:43.359096 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 566/1146] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:21:43 2022] GET /identity/v3/role_assignments?user.id=d1077026544d437ba718e785b89ceb4d&scope.project.id=87ce32d2b1ce4be6a9f6f5702c3fd60e&role.id=408ee9a3a38640a48dbcdb2c377efcd8 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:45.513675 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b096764-0916-44f0-a03d-240da6352fc5 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:45.514239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b096764-0916-44f0-a03d-240da6352fc5 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:45.514239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b096764-0916-44f0-a03d-240da6352fc5 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:45.515581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 581/1147] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:45.520852 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab996b-f19e-4723-9e3b-e1ef85b02c15 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:45.521273 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab996b-f19e-4723-9e3b-e1ef85b02c15 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:45.521384 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab996b-f19e-4723-9e3b-e1ef85b02c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:45.537334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-22ab996b-f19e-4723-9e3b-e1ef85b02c15 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:45.538522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-22ab996b-f19e-4723-9e3b-e1ef85b02c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:45.599837 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 567/1148] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:21:45.622295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b096764-0916-44f0-a03d-240da6352fc5 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:45.717029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b096764-0916-44f0-a03d-240da6352fc5 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:45.749080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f1871-bae7-4ee1-b6d7-d11b0201c6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:45.749849 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f1871-bae7-4ee1-b6d7-d11b0201c6be None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:45.750131 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f1871-bae7-4ee1-b6d7-d11b0201c6be None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:45.750405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f1871-bae7-4ee1-b6d7-d11b0201c6be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:45.760024 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f1871-bae7-4ee1-b6d7-d11b0201c6be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:21:45.768252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-155f1871-bae7-4ee1-b6d7-d11b0201c6be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:21:45.768252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:45.768252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:45.768252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:45.768252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:45.768252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:45.768252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:45.768252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:45.768252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:45.768252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:45.768252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:45.768252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:45.768252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:21:45.768252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:21:45.768252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:21:45.768252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:21:45.769391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:21:45.769391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:21:45.769391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:21:45.769391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:21:45.769391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:45.769391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:45.769391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:45.769391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:45.769391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:45.769391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:45.769391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:45.769391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:21:45.769391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:45.769391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:45.769391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:45.769391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:45.770581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:45.770581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:45.770581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:45.770581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:45.770581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:21:45.770581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:21:45.770581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:21:45.770581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:21:45.770581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:21:45.770581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:21:45.770581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:21:45.770581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:45.770581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 582/1149] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:21:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:45.775476 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab996b-f19e-4723-9e3b-e1ef85b02c15 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:45.866861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab996b-f19e-4723-9e3b-e1ef85b02c15 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:45.897753 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d51ea5-d505-427c-88ed-148ee98c312e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:45.898409 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d51ea5-d505-427c-88ed-148ee98c312e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:45.898693 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d51ea5-d505-427c-88ed-148ee98c312e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:45.898969 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d51ea5-d505-427c-88ed-148ee98c312e None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:45.899711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d51ea5-d505-427c-88ed-148ee98c312e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:45.900018 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d51ea5-d505-427c-88ed-148ee98c312e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:45.901432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d51ea5-d505-427c-88ed-148ee98c312e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:45.909108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 568/1150] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:21:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:45.915452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f1871-bae7-4ee1-b6d7-d11b0201c6be None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:46.008184 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f1871-bae7-4ee1-b6d7-d11b0201c6be None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:46.039806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460110f-39fe-4d0a-8cc1-314499154ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:46.040620 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460110f-39fe-4d0a-8cc1-314499154ad4 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:46.040902 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460110f-39fe-4d0a-8cc1-314499154ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:46.041173 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460110f-39fe-4d0a-8cc1-314499154ad4 None admin] PATH_INFO: `/v3/users/d1077026544d437ba718e785b89ceb4d` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:46.042336 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460110f-39fe-4d0a-8cc1-314499154ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=d1077026544d437ba718e785b89ceb4d)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:46.043760 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460110f-39fe-4d0a-8cc1-314499154ad4 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:46.045394 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 583/1151] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:21:45 2022] GET /identity/v3/users/d1077026544d437ba718e785b89ceb4d => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:46.050805 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d51ea5-d505-427c-88ed-148ee98c312e None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:46.142588 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d51ea5-d505-427c-88ed-148ee98c312e None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:46.173686 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360ea3a-818d-4ab8-bf82-51188b4017df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:46.174506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360ea3a-818d-4ab8-bf82-51188b4017df None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:46.174782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360ea3a-818d-4ab8-bf82-51188b4017df None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:46.175048 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360ea3a-818d-4ab8-bf82-51188b4017df None admin] PATH_INFO: `/v3/projects/87ce32d2b1ce4be6a9f6f5702c3fd60e` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:46.176195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360ea3a-818d-4ab8-bf82-51188b4017df None admin] RBAC: Authorizing `identity:get_project(project_id=87ce32d2b1ce4be6a9f6f5702c3fd60e)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:46.177641 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360ea3a-818d-4ab8-bf82-51188b4017df None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:46.179293 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 569/1152] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:21:46 2022] GET /identity/v3/projects/87ce32d2b1ce4be6a9f6f5702c3fd60e => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:46.184936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460110f-39fe-4d0a-8cc1-314499154ad4 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:46.279317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460110f-39fe-4d0a-8cc1-314499154ad4 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:46.316880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb82e7-7257-43f8-bfc9-0198bdfe4836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:46.317684 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb82e7-7257-43f8-bfc9-0198bdfe4836 None admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:46.317964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb82e7-7257-43f8-bfc9-0198bdfe4836 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:46.318240 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb82e7-7257-43f8-bfc9-0198bdfe4836 None admin] PATH_INFO: `/v3/projects/87ce32d2b1ce4be6a9f6f5702c3fd60e/users/d1077026544d437ba718e785b89ceb4d/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:46.320236 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb82e7-7257-43f8-bfc9-0198bdfe4836 None admin] RBAC: Authorizing `identity:create_grant(project_id=87ce32d2b1ce4be6a9f6f5702c3fd60e, user_id=d1077026544d437ba718e785b89ceb4d, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:46.321705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb82e7-7257-43f8-bfc9-0198bdfe4836 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:46.334679 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 584/1153] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:21:46 2022] PUT /identity/v3/projects/87ce32d2b1ce4be6a9f6f5702c3fd60e/users/d1077026544d437ba718e785b89ceb4d/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:21:48.503456 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be611ff-5618-435b-8766-38546d8841e2 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:48.503991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be611ff-5618-435b-8766-38546d8841e2 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:48.503991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be611ff-5618-435b-8766-38546d8841e2 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:48.505414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 570/1154] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:48.511407 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b4758-5c31-48d7-8b05-8ce48bb899d9 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:48.511824 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b4758-5c31-48d7-8b05-8ce48bb899d9 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:48.511960 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b4758-5c31-48d7-8b05-8ce48bb899d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:48.528037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-826b4758-5c31-48d7-8b05-8ce48bb899d9 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:48.529246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-826b4758-5c31-48d7-8b05-8ce48bb899d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:48.591358 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 585/1155] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:21:48.613833 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be611ff-5618-435b-8766-38546d8841e2 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:48.707467 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be611ff-5618-435b-8766-38546d8841e2 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:48.738508 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feff737-6315-408f-916e-f1fc59bca4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:48.739268 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feff737-6315-408f-916e-f1fc59bca4d3 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:48.739546 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feff737-6315-408f-916e-f1fc59bca4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:48.739817 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feff737-6315-408f-916e-f1fc59bca4d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:48.749713 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feff737-6315-408f-916e-f1fc59bca4d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:21:48.757694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-4feff737-6315-408f-916e-f1fc59bca4d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:21:48.757694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:48.757694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:48.757694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:48.757694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:48.757694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:48.757694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:48.757694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:48.757694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:48.757694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:48.757694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:48.757694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:48.757694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:21:48.757694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:21:48.757694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:21:48.757694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:21:48.758768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:21:48.758768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:21:48.758768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:21:48.758768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:21:48.758768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:48.758768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:48.758768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:48.758768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:48.758768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:48.758768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:48.758768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:48.758768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:21:48.758768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:48.758768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:48.758768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:48.758768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:48.759807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:48.759807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:48.759807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:48.759807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:48.759807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:21:48.759807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:21:48.759807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:21:48.759807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:21:48.759807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:21:48.759807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:21:48.759807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:21:48.759807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:21:48.763488 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 571/1156] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:21:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:48.764527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b4758-5c31-48d7-8b05-8ce48bb899d9 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:48.856958 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b4758-5c31-48d7-8b05-8ce48bb899d9 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:48.888287 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e845b2-d3b1-4159-884d-36249c7f6e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:48.889033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e845b2-d3b1-4159-884d-36249c7f6e05 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:48.889307 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e845b2-d3b1-4159-884d-36249c7f6e05 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:48.889577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e845b2-d3b1-4159-884d-36249c7f6e05 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:48.890583 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e845b2-d3b1-4159-884d-36249c7f6e05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:48.890885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e845b2-d3b1-4159-884d-36249c7f6e05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:48.892471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e845b2-d3b1-4159-884d-36249c7f6e05 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:48.900903 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 586/1157] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:21:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:21:48.906562 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feff737-6315-408f-916e-f1fc59bca4d3 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:48.998797 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feff737-6315-408f-916e-f1fc59bca4d3 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:49.030117 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee6749-7d6f-49ca-95a0-ca93adef91a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:49.030961 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee6749-7d6f-49ca-95a0-ca93adef91a4 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:49.031244 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee6749-7d6f-49ca-95a0-ca93adef91a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:49.031522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee6749-7d6f-49ca-95a0-ca93adef91a4 None admin] PATH_INFO: `/v3/users/d1077026544d437ba718e785b89ceb4d` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:49.032720 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee6749-7d6f-49ca-95a0-ca93adef91a4 None admin] RBAC: Authorizing `identity:get_user(user_id=d1077026544d437ba718e785b89ceb4d)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:49.034144 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee6749-7d6f-49ca-95a0-ca93adef91a4 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:49.035724 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 572/1158] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:21:48 2022] GET /identity/v3/users/d1077026544d437ba718e785b89ceb4d => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:49.041465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e845b2-d3b1-4159-884d-36249c7f6e05 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:49.133389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e845b2-d3b1-4159-884d-36249c7f6e05 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:49.164649 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ec75b-6e5b-43db-87e8-511a5d8fad16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:49.165270 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ec75b-6e5b-43db-87e8-511a5d8fad16 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:49.165547 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ec75b-6e5b-43db-87e8-511a5d8fad16 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:49.165820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ec75b-6e5b-43db-87e8-511a5d8fad16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:49.227558 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ec75b-6e5b-43db-87e8-511a5d8fad16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:49.229024 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ec75b-6e5b-43db-87e8-511a5d8fad16 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:49.320733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 587/1159] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:21:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 06 23:21:49.326642 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee6749-7d6f-49ca-95a0-ca93adef91a4 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:49.419403 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee6749-7d6f-49ca-95a0-ca93adef91a4 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:49.450714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295e82c-4cbf-480a-878a-c7e472db764e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:49.451543 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e82c-4cbf-480a-878a-c7e472db764e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:49.451821 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e82c-4cbf-480a-878a-c7e472db764e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:49.452094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e82c-4cbf-480a-878a-c7e472db764e None admin] PATH_INFO: `/v3/projects/87ce32d2b1ce4be6a9f6f5702c3fd60e` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:49.453281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295e82c-4cbf-480a-878a-c7e472db764e None admin] RBAC: Authorizing `identity:get_project(project_id=87ce32d2b1ce4be6a9f6f5702c3fd60e)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:49.454706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295e82c-4cbf-480a-878a-c7e472db764e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:49.456356 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 573/1160] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:21:49 2022] GET /identity/v3/projects/87ce32d2b1ce4be6a9f6f5702c3fd60e => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:49.462273 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ec75b-6e5b-43db-87e8-511a5d8fad16 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:49.554784 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ec75b-6e5b-43db-87e8-511a5d8fad16 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:49.585418 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cd396-77db-4d1c-8df5-22c00eabcc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:49.585994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd396-77db-4d1c-8df5-22c00eabcc8a None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:49.586271 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd396-77db-4d1c-8df5-22c00eabcc8a None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:49.586540 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd396-77db-4d1c-8df5-22c00eabcc8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:49.587352 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cd396-77db-4d1c-8df5-22c00eabcc8a None admin] RBAC: Adding query filter params (role.id=408ee9a3a38640a48dbcdb2c377efcd8, scope.project.id=87ce32d2b1ce4be6a9f6f5702c3fd60e, user.id=d1077026544d437ba718e785b89ceb4d) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:49.587656 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cd396-77db-4d1c-8df5-22c00eabcc8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:49.589219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cd396-77db-4d1c-8df5-22c00eabcc8a None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:49.594951 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 588/1161] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:21:49 2022] GET /identity/v3/role_assignments?user.id=d1077026544d437ba718e785b89ceb4d&scope.project.id=87ce32d2b1ce4be6a9f6f5702c3fd60e&role.id=408ee9a3a38640a48dbcdb2c377efcd8 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:51.831258 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db4f12-3c0b-4258-8444-751e620e0526 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:51.831780 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db4f12-3c0b-4258-8444-751e620e0526 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:51.831872 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db4f12-3c0b-4258-8444-751e620e0526 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:51.833225 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 574/1162] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:51.838571 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c6729-57ce-4375-9b92-49f7ecb92dad None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:51.838984 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c6729-57ce-4375-9b92-49f7ecb92dad None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:51.839124 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c6729-57ce-4375-9b92-49f7ecb92dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:51.855953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-f29c6729-57ce-4375-9b92-49f7ecb92dad None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:51.857141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-f29c6729-57ce-4375-9b92-49f7ecb92dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:51.918324 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 589/1163] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:21:51.940278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db4f12-3c0b-4258-8444-751e620e0526 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:52.039716 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db4f12-3c0b-4258-8444-751e620e0526 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:52.070301 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3620fb1-5a98-49aa-9d76-7630bd4d765c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:52.070927 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3620fb1-5a98-49aa-9d76-7630bd4d765c None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:52.071203 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3620fb1-5a98-49aa-9d76-7630bd4d765c None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:52.071469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3620fb1-5a98-49aa-9d76-7630bd4d765c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:52.132489 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3620fb1-5a98-49aa-9d76-7630bd4d765c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:52.133908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3620fb1-5a98-49aa-9d76-7630bd4d765c None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:52.223630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 575/1164] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:21:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 06 23:21:52.230465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c6729-57ce-4375-9b92-49f7ecb92dad None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:52.324253 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c6729-57ce-4375-9b92-49f7ecb92dad None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:52.357088 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fa7b5-96e1-4f39-b5e6-e239b087a3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:52.357880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fa7b5-96e1-4f39-b5e6-e239b087a3d5 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:52.358160 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fa7b5-96e1-4f39-b5e6-e239b087a3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:52.358434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fa7b5-96e1-4f39-b5e6-e239b087a3d5 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:52.364873 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fa7b5-96e1-4f39-b5e6-e239b087a3d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:52.366353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fa7b5-96e1-4f39-b5e6-e239b087a3d5 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:52.379968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-973fa7b5-96e1-4f39-b5e6-e239b087a3d5 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 06 23:21:52.379968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:52.379968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 06 23:21:52.379968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 06 23:21:52.379968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:21:52.379968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:21:52.379968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:21:52.379968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:21:52.379968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 06 23:21:52.379968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:52.379968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:21:52.379968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:52.379968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:21:52.379968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:21:52.379968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:21:52.379968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:21:52.379968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:21:52.381182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:21:52.381182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:21:52.381182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:21:52.381182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:21:52.381182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:21:52.381182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:21:52.381182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:21:52.381182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:21:52.381182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:21:52.381182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:21:52.381182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:21:52.381182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:21:52.381182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:21:52.381182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:21:52.381182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:21:52.381182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:21:52.382800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:21:52.382800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:21:52.382800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:21:52.382800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:21:52.382800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:21:52.382800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:21:52.382800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:21:52.382800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:21:52.382800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:21:52.382800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:21:52.382800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 06 23:21:52.382800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:21:52.382800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 06 23:21:52.382800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:21:52.382800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 590/1165] 10.222.0.60 () {56 vars in 1117 bytes} [Fri May 6 23:21:52 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:21:52.387788 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3620fb1-5a98-49aa-9d76-7630bd4d765c None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:52.479084 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3620fb1-5a98-49aa-9d76-7630bd4d765c None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:52.510347 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcc12c-8ba3-42a1-b414-f45d4ed0bfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:52.510985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcc12c-8ba3-42a1-b414-f45d4ed0bfde None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:52.511264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcc12c-8ba3-42a1-b414-f45d4ed0bfde None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:52.511535 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcc12c-8ba3-42a1-b414-f45d4ed0bfde None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:52.512236 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcc12c-8ba3-42a1-b414-f45d4ed0bfde None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:21:52.512564 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcc12c-8ba3-42a1-b414-f45d4ed0bfde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:52.513925 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcc12c-8ba3-42a1-b414-f45d4ed0bfde None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:52.520769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 576/1166] 10.222.0.60 () {56 vars in 1115 bytes} [Fri May 6 23:21:52 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:54.711221 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52da51d-4fa4-4523-bd04-a6168d270981 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:54.711746 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52da51d-4fa4-4523-bd04-a6168d270981 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:54.711859 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52da51d-4fa4-4523-bd04-a6168d270981 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:54.713173 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 591/1167] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:54.718585 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1ea51-b6a7-47f5-af0c-a3bb876c2832 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:54.718980 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1ea51-b6a7-47f5-af0c-a3bb876c2832 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:54.719141 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1ea51-b6a7-47f5-af0c-a3bb876c2832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:54.735204 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-49d1ea51-b6a7-47f5-af0c-a3bb876c2832 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:54.736366 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-49d1ea51-b6a7-47f5-af0c-a3bb876c2832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:54.798042 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 577/1168] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:21:54.820442 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52da51d-4fa4-4523-bd04-a6168d270981 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:54.917191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52da51d-4fa4-4523-bd04-a6168d270981 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:54.948697 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d2008-be2c-4029-a9ed-f1331f498f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:54.949342 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d2008-be2c-4029-a9ed-f1331f498f5b None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:54.949620 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d2008-be2c-4029-a9ed-f1331f498f5b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:54.949892 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d2008-be2c-4029-a9ed-f1331f498f5b None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:54.950620 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d2008-be2c-4029-a9ed-f1331f498f5b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:54.951982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d2008-be2c-4029-a9ed-f1331f498f5b None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:54.966290 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 592/1169] 10.222.0.60 () {60 vars in 1138 bytes} [Fri May 6 23:21:54 2022] POST /identity/v3/domains => generated 267 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:21:57.187814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f72fb-36bd-47b9-872b-06eca572004f None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:57.188361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f72fb-36bd-47b9-872b-06eca572004f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:57.188361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f72fb-36bd-47b9-872b-06eca572004f None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:57.189685 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 578/1170] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:57.194794 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14eee4a-b095-4e77-a796-40347a24281d None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:57.195236 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14eee4a-b095-4e77-a796-40347a24281d None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:57.195337 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14eee4a-b095-4e77-a796-40347a24281d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:57.211269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-d14eee4a-b095-4e77-a796-40347a24281d None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:57.212418 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d14eee4a-b095-4e77-a796-40347a24281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:57.278163 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 593/1171] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:21:57.301382 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f72fb-36bd-47b9-872b-06eca572004f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:57.394237 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f72fb-36bd-47b9-872b-06eca572004f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:57.426070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bea94-06fd-4047-bda1-1bffa89ea740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:57.426905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bea94-06fd-4047-bda1-1bffa89ea740 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:57.427184 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bea94-06fd-4047-bda1-1bffa89ea740 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:57.427455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bea94-06fd-4047-bda1-1bffa89ea740 None admin] PATH_INFO: `/v3/domains/46e9edb6deb242b8b97d68985191c8c4` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:57.437180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bea94-06fd-4047-bda1-1bffa89ea740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=46e9edb6deb242b8b97d68985191c8c4)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:57.438663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bea94-06fd-4047-bda1-1bffa89ea740 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:57.440217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 579/1172] 10.222.0.60 () {56 vars in 1183 bytes} [Fri May 6 23:21:57 2022] GET /identity/v3/domains/46e9edb6deb242b8b97d68985191c8c4 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:21:57.445957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14eee4a-b095-4e77-a796-40347a24281d None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:21:57.540339 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14eee4a-b095-4e77-a796-40347a24281d None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:21:57.571248 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a4125-e101-4cc7-8916-6b862d993cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:21:57.571890 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a4125-e101-4cc7-8916-6b862d993cc5 None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:57.572167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a4125-e101-4cc7-8916-6b862d993cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:57.572436 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a4125-e101-4cc7-8916-6b862d993cc5 None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:57.573165 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a4125-e101-4cc7-8916-6b862d993cc5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:21:57.574572 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a4125-e101-4cc7-8916-6b862d993cc5 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:21:57.599639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 594/1173] 10.222.0.60 () {60 vars in 1141 bytes} [Fri May 6 23:21:57 2022] POST /identity/v3/projects => generated 361 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:21:59.838808 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e55f9-fb2a-4e08-99cc-9c04433fbf8f None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:59.839373 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e55f9-fb2a-4e08-99cc-9c04433fbf8f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:59.839373 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e55f9-fb2a-4e08-99cc-9c04433fbf8f None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:59.841012 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 580/1174] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:21:59.846283 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b029a-6957-4f0a-89b7-75667db70d18 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:21:59.846669 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b029a-6957-4f0a-89b7-75667db70d18 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:21:59.846834 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b029a-6957-4f0a-89b7-75667db70d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:21:59.863455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-4b3b029a-6957-4f0a-89b7-75667db70d18 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:21:59.864696 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-4b3b029a-6957-4f0a-89b7-75667db70d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:21:59.925862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 595/1175] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:21:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:21:59.949756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e55f9-fb2a-4e08-99cc-9c04433fbf8f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:22:00.047953 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e55f9-fb2a-4e08-99cc-9c04433fbf8f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:22:00.078512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba7d17-6b90-4c5f-b9e7-f508c500a09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:22:00.079346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba7d17-6b90-4c5f-b9e7-f508c500a09f None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:00.079622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba7d17-6b90-4c5f-b9e7-f508c500a09f None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:00.079891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba7d17-6b90-4c5f-b9e7-f508c500a09f None admin] PATH_INFO: `/v3/domains/46e9edb6deb242b8b97d68985191c8c4` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:00.081105 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba7d17-6b90-4c5f-b9e7-f508c500a09f None admin] RBAC: Authorizing `identity:get_domain(domain_id=46e9edb6deb242b8b97d68985191c8c4)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:22:00.082520 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba7d17-6b90-4c5f-b9e7-f508c500a09f None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:22:00.084097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 581/1176] 10.222.0.60 () {56 vars in 1183 bytes} [Fri May 6 23:21:59 2022] GET /identity/v3/domains/46e9edb6deb242b8b97d68985191c8c4 => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:22:00.090656 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b029a-6957-4f0a-89b7-75667db70d18 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:22:00.181144 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b029a-6957-4f0a-89b7-75667db70d18 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:22:00.213115 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c08424-70ff-447a-bcad-3d07087cbaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:22:00.213761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c08424-70ff-447a-bcad-3d07087cbaf3 None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:00.214043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c08424-70ff-447a-bcad-3d07087cbaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:00.214317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c08424-70ff-447a-bcad-3d07087cbaf3 None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:00.215280 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c08424-70ff-447a-bcad-3d07087cbaf3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:22:00.216720 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c08424-70ff-447a-bcad-3d07087cbaf3 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:22:00.236036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 596/1177] 10.222.0.60 () {60 vars in 1132 bytes} [Fri May 6 23:22:00 2022] POST /identity/v3/users => generated 311 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:22:02.485537 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62f2b9-4400-4412-b15b-724d80306b78 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:02.486086 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62f2b9-4400-4412-b15b-724d80306b78 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:02.486086 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62f2b9-4400-4412-b15b-724d80306b78 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:02.487558 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 582/1178] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:22:02.493299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4eafe2-e567-4693-bdd4-fc9d50328c0f None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:02.493721 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4eafe2-e567-4693-bdd4-fc9d50328c0f None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:02.493854 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4eafe2-e567-4693-bdd4-fc9d50328c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:02.510558 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-0e4eafe2-e567-4693-bdd4-fc9d50328c0f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:22:02.511725 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-0e4eafe2-e567-4693-bdd4-fc9d50328c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:22:02.574088 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 597/1179] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:22:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:22:02.596679 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62f2b9-4400-4412-b15b-724d80306b78 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:22:02.690173 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62f2b9-4400-4412-b15b-724d80306b78 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:22:02.721352 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a489b-61c2-4066-be6d-e805199f2774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:22:02.722115 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a489b-61c2-4066-be6d-e805199f2774 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:02.722396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a489b-61c2-4066-be6d-e805199f2774 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:02.722665 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a489b-61c2-4066-be6d-e805199f2774 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:02.733233 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a489b-61c2-4066-be6d-e805199f2774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:22:02.741215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-029a489b-61c2-4066-be6d-e805199f2774 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:22:02.741215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:22:02.741215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:22:02.741215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:22:02.741215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:22:02.741215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:22:02.741215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:22:02.741215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:22:02.741215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:22:02.741215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:22:02.741215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:22:02.741215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:22:02.741215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:22:02.741215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:22:02.741215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:22:02.741215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:22:02.742402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:22:02.742402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:22:02.742402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:22:02.742402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:22:02.742402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:22:02.742402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:22:02.742402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:22:02.742402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:22:02.742402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:22:02.742402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:22:02.742402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:22:02.742402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:22:02.742402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:22:02.742402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:22:02.742402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:22:02.742402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:22:02.743319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:22:02.743319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:22:02.743319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:22:02.743319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:22:02.743319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:22:02.743319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:22:02.743319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:22:02.743319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:22:02.743319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:22:02.743319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:22:02.743319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:22:02.743319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:22:02.743319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 583/1180] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:22:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:22:02.748186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4eafe2-e567-4693-bdd4-fc9d50328c0f None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:22:02.839596 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4eafe2-e567-4693-bdd4-fc9d50328c0f None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:22:02.872006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000b23b-9feb-4cad-8dab-083fcbe6ce8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:22:02.872701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000b23b-9feb-4cad-8dab-083fcbe6ce8d None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:02.872982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000b23b-9feb-4cad-8dab-083fcbe6ce8d None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:02.873253 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000b23b-9feb-4cad-8dab-083fcbe6ce8d None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:02.873992 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000b23b-9feb-4cad-8dab-083fcbe6ce8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:22:02.874291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000b23b-9feb-4cad-8dab-083fcbe6ce8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:22:02.875661 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000b23b-9feb-4cad-8dab-083fcbe6ce8d None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:22:02.883259 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 598/1181] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:22:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:22:02.888884 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a489b-61c2-4066-be6d-e805199f2774 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:22:02.980649 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a489b-61c2-4066-be6d-e805199f2774 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:22:03.011901 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4c8cd-304a-4e2a-b717-e007800cf693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:22:03.012715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4c8cd-304a-4e2a-b717-e007800cf693 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:03.012996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4c8cd-304a-4e2a-b717-e007800cf693 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:03.013266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4c8cd-304a-4e2a-b717-e007800cf693 None admin] PATH_INFO: `/v3/users/58abecc413cd4dc5ad3ba1687f0d9e73` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:03.025355 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4c8cd-304a-4e2a-b717-e007800cf693 None admin] RBAC: Authorizing `identity:get_user(user_id=58abecc413cd4dc5ad3ba1687f0d9e73)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:22:03.026801 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4c8cd-304a-4e2a-b717-e007800cf693 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:22:03.028388 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 584/1182] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:22:02 2022] GET /identity/v3/users/58abecc413cd4dc5ad3ba1687f0d9e73 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:22:03.033913 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000b23b-9feb-4cad-8dab-083fcbe6ce8d None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:22:03.126421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000b23b-9feb-4cad-8dab-083fcbe6ce8d None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:22:03.157185 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8bfa8-f065-4d1c-874b-7731a2b874a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:22:03.157812 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8bfa8-f065-4d1c-874b-7731a2b874a1 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:03.158091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8bfa8-f065-4d1c-874b-7731a2b874a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:03.158364 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8bfa8-f065-4d1c-874b-7731a2b874a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:03.220324 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8bfa8-f065-4d1c-874b-7731a2b874a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:22:03.221772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8bfa8-f065-4d1c-874b-7731a2b874a1 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:22:03.312177 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 599/1183] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:22:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 06 23:22:03.317901 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4c8cd-304a-4e2a-b717-e007800cf693 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:22:03.409732 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4c8cd-304a-4e2a-b717-e007800cf693 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:22:03.440909 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4c1f6-6ed3-428c-b91b-4a19fc8d9064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:22:03.441735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4c1f6-6ed3-428c-b91b-4a19fc8d9064 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:03.442014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4c1f6-6ed3-428c-b91b-4a19fc8d9064 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:03.442284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4c1f6-6ed3-428c-b91b-4a19fc8d9064 None admin] PATH_INFO: `/v3/projects/3d73e83878cf4e12be00684309f49c7f` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:03.443431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4c1f6-6ed3-428c-b91b-4a19fc8d9064 None admin] RBAC: Authorizing `identity:get_project(project_id=3d73e83878cf4e12be00684309f49c7f)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:22:03.444905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4c1f6-6ed3-428c-b91b-4a19fc8d9064 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:22:03.446538 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 585/1184] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:22:03 2022] GET /identity/v3/projects/3d73e83878cf4e12be00684309f49c7f => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:22:03.452328 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8bfa8-f065-4d1c-874b-7731a2b874a1 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:22:03.546116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8bfa8-f065-4d1c-874b-7731a2b874a1 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:22:03.576910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdde39-5d92-49fc-9ab2-9ee89f4fdab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:22:03.577489 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdde39-5d92-49fc-9ab2-9ee89f4fdab0 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:03.577764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdde39-5d92-49fc-9ab2-9ee89f4fdab0 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:03.578036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdde39-5d92-49fc-9ab2-9ee89f4fdab0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:03.578841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdde39-5d92-49fc-9ab2-9ee89f4fdab0 None admin] RBAC: Adding query filter params (role.id=408ee9a3a38640a48dbcdb2c377efcd8, scope.project.id=3d73e83878cf4e12be00684309f49c7f, user.id=58abecc413cd4dc5ad3ba1687f0d9e73) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:22:03.579145 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdde39-5d92-49fc-9ab2-9ee89f4fdab0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:22:03.580572 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdde39-5d92-49fc-9ab2-9ee89f4fdab0 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:22:03.586144 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 600/1185] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:22:03 2022] GET /identity/v3/role_assignments?user.id=58abecc413cd4dc5ad3ba1687f0d9e73&scope.project.id=3d73e83878cf4e12be00684309f49c7f&role.id=408ee9a3a38640a48dbcdb2c377efcd8 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:22:05.780143 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093e228-866b-426f-a14d-a2bbc50a5f15 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:05.780690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093e228-866b-426f-a14d-a2bbc50a5f15 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:05.780781 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093e228-866b-426f-a14d-a2bbc50a5f15 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:05.782086 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 586/1186] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:22:05.787234 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec37f5-dc39-4521-9867-43a1bde4ea96 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:05.788233 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec37f5-dc39-4521-9867-43a1bde4ea96 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:05.788338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec37f5-dc39-4521-9867-43a1bde4ea96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:05.804333 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-b0ec37f5-dc39-4521-9867-43a1bde4ea96 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:22:05.805513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b0ec37f5-dc39-4521-9867-43a1bde4ea96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:22:05.876072 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 601/1187] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:22:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:22:05.898998 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093e228-866b-426f-a14d-a2bbc50a5f15 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:22:05.991601 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093e228-866b-426f-a14d-a2bbc50a5f15 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:22:06.022402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb27853-8daa-487b-8b37-f6c26f58cdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:22:06.023159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb27853-8daa-487b-8b37-f6c26f58cdf1 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:06.023434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb27853-8daa-487b-8b37-f6c26f58cdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:06.023701 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb27853-8daa-487b-8b37-f6c26f58cdf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:06.033044 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb27853-8daa-487b-8b37-f6c26f58cdf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:22:06.040913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-fdb27853-8daa-487b-8b37-f6c26f58cdf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:22:06.040913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:22:06.040913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:22:06.040913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:22:06.040913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:22:06.040913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:22:06.040913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:22:06.040913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:22:06.040913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:22:06.040913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:22:06.040913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:22:06.040913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:22:06.040913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:22:06.040913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:22:06.040913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:22:06.040913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:22:06.042001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:22:06.042001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:22:06.042001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:22:06.042001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:22:06.042001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:22:06.042001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:22:06.042001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:22:06.042001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:22:06.042001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:22:06.042001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:22:06.042001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:22:06.042001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:22:06.042001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:22:06.042001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:22:06.042001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:22:06.042001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:22:06.042938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:22:06.042938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:22:06.042938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:22:06.042938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:22:06.042938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:22:06.042938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:22:06.042938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:22:06.042938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:22:06.042938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:22:06.042938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:22:06.042938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:22:06.042938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:22:06.042938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 587/1188] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:22:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:22:06.047804 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec37f5-dc39-4521-9867-43a1bde4ea96 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:22:06.142096 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec37f5-dc39-4521-9867-43a1bde4ea96 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:22:06.181395 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80885b-938a-4f98-ad5d-a635e9682ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:22:06.182054 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80885b-938a-4f98-ad5d-a635e9682ada None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:06.182334 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80885b-938a-4f98-ad5d-a635e9682ada None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:06.182607 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80885b-938a-4f98-ad5d-a635e9682ada None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:06.183347 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80885b-938a-4f98-ad5d-a635e9682ada None admin] RBAC: Adding query filter params (name=admin) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:22:06.183652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80885b-938a-4f98-ad5d-a635e9682ada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:22:06.185038 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80885b-938a-4f98-ad5d-a635e9682ada None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:22:06.192645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 602/1189] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:22:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:22:06.198650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb27853-8daa-487b-8b37-f6c26f58cdf1 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:22:06.292599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb27853-8daa-487b-8b37-f6c26f58cdf1 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:22:06.323428 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94001616-c263-497a-bd94-4291b508df33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:22:06.324269 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94001616-c263-497a-bd94-4291b508df33 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:06.324570 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94001616-c263-497a-bd94-4291b508df33 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:06.324848 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94001616-c263-497a-bd94-4291b508df33 None admin] PATH_INFO: `/v3/users/58abecc413cd4dc5ad3ba1687f0d9e73` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:06.326010 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94001616-c263-497a-bd94-4291b508df33 None admin] RBAC: Authorizing `identity:get_user(user_id=58abecc413cd4dc5ad3ba1687f0d9e73)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:22:06.327439 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94001616-c263-497a-bd94-4291b508df33 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:22:06.329139 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 588/1190] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:22:06 2022] GET /identity/v3/users/58abecc413cd4dc5ad3ba1687f0d9e73 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:22:06.335086 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80885b-938a-4f98-ad5d-a635e9682ada None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:22:06.427168 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80885b-938a-4f98-ad5d-a635e9682ada None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:22:06.467756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16534bd2-abab-4314-98f1-379696a17d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:22:06.468623 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16534bd2-abab-4314-98f1-379696a17d79 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:06.468905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16534bd2-abab-4314-98f1-379696a17d79 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:06.469175 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16534bd2-abab-4314-98f1-379696a17d79 None admin] PATH_INFO: `/v3/projects/3d73e83878cf4e12be00684309f49c7f` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:06.470324 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16534bd2-abab-4314-98f1-379696a17d79 None admin] RBAC: Authorizing `identity:get_project(project_id=3d73e83878cf4e12be00684309f49c7f)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:22:06.471732 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16534bd2-abab-4314-98f1-379696a17d79 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:22:06.473428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 603/1191] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:22:06 2022] GET /identity/v3/projects/3d73e83878cf4e12be00684309f49c7f => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:22:06.479863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94001616-c263-497a-bd94-4291b508df33 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:22:06.570704 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94001616-c263-497a-bd94-4291b508df33 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:22:06.603777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c6fe2-0a40-49c7-b30f-7fcd9dfa290e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:22:06.604672 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c6fe2-0a40-49c7-b30f-7fcd9dfa290e None admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:06.604956 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c6fe2-0a40-49c7-b30f-7fcd9dfa290e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:06.605233 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c6fe2-0a40-49c7-b30f-7fcd9dfa290e None admin] PATH_INFO: `/v3/projects/3d73e83878cf4e12be00684309f49c7f/users/58abecc413cd4dc5ad3ba1687f0d9e73/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:06.607166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c6fe2-0a40-49c7-b30f-7fcd9dfa290e None admin] RBAC: Authorizing `identity:create_grant(project_id=3d73e83878cf4e12be00684309f49c7f, user_id=58abecc413cd4dc5ad3ba1687f0d9e73, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:22:06.608627 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c6fe2-0a40-49c7-b30f-7fcd9dfa290e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:22:06.621704 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 589/1192] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:22:06 2022] PUT /identity/v3/projects/3d73e83878cf4e12be00684309f49c7f/users/58abecc413cd4dc5ad3ba1687f0d9e73/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:22:08.781870 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6ab43-5090-48e2-a17c-c5c68aea83dc None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:08.782397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6ab43-5090-48e2-a17c-c5c68aea83dc None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:08.782397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6ab43-5090-48e2-a17c-c5c68aea83dc None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:08.783773 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 604/1193] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:22:08.788956 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53caadac-c80d-45d3-9f2b-4af7d331060c None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:08.789364 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53caadac-c80d-45d3-9f2b-4af7d331060c None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:08.789516 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53caadac-c80d-45d3-9f2b-4af7d331060c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:08.806754 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-53caadac-c80d-45d3-9f2b-4af7d331060c None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:22:08.807915 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-53caadac-c80d-45d3-9f2b-4af7d331060c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:22:08.871000 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 590/1194] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:22:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:22:08.893742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6ab43-5090-48e2-a17c-c5c68aea83dc None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:22:08.987337 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6ab43-5090-48e2-a17c-c5c68aea83dc None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:22:09.018214 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65d10e-cad1-405c-80f2-daf6da0406e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:22:09.018974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65d10e-cad1-405c-80f2-daf6da0406e4 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:09.019251 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65d10e-cad1-405c-80f2-daf6da0406e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:09.019522 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65d10e-cad1-405c-80f2-daf6da0406e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:09.028925 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65d10e-cad1-405c-80f2-daf6da0406e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:22:09.036397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-7f65d10e-cad1-405c-80f2-daf6da0406e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:22:09.036397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:22:09.036397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:22:09.036397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:22:09.036397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:22:09.036397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:22:09.036397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:22:09.036397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:22:09.036397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:22:09.036397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:22:09.036397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:22:09.036397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:22:09.036397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:22:09.036397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:22:09.036397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:22:09.036397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:22:09.038008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:22:09.038008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:22:09.038008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:22:09.038008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:22:09.038008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:22:09.038008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:22:09.038008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:22:09.038008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:22:09.038008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:22:09.038008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:22:09.038008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:22:09.038008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:22:09.038008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:22:09.038008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:22:09.038008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:22:09.038008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:22:09.039053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:22:09.039053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:22:09.039053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:22:09.039053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:22:09.039053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:22:09.039053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:22:09.039053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:22:09.039053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:22:09.039053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:22:09.039053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:22:09.039053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:22:09.039053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:22:09.039053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 605/1195] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:22:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:22:09.045680 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53caadac-c80d-45d3-9f2b-4af7d331060c None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:22:09.135703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53caadac-c80d-45d3-9f2b-4af7d331060c None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:22:09.166790 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355fa66-ddcf-4a42-83e5-c6a12176e964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:22:09.167428 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355fa66-ddcf-4a42-83e5-c6a12176e964 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:09.167708 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355fa66-ddcf-4a42-83e5-c6a12176e964 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:09.167980 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355fa66-ddcf-4a42-83e5-c6a12176e964 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:09.168735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355fa66-ddcf-4a42-83e5-c6a12176e964 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:22:09.169039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355fa66-ddcf-4a42-83e5-c6a12176e964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:22:09.170415 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355fa66-ddcf-4a42-83e5-c6a12176e964 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:22:09.177935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 591/1196] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:22:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:22:09.183388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65d10e-cad1-405c-80f2-daf6da0406e4 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:22:09.277079 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65d10e-cad1-405c-80f2-daf6da0406e4 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:22:09.308427 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42c2f0-0a6f-40b1-9d56-a01eaab79852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:22:09.309248 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42c2f0-0a6f-40b1-9d56-a01eaab79852 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:09.309523 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42c2f0-0a6f-40b1-9d56-a01eaab79852 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:09.309792 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42c2f0-0a6f-40b1-9d56-a01eaab79852 None admin] PATH_INFO: `/v3/users/58abecc413cd4dc5ad3ba1687f0d9e73` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:09.310961 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42c2f0-0a6f-40b1-9d56-a01eaab79852 None admin] RBAC: Authorizing `identity:get_user(user_id=58abecc413cd4dc5ad3ba1687f0d9e73)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:22:09.312379 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42c2f0-0a6f-40b1-9d56-a01eaab79852 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:22:09.314031 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 606/1197] 10.222.0.60 () {56 vars in 1177 bytes} [Fri May 6 23:22:09 2022] GET /identity/v3/users/58abecc413cd4dc5ad3ba1687f0d9e73 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:22:09.319485 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355fa66-ddcf-4a42-83e5-c6a12176e964 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:22:09.412171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355fa66-ddcf-4a42-83e5-c6a12176e964 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:22:09.443249 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494eee64-9728-436f-a5a8-7652254be227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:22:09.444441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eee64-9728-436f-a5a8-7652254be227 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:09.444746 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eee64-9728-436f-a5a8-7652254be227 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:09.445014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eee64-9728-436f-a5a8-7652254be227 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:09.506363 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494eee64-9728-436f-a5a8-7652254be227 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:22:09.507791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494eee64-9728-436f-a5a8-7652254be227 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:22:09.599717 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 592/1198] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:22:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 06 23:22:09.605928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42c2f0-0a6f-40b1-9d56-a01eaab79852 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:22:09.698565 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42c2f0-0a6f-40b1-9d56-a01eaab79852 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:22:09.729841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dbac2-5c11-4c4d-ac47-152360df9e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:22:09.730673 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dbac2-5c11-4c4d-ac47-152360df9e5a None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:09.730952 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dbac2-5c11-4c4d-ac47-152360df9e5a None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:09.731223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dbac2-5c11-4c4d-ac47-152360df9e5a None admin] PATH_INFO: `/v3/projects/3d73e83878cf4e12be00684309f49c7f` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:09.732378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dbac2-5c11-4c4d-ac47-152360df9e5a None admin] RBAC: Authorizing `identity:get_project(project_id=3d73e83878cf4e12be00684309f49c7f)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:22:09.733836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dbac2-5c11-4c4d-ac47-152360df9e5a None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:22:09.735497 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 607/1199] 10.222.0.60 () {56 vars in 1186 bytes} [Fri May 6 23:22:09 2022] GET /identity/v3/projects/3d73e83878cf4e12be00684309f49c7f => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:22:09.741524 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494eee64-9728-436f-a5a8-7652254be227 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:22:09.833487 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494eee64-9728-436f-a5a8-7652254be227 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:22:09.866033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d88fa9-d3dd-4921-9e1b-187b0b220be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:22:09.866620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d88fa9-d3dd-4921-9e1b-187b0b220be4 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:22:09.866901 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d88fa9-d3dd-4921-9e1b-187b0b220be4 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:22:09.867178 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d88fa9-d3dd-4921-9e1b-187b0b220be4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:22:09.867995 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d88fa9-d3dd-4921-9e1b-187b0b220be4 None admin] RBAC: Adding query filter params (role.id=408ee9a3a38640a48dbcdb2c377efcd8, scope.project.id=3d73e83878cf4e12be00684309f49c7f, user.id=58abecc413cd4dc5ad3ba1687f0d9e73) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:22:09.868305 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d88fa9-d3dd-4921-9e1b-187b0b220be4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:22:09.869767 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d88fa9-d3dd-4921-9e1b-187b0b220be4 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:22:09.875263 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 593/1200] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:22:09 2022] GET /identity/v3/role_assignments?user.id=58abecc413cd4dc5ad3ba1687f0d9e73&scope.project.id=3d73e83878cf4e12be00684309f49c7f&role.id=408ee9a3a38640a48dbcdb2c377efcd8 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:10.003807 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aac99-0eb2-40e6-bd08-fe0269aad473 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:10.004486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aac99-0eb2-40e6-bd08-fe0269aad473 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:10.004486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aac99-0eb2-40e6-bd08-fe0269aad473 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:10.006043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 608/1201] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:23:10.011531 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317f0d0-c969-415d-a7e9-581ee17a531e None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:10.012051 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317f0d0-c969-415d-a7e9-581ee17a531e None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:10.012151 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317f0d0-c969-415d-a7e9-581ee17a531e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:10.029977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-5317f0d0-c969-415d-a7e9-581ee17a531e None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:23:10.031464 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-5317f0d0-c969-415d-a7e9-581ee17a531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:23:10.115618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 594/1202] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:23:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:23:10.140589 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51aac99-0eb2-40e6-bd08-fe0269aad473 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:10.266383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51aac99-0eb2-40e6-bd08-fe0269aad473 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:10.313701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b992467-4e71-46c5-b439-752c27d4aab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:10.314945 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b992467-4e71-46c5-b439-752c27d4aab9 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:10.315268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b992467-4e71-46c5-b439-752c27d4aab9 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:10.315601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b992467-4e71-46c5-b439-752c27d4aab9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:10.330887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b992467-4e71-46c5-b439-752c27d4aab9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:10.333711 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b992467-4e71-46c5-b439-752c27d4aab9 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:10.355974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-2b992467-4e71-46c5-b439-752c27d4aab9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:10.355974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:10.355974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:10.355974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:10.355974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:10.355974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:10.355974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:10.355974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:10.355974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:10.355974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:10.355974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:10.355974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:10.355974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:23:10.355974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:23:10.355974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:23:10.357574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:23:10.357574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:10.357574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:10.357574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:10.357574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:10.357574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:10.357574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:10.357574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:10.357574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:23:10.357574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:10.357574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:10.357574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:10.357574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:10.357574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:10.357574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:10.357574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:10.357574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:10.359010 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:23:10.359010 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:23:10.359010 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:10.359010 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:23:10.362419 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 609/1203] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:10.370891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317f0d0-c969-415d-a7e9-581ee17a531e None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:10.494159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317f0d0-c969-415d-a7e9-581ee17a531e None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:10.542444 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2adca4-05aa-4a25-a9db-0eab5d2da436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:10.543231 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2adca4-05aa-4a25-a9db-0eab5d2da436 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:10.543548 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2adca4-05aa-4a25-a9db-0eab5d2da436 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:10.543851 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2adca4-05aa-4a25-a9db-0eab5d2da436 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:10.544693 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2adca4-05aa-4a25-a9db-0eab5d2da436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:10.545028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2adca4-05aa-4a25-a9db-0eab5d2da436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:10.546573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2adca4-05aa-4a25-a9db-0eab5d2da436 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:10.560591 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 595/1204] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:23:10.565622 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b992467-4e71-46c5-b439-752c27d4aab9 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:10.691324 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b992467-4e71-46c5-b439-752c27d4aab9 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:10.731212 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1cb36-03d6-4330-8417-7517cc12e6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:10.732061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1cb36-03d6-4330-8417-7517cc12e6a0 None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:10.732453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1cb36-03d6-4330-8417-7517cc12e6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:10.732806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1cb36-03d6-4330-8417-7517cc12e6a0 None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:10.733777 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1cb36-03d6-4330-8417-7517cc12e6a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:10.735467 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1cb36-03d6-4330-8417-7517cc12e6a0 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:10.764575 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 610/1205] 10.222.0.60 () {60 vars in 1132 bytes} [Fri May 6 23:23:10 2022] POST /identity/v3/users => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:23:13.232577 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a5f7b-527f-459f-81e0-dab1be3d08ff None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:13.233110 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a5f7b-527f-459f-81e0-dab1be3d08ff None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:13.233110 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a5f7b-527f-459f-81e0-dab1be3d08ff None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:13.234736 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 596/1206] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:23:13.241041 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d445abd-612f-4caf-b4c5-a397c60595d6 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:13.241660 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d445abd-612f-4caf-b4c5-a397c60595d6 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:13.241660 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d445abd-612f-4caf-b4c5-a397c60595d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:13.259336 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-5d445abd-612f-4caf-b4c5-a397c60595d6 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:23:13.260615 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-5d445abd-612f-4caf-b4c5-a397c60595d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:23:13.334897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 611/1207] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:23:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 06 23:23:13.360029 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a5f7b-527f-459f-81e0-dab1be3d08ff None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:13.480037 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a5f7b-527f-459f-81e0-dab1be3d08ff None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:13.513091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc6078-84ae-4ae1-a99d-8a723fa97d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:13.513816 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc6078-84ae-4ae1-a99d-8a723fa97d7f None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:13.514096 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc6078-84ae-4ae1-a99d-8a723fa97d7f None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:13.514370 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc6078-84ae-4ae1-a99d-8a723fa97d7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:13.524994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc6078-84ae-4ae1-a99d-8a723fa97d7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:23:13.532621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-d6cc6078-84ae-4ae1-a99d-8a723fa97d7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:23:13.532621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:13.532621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:13.532621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:13.532621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:13.532621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:13.532621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:13.532621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:13.532621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:13.532621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:13.532621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:13.532621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:13.532621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:23:13.532621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:23:13.532621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:23:13.532621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:23:13.533696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:23:13.533696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:23:13.533696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:23:13.533696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:23:13.533696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:13.533696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:13.533696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:13.533696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:13.533696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:13.533696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:13.533696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:13.533696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:23:13.533696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:13.533696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:13.533696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:13.533696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:13.534542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:13.534542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:13.534542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:13.534542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:13.534542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:23:13.534542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:23:13.534542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:23:13.534542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:23:13.534542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:23:13.534542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:23:13.534542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:23:13.534542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:13.534542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 597/1208] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:23:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:13.540603 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d445abd-612f-4caf-b4c5-a397c60595d6 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:13.651511 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d445abd-612f-4caf-b4c5-a397c60595d6 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:13.697949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2949a-ee7a-44fa-8556-57720ac9bfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:13.698877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2949a-ee7a-44fa-8556-57720ac9bfa5 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:13.699293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2949a-ee7a-44fa-8556-57720ac9bfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:13.699618 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2949a-ee7a-44fa-8556-57720ac9bfa5 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:13.700468 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2949a-ee7a-44fa-8556-57720ac9bfa5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:13.700802 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2949a-ee7a-44fa-8556-57720ac9bfa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:13.702165 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2949a-ee7a-44fa-8556-57720ac9bfa5 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:13.717727 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 612/1209] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:23:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:13.718920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc6078-84ae-4ae1-a99d-8a723fa97d7f None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:13.831982 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc6078-84ae-4ae1-a99d-8a723fa97d7f None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:13.871581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f327e-5354-47d9-a26a-cbe4b37f5043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:13.872428 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f327e-5354-47d9-a26a-cbe4b37f5043 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:13.872749 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f327e-5354-47d9-a26a-cbe4b37f5043 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:13.873030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f327e-5354-47d9-a26a-cbe4b37f5043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:13.886143 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f327e-5354-47d9-a26a-cbe4b37f5043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:13.887787 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f327e-5354-47d9-a26a-cbe4b37f5043 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:13.911603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-be4f327e-5354-47d9-a26a-cbe4b37f5043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:13.911603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:13.911603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:13.911603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:13.911603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:13.911603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:13.911603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:13.911603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:13.911603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:13.911603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:13.911603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:13.911603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:13.911603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:23:13.911603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:23:13.911603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:23:13.912857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:23:13.912857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:13.912857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:13.912857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:13.912857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:13.912857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:13.912857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:13.912857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:13.912857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:23:13.912857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:13.912857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:13.912857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:13.912857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:13.912857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:13.912857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:13.912857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:13.912857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:13.913887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:23:13.913887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:23:13.913887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:13.913887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:13.916612 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 598/1210] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:13.921032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2949a-ee7a-44fa-8556-57720ac9bfa5 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:14.042425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2949a-ee7a-44fa-8556-57720ac9bfa5 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:14.082933 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63c3e0-c721-4063-b224-2d70db62b03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:14.083520 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63c3e0-c721-4063-b224-2d70db62b03e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:14.083860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63c3e0-c721-4063-b224-2d70db62b03e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:14.084082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63c3e0-c721-4063-b224-2d70db62b03e None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:14.084952 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63c3e0-c721-4063-b224-2d70db62b03e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:14.085294 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63c3e0-c721-4063-b224-2d70db62b03e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:14.086821 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63c3e0-c721-4063-b224-2d70db62b03e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:14.101146 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 613/1211] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:14.107893 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f327e-5354-47d9-a26a-cbe4b37f5043 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:14.233027 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f327e-5354-47d9-a26a-cbe4b37f5043 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:14.273992 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896a2a7-3009-4068-85cb-f3d5ee567824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:14.274954 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896a2a7-3009-4068-85cb-f3d5ee567824 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:14.275242 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896a2a7-3009-4068-85cb-f3d5ee567824 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:14.275518 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896a2a7-3009-4068-85cb-f3d5ee567824 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:14.284382 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896a2a7-3009-4068-85cb-f3d5ee567824 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:14.285950 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896a2a7-3009-4068-85cb-f3d5ee567824 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:14.302108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-9896a2a7-3009-4068-85cb-f3d5ee567824 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 06 23:23:14.302108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:14.302108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:14.302108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:14.302108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:14.302108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:14.302108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:14.302108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:14.302108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:14.302108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:14.302108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:14.302108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:14.302108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:23:14.302108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:23:14.302108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:23:14.302108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:23:14.303800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:14.303800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:14.303800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:23:14.303800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:23:14.303800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:23:14.303800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:23:14.303800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:14.303800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:14.303800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:14.303800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:14.303800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:14.303800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:23:14.303800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:14.303800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:14.303800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:14.303800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:14.303800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:14.303800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:14.305180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:14.305180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:14.305180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:23:14.305180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:23:14.305180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:23:14.305180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:23:14.305180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:23:14.305180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:23:14.305180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 06 23:23:14.305180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:14.311503 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 599/1212] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:23:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:14.312822 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63c3e0-c721-4063-b224-2d70db62b03e None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:14.432964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63c3e0-c721-4063-b224-2d70db62b03e None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:14.474551 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2e1af-9845-46c8-8c4f-6f7e0f834d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:14.475444 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2e1af-9845-46c8-8c4f-6f7e0f834d35 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:14.475726 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2e1af-9845-46c8-8c4f-6f7e0f834d35 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:14.476026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2e1af-9845-46c8-8c4f-6f7e0f834d35 None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:14.476888 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2e1af-9845-46c8-8c4f-6f7e0f834d35 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:14.477197 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2e1af-9845-46c8-8c4f-6f7e0f834d35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:14.480741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2e1af-9845-46c8-8c4f-6f7e0f834d35 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:14.500511 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 614/1213] 10.222.0.60 () {56 vars in 1143 bytes} [Fri May 6 23:23:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:14.506534 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896a2a7-3009-4068-85cb-f3d5ee567824 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:14.610911 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896a2a7-3009-4068-85cb-f3d5ee567824 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:14.646128 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6296a-e1b1-4b79-afe0-9794b2861852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:14.647155 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6296a-e1b1-4b79-afe0-9794b2861852 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:14.647657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6296a-e1b1-4b79-afe0-9794b2861852 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:14.648134 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6296a-e1b1-4b79-afe0-9794b2861852 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:14.722626 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6296a-e1b1-4b79-afe0-9794b2861852 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:14.724078 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6296a-e1b1-4b79-afe0-9794b2861852 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:14.829916 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 600/1214] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:23:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 06 23:23:14.836491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2e1af-9845-46c8-8c4f-6f7e0f834d35 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:14.946990 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2e1af-9845-46c8-8c4f-6f7e0f834d35 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:14.984182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bceadd5-b732-42b0-8b80-0bf95e513557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:14.985035 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bceadd5-b732-42b0-8b80-0bf95e513557 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:14.986500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bceadd5-b732-42b0-8b80-0bf95e513557 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:14.986500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bceadd5-b732-42b0-8b80-0bf95e513557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:14.997167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bceadd5-b732-42b0-8b80-0bf95e513557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:14.998882 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bceadd5-b732-42b0-8b80-0bf95e513557 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:15.018754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-4bceadd5-b732-42b0-8b80-0bf95e513557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:15.018754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:15.018754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:15.018754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:15.018754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:15.018754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:15.018754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:15.018754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:15.018754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:15.018754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:15.018754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:15.018754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:15.018754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:23:15.018754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:23:15.018754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:23:15.019893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:23:15.019893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:15.019893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:15.019893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:15.019893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:15.019893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:15.019893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:15.019893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:15.019893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:23:15.019893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:15.019893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:15.019893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:15.019893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:15.019893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:15.019893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:15.019893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:15.019893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:15.021374 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:23:15.021374 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:23:15.021374 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:15.021374 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:23:15.021374 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 615/1215] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:15.026343 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6296a-e1b1-4b79-afe0-9794b2861852 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:15.127431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6296a-e1b1-4b79-afe0-9794b2861852 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:15.163510 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6b811-6896-4fe7-8d94-c64d4131004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:15.164209 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6b811-6896-4fe7-8d94-c64d4131004d None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:15.164493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6b811-6896-4fe7-8d94-c64d4131004d None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:15.164974 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6b811-6896-4fe7-8d94-c64d4131004d None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:15.165693 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6b811-6896-4fe7-8d94-c64d4131004d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:15.166000 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6b811-6896-4fe7-8d94-c64d4131004d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:15.167368 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6b811-6896-4fe7-8d94-c64d4131004d None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:15.179350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 601/1216] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:15.185063 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bceadd5-b732-42b0-8b80-0bf95e513557 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:15.299522 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bceadd5-b732-42b0-8b80-0bf95e513557 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:15.340330 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5618d0-ed02-46d3-81e2-4a549d8c8fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:15.341552 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5618d0-ed02-46d3-81e2-4a549d8c8fc0 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:15.341845 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5618d0-ed02-46d3-81e2-4a549d8c8fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:15.342150 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5618d0-ed02-46d3-81e2-4a549d8c8fc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:15.350841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5618d0-ed02-46d3-81e2-4a549d8c8fc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:15.352447 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5618d0-ed02-46d3-81e2-4a549d8c8fc0 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:15.367772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-5f5618d0-ed02-46d3-81e2-4a549d8c8fc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:23:15.367772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:15.367772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:15.367772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:15.367772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:15.367772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:15.367772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:15.367772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:15.367772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:15.367772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:15.367772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:15.367772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:15.367772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:23:15.367772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:23:15.367772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:23:15.369093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:23:15.369093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:15.369093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:15.369093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:15.369093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:15.369093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:15.369093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:15.369093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:15.369093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:23:15.369093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:15.369093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:15.369093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:15.369093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:15.369093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:15.369093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:15.369093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:15.369093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:15.370030 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:23:15.370030 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:23:15.370030 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:23:15.370030 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:23:15.370030 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:23:15.370030 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:23:15.370030 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:23:15.370030 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:23:15.370030 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 616/1217] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:23:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:15.374850 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6b811-6896-4fe7-8d94-c64d4131004d None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:15.500945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6b811-6896-4fe7-8d94-c64d4131004d None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:15.544151 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9534f-0505-4ece-b63c-25a3cee86407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:15.545110 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9534f-0505-4ece-b63c-25a3cee86407 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:15.545530 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9534f-0505-4ece-b63c-25a3cee86407 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:15.545884 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9534f-0505-4ece-b63c-25a3cee86407 None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:15.546882 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9534f-0505-4ece-b63c-25a3cee86407 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:15.547411 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9534f-0505-4ece-b63c-25a3cee86407 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:15.549092 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9534f-0505-4ece-b63c-25a3cee86407 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:15.565889 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 602/1218] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:23:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:15.572929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5618d0-ed02-46d3-81e2-4a549d8c8fc0 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:15.682014 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5618d0-ed02-46d3-81e2-4a549d8c8fc0 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:15.719850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f47bb8-03c9-4dce-830c-d9a8b6e56d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:15.720527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47bb8-03c9-4dce-830c-d9a8b6e56d7e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:15.720838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47bb8-03c9-4dce-830c-d9a8b6e56d7e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:15.721111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47bb8-03c9-4dce-830c-d9a8b6e56d7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:15.721955 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f47bb8-03c9-4dce-830c-d9a8b6e56d7e None admin] RBAC: Adding query filter params (role.id=71050e310414462b8d07f901fef201ad, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=fb1f7704fb5644688b8764bb1ce15734) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:15.722277 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f47bb8-03c9-4dce-830c-d9a8b6e56d7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:15.724063 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f47bb8-03c9-4dce-830c-d9a8b6e56d7e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:15.736419 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 617/1219] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:23:15 2022] GET /identity/v3/role_assignments?user.id=fb1f7704fb5644688b8764bb1ce15734&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=71050e310414462b8d07f901fef201ad => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:18.258959 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19479618-5544-4929-a3ad-323d78640bd9 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:18.259466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19479618-5544-4929-a3ad-323d78640bd9 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:18.259466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19479618-5544-4929-a3ad-323d78640bd9 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:18.260968 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 603/1220] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:23:18.266337 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f1ac8-bef3-49ef-abe8-3eabc6ee55a9 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:18.266753 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f1ac8-bef3-49ef-abe8-3eabc6ee55a9 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:18.266897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f1ac8-bef3-49ef-abe8-3eabc6ee55a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:18.287351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-fc6f1ac8-bef3-49ef-abe8-3eabc6ee55a9 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:23:18.289035 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-fc6f1ac8-bef3-49ef-abe8-3eabc6ee55a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:23:18.368913 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 618/1221] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:23:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:23:18.392833 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19479618-5544-4929-a3ad-323d78640bd9 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:18.508746 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19479618-5544-4929-a3ad-323d78640bd9 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:18.549001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab176e2-1af1-40b9-bb23-d5fbe08d562b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:18.549815 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab176e2-1af1-40b9-bb23-d5fbe08d562b None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:18.551637 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab176e2-1af1-40b9-bb23-d5fbe08d562b None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:18.551919 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab176e2-1af1-40b9-bb23-d5fbe08d562b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:18.565429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab176e2-1af1-40b9-bb23-d5fbe08d562b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:23:18.573150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-7ab176e2-1af1-40b9-bb23-d5fbe08d562b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:23:18.573150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:18.573150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:18.573150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:18.573150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:18.573150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:18.573150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:18.573150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:18.573150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:18.573150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:18.573150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:18.573150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:18.573150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:23:18.573150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:23:18.573150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:23:18.573150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:23:18.574349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:23:18.574349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:23:18.574349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:23:18.574349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:23:18.574349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:18.574349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:18.574349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:18.574349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:18.574349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:18.574349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:18.574349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:18.574349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:23:18.574349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:18.574349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:18.574349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:18.574349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:18.575330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:18.575330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:18.575330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:18.575330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:18.575330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:23:18.575330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:23:18.575330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:23:18.575330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:23:18.575330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:23:18.575330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:23:18.575330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:23:18.575330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:18.575330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 604/1222] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:23:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:23:18.581247 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f1ac8-bef3-49ef-abe8-3eabc6ee55a9 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:18.686253 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f1ac8-bef3-49ef-abe8-3eabc6ee55a9 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:18.726692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072da8d5-5f3d-4044-beea-d0f407033422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:18.727433 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072da8d5-5f3d-4044-beea-d0f407033422 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:18.727786 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072da8d5-5f3d-4044-beea-d0f407033422 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:18.728143 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072da8d5-5f3d-4044-beea-d0f407033422 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:18.729059 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072da8d5-5f3d-4044-beea-d0f407033422 None admin] RBAC: Adding query filter params (name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:18.729446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072da8d5-5f3d-4044-beea-d0f407033422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:18.730936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072da8d5-5f3d-4044-beea-d0f407033422 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:18.739832 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 619/1223] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:23:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:18.745779 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab176e2-1af1-40b9-bb23-d5fbe08d562b None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:18.855797 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab176e2-1af1-40b9-bb23-d5fbe08d562b None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:18.904806 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc25aa-f875-4e8b-8e50-5c9c64962c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:18.905713 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc25aa-f875-4e8b-8e50-5c9c64962c1a None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:18.906085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc25aa-f875-4e8b-8e50-5c9c64962c1a None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:18.906439 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc25aa-f875-4e8b-8e50-5c9c64962c1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:18.917280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc25aa-f875-4e8b-8e50-5c9c64962c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:18.918753 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc25aa-f875-4e8b-8e50-5c9c64962c1a None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:18.935671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-19cc25aa-f875-4e8b-8e50-5c9c64962c1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:18.935671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:18.935671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:18.935671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:18.935671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:18.935671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:18.935671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:18.935671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:18.935671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:18.935671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:18.935671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:18.935671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:18.935671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:23:18.935671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:23:18.935671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:23:18.936878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:23:18.936878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:18.936878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:18.936878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:18.936878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:18.936878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:18.936878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:18.936878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:18.936878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:23:18.936878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:18.936878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:18.936878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:18.936878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:18.936878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:18.936878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:18.936878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:18.936878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:18.937976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:23:18.937976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:23:18.937976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:18.937976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:18.937976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 605/1224] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:18.943237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072da8d5-5f3d-4044-beea-d0f407033422 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:19.046863 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072da8d5-5f3d-4044-beea-d0f407033422 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:19.082692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42e879-4c6e-476e-9f87-c4abe1fcd9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:19.083469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42e879-4c6e-476e-9f87-c4abe1fcd9b8 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:19.083757 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42e879-4c6e-476e-9f87-c4abe1fcd9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:19.084108 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42e879-4c6e-476e-9f87-c4abe1fcd9b8 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:19.084990 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42e879-4c6e-476e-9f87-c4abe1fcd9b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:19.085281 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42e879-4c6e-476e-9f87-c4abe1fcd9b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:19.086831 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42e879-4c6e-476e-9f87-c4abe1fcd9b8 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:19.104603 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 620/1225] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:19.105840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc25aa-f875-4e8b-8e50-5c9c64962c1a None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:19.208663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc25aa-f875-4e8b-8e50-5c9c64962c1a None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:19.263346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8be201-dbfa-4d21-b35a-ee501600d4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:19.264144 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8be201-dbfa-4d21-b35a-ee501600d4c8 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:19.264424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8be201-dbfa-4d21-b35a-ee501600d4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:19.264737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8be201-dbfa-4d21-b35a-ee501600d4c8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:19.272952 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8be201-dbfa-4d21-b35a-ee501600d4c8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:19.274626 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8be201-dbfa-4d21-b35a-ee501600d4c8 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:19.291466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-0b8be201-dbfa-4d21-b35a-ee501600d4c8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 06 23:23:19.291466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:19.291466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:19.291466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:19.291466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:19.291466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:19.291466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:19.291466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:19.291466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:19.291466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:19.291466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:19.291466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:19.291466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:23:19.291466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:23:19.291466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:23:19.291466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:23:19.292703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:19.292703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:19.292703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:23:19.292703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:23:19.292703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:23:19.292703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:23:19.292703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:19.292703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:19.292703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:19.292703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:19.292703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:19.292703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:23:19.292703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:19.292703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:19.292703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:19.292703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:19.292703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:19.292703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:19.293997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:19.293997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:19.293997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:23:19.293997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:23:19.293997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:23:19.293997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:23:19.293997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:23:19.293997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:23:19.293997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 06 23:23:19.293997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:19.298387 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 606/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:23:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:23:19.299539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42e879-4c6e-476e-9f87-c4abe1fcd9b8 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:19.411905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42e879-4c6e-476e-9f87-c4abe1fcd9b8 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:19.445156 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed19a64-6997-43e8-82ba-fa5bca2cb3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:19.445964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed19a64-6997-43e8-82ba-fa5bca2cb3db None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:19.446244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed19a64-6997-43e8-82ba-fa5bca2cb3db None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:19.446567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed19a64-6997-43e8-82ba-fa5bca2cb3db None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:19.447428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed19a64-6997-43e8-82ba-fa5bca2cb3db None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:19.447768 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed19a64-6997-43e8-82ba-fa5bca2cb3db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:19.449377 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed19a64-6997-43e8-82ba-fa5bca2cb3db None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:19.468309 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 621/1227] 10.222.0.60 () {56 vars in 1143 bytes} [Fri May 6 23:23:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:19.475036 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8be201-dbfa-4d21-b35a-ee501600d4c8 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:19.587423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8be201-dbfa-4d21-b35a-ee501600d4c8 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:19.624367 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e6b69-1847-49a4-82ed-ea54b656f64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:19.625338 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e6b69-1847-49a4-82ed-ea54b656f64a None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:19.625634 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e6b69-1847-49a4-82ed-ea54b656f64a None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:19.626002 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e6b69-1847-49a4-82ed-ea54b656f64a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:19.638675 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e6b69-1847-49a4-82ed-ea54b656f64a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:19.640332 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e6b69-1847-49a4-82ed-ea54b656f64a None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:19.659193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-f89e6b69-1847-49a4-82ed-ea54b656f64a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:19.659193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:19.659193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:19.659193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:19.659193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:19.659193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:19.659193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:19.659193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:19.659193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:19.659193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:19.659193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:19.659193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:19.659193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:23:19.659193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:23:19.659193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:23:19.660280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:23:19.660280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:19.660280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:19.660280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:19.660280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:19.660280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:19.660280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:19.660280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:19.660280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:23:19.660280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:19.660280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:19.660280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:19.660280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:19.660280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:19.660280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:19.660280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:19.660280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:19.661743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:23:19.661743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:23:19.661743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:19.661743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:19.661743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 607/1228] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:19.667195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed19a64-6997-43e8-82ba-fa5bca2cb3db None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:19.774036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed19a64-6997-43e8-82ba-fa5bca2cb3db None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:19.809546 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfd9fc-8b2c-4dfc-ab40-3f2c5ec7feda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:19.810432 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfd9fc-8b2c-4dfc-ab40-3f2c5ec7feda None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:19.810713 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfd9fc-8b2c-4dfc-ab40-3f2c5ec7feda None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:19.810987 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfd9fc-8b2c-4dfc-ab40-3f2c5ec7feda None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:19.811779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfd9fc-8b2c-4dfc-ab40-3f2c5ec7feda None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:19.812095 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfd9fc-8b2c-4dfc-ab40-3f2c5ec7feda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:19.813810 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfd9fc-8b2c-4dfc-ab40-3f2c5ec7feda None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:19.825917 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 622/1229] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:19.831520 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e6b69-1847-49a4-82ed-ea54b656f64a None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:19.939784 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e6b69-1847-49a4-82ed-ea54b656f64a None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:19.975772 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4202e-fc51-4338-9a79-f9970be79212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:19.976572 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4202e-fc51-4338-9a79-f9970be79212 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:19.976855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4202e-fc51-4338-9a79-f9970be79212 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:19.977125 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4202e-fc51-4338-9a79-f9970be79212 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:19.983844 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4202e-fc51-4338-9a79-f9970be79212 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:19.985328 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4202e-fc51-4338-9a79-f9970be79212 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:19.998937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-11a4202e-fc51-4338-9a79-f9970be79212 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:23:19.998937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:19.998937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:19.998937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:19.998937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:19.998937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:19.998937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:19.998937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:19.998937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:19.998937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:19.998937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:19.998937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:19.998937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:23:19.998937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:23:19.998937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:23:20.000266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:23:20.000266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:20.000266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:20.000266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:20.000266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:20.000266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:20.000266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:20.000266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:20.000266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:23:20.000266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:20.000266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:20.000266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:20.000266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:20.000266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:20.000266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:20.000266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:20.000266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:20.001864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:23:20.001864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:23:20.001864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:23:20.001864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:23:20.001864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:23:20.001864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:23:20.001864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:23:20.001864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:20.001864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 608/1230] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:23:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:20.006342 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfd9fc-8b2c-4dfc-ab40-3f2c5ec7feda None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:20.121698 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfd9fc-8b2c-4dfc-ab40-3f2c5ec7feda None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:20.157327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0ee8f-69f7-49d7-9ea2-b64c0ad21f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:20.157992 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0ee8f-69f7-49d7-9ea2-b64c0ad21f25 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:20.158272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0ee8f-69f7-49d7-9ea2-b64c0ad21f25 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:20.158550 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0ee8f-69f7-49d7-9ea2-b64c0ad21f25 None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:20.159346 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0ee8f-69f7-49d7-9ea2-b64c0ad21f25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:20.159644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0ee8f-69f7-49d7-9ea2-b64c0ad21f25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:20.161143 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0ee8f-69f7-49d7-9ea2-b64c0ad21f25 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:20.173134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 623/1231] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:23:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:23:20.180083 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4202e-fc51-4338-9a79-f9970be79212 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:20.298678 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4202e-fc51-4338-9a79-f9970be79212 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:20.344236 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dd855-dae2-492d-97bf-ad62be13e93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:20.345148 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dd855-dae2-492d-97bf-ad62be13e93a None admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:20.345476 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dd855-dae2-492d-97bf-ad62be13e93a None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:20.345763 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dd855-dae2-492d-97bf-ad62be13e93a None admin] PATH_INFO: `/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/fb1f7704fb5644688b8764bb1ce15734/roles/71050e310414462b8d07f901fef201ad` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:20.360678 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dd855-dae2-492d-97bf-ad62be13e93a None admin] RBAC: Authorizing `identity:create_grant(project_id=4389eb256aba4b7182e33cb3720b1073, user_id=fb1f7704fb5644688b8764bb1ce15734, role_id=71050e310414462b8d07f901fef201ad)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:20.362138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dd855-dae2-492d-97bf-ad62be13e93a None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:20.374320 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 609/1232] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:23:20 2022] PUT /identity/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/fb1f7704fb5644688b8764bb1ce15734/roles/71050e310414462b8d07f901fef201ad => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:23:22.822452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ca961-6c2f-49a6-bdb7-f3b510cfc79c None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:22.823000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ca961-6c2f-49a6-bdb7-f3b510cfc79c None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:22.823000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ca961-6c2f-49a6-bdb7-f3b510cfc79c None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:22.824419 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 624/1233] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:23:22.831964 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b623d4f-a46f-4c8b-a380-74b457173410 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:22.832443 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b623d4f-a46f-4c8b-a380-74b457173410 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:22.832836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b623d4f-a46f-4c8b-a380-74b457173410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:22.850951 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-9b623d4f-a46f-4c8b-a380-74b457173410 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:23:22.852150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9b623d4f-a46f-4c8b-a380-74b457173410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:23:22.925511 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 610/1234] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:23:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:23:22.949215 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ca961-6c2f-49a6-bdb7-f3b510cfc79c None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:23.062864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ca961-6c2f-49a6-bdb7-f3b510cfc79c None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:23.098744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f983696-2a0a-41be-9d5b-41d0b5af77f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:23.099661 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f983696-2a0a-41be-9d5b-41d0b5af77f8 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:23.099988 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f983696-2a0a-41be-9d5b-41d0b5af77f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:23.100260 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f983696-2a0a-41be-9d5b-41d0b5af77f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:23.110441 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f983696-2a0a-41be-9d5b-41d0b5af77f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:23:23.119136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-0f983696-2a0a-41be-9d5b-41d0b5af77f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 06 23:23:23.119136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:23.119136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:23.119136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:23.119136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:23.119136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:23.119136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:23.119136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:23.119136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:23.119136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:23.119136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:23.119136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:23.119136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:23:23.119136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:23:23.119136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:23:23.119136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:23:23.120293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:23:23.120293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:23:23.120293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:23:23.120293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:23:23.120293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:23.120293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:23.120293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:23.120293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:23.120293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:23.120293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:23.120293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:23.120293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:23:23.120293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:23.120293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:23.120293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:23.120293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:23.121340 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:23.121340 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:23.121340 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:23.121340 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:23.121340 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:23:23.121340 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:23:23.121340 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:23:23.121340 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:23:23.121340 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:23:23.121340 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:23:23.121340 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 06 23:23:23.121340 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:23:23.121340 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 625/1235] 10.222.0.60 () {56 vars in 1102 bytes} [Fri May 6 23:23:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:23.126653 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b623d4f-a46f-4c8b-a380-74b457173410 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:23.231029 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b623d4f-a46f-4c8b-a380-74b457173410 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:23.273900 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810ff13-dcdc-4cc4-a329-b290a5a5f35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:23.274562 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810ff13-dcdc-4cc4-a329-b290a5a5f35f None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:23.274843 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810ff13-dcdc-4cc4-a329-b290a5a5f35f None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:23.275123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810ff13-dcdc-4cc4-a329-b290a5a5f35f None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:23.275874 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810ff13-dcdc-4cc4-a329-b290a5a5f35f None admin] RBAC: Adding query filter params (name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:23.276181 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810ff13-dcdc-4cc4-a329-b290a5a5f35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:23.277825 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810ff13-dcdc-4cc4-a329-b290a5a5f35f None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:23.288351 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 611/1236] 10.222.0.60 () {56 vars in 1103 bytes} [Fri May 6 23:23:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:23.296133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f983696-2a0a-41be-9d5b-41d0b5af77f8 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:23.408465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f983696-2a0a-41be-9d5b-41d0b5af77f8 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:23.443776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee249f0b-e57f-45c7-bb89-0745237d0849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:23.444637 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee249f0b-e57f-45c7-bb89-0745237d0849 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:23.444919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee249f0b-e57f-45c7-bb89-0745237d0849 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:23.445190 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee249f0b-e57f-45c7-bb89-0745237d0849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:23.456219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee249f0b-e57f-45c7-bb89-0745237d0849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:23.458300 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee249f0b-e57f-45c7-bb89-0745237d0849 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:23.477538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-ee249f0b-e57f-45c7-bb89-0745237d0849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:23.477538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:23.477538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:23.477538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:23.477538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:23.477538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:23.477538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:23.477538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:23.477538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:23.477538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:23.477538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:23.477538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:23.477538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:23:23.477538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:23:23.477538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:23:23.478761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:23:23.478761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:23.478761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:23.478761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:23.478761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:23.478761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:23.478761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:23.478761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:23.478761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:23:23.478761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:23.478761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:23.478761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:23.478761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:23.478761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:23.478761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:23.478761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:23.478761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:23.480111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:23:23.480111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:23:23.480111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:23.480111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:23:23.480111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 626/1237] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:23.484902 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810ff13-dcdc-4cc4-a329-b290a5a5f35f None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:23.594047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810ff13-dcdc-4cc4-a329-b290a5a5f35f None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:23.632559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b140da-aa3d-46ec-85d8-adb2a9117c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:23.633248 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b140da-aa3d-46ec-85d8-adb2a9117c59 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:23.633522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b140da-aa3d-46ec-85d8-adb2a9117c59 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:23.633958 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b140da-aa3d-46ec-85d8-adb2a9117c59 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:23.634628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b140da-aa3d-46ec-85d8-adb2a9117c59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:23.634973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b140da-aa3d-46ec-85d8-adb2a9117c59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:23.637364 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b140da-aa3d-46ec-85d8-adb2a9117c59 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:23.656389 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 612/1238] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:23:23.657713 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee249f0b-e57f-45c7-bb89-0745237d0849 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:23.764400 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee249f0b-e57f-45c7-bb89-0745237d0849 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:23.798368 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31023df-7ed7-4ff6-aed3-fd9ca83309d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:23.799163 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31023df-7ed7-4ff6-aed3-fd9ca83309d5 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:23.799440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31023df-7ed7-4ff6-aed3-fd9ca83309d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:23.799709 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31023df-7ed7-4ff6-aed3-fd9ca83309d5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:23.807891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31023df-7ed7-4ff6-aed3-fd9ca83309d5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:23.809480 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31023df-7ed7-4ff6-aed3-fd9ca83309d5 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:23.825778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-b31023df-7ed7-4ff6-aed3-fd9ca83309d5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 06 23:23:23.825778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:23.825778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:23.825778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:23.825778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:23.825778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:23.825778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:23.825778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:23.825778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:23.825778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:23.825778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:23.825778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:23.825778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:23:23.825778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:23:23.825778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:23:23.825778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:23:23.827440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:23.827440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:23.827440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:23:23.827440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:23:23.827440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:23:23.827440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:23:23.827440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:23.827440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:23.827440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:23.827440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:23.827440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:23.827440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:23:23.827440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:23.827440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:23.827440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:23.827440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:23.827440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:23.827440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:23.828731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:23.828731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:23.828731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:23:23.828731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:23:23.828731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:23:23.828731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:23:23.828731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:23:23.828731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:23:23.828731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 06 23:23:23.828731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:23:23.832578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 627/1239] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:23:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:23.833300 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b140da-aa3d-46ec-85d8-adb2a9117c59 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:23.937489 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b140da-aa3d-46ec-85d8-adb2a9117c59 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:23.973885 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56135ee3-40ae-482f-bf8a-ac46f9631c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:23.974554 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135ee3-40ae-482f-bf8a-ac46f9631c3f None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:23.974829 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135ee3-40ae-482f-bf8a-ac46f9631c3f None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:23.975098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135ee3-40ae-482f-bf8a-ac46f9631c3f None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:23.975936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56135ee3-40ae-482f-bf8a-ac46f9631c3f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:23.976240 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56135ee3-40ae-482f-bf8a-ac46f9631c3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:23.977703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56135ee3-40ae-482f-bf8a-ac46f9631c3f None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:23.995326 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 613/1240] 10.222.0.60 () {56 vars in 1143 bytes} [Fri May 6 23:23:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:24.001389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31023df-7ed7-4ff6-aed3-fd9ca83309d5 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:24.110912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31023df-7ed7-4ff6-aed3-fd9ca83309d5 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:24.148996 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7e05a-e415-4008-87f3-8b902966939e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:24.149653 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7e05a-e415-4008-87f3-8b902966939e None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:24.149990 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7e05a-e415-4008-87f3-8b902966939e None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:24.150323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7e05a-e415-4008-87f3-8b902966939e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:24.224530 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7e05a-e415-4008-87f3-8b902966939e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:24.226236 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7e05a-e415-4008-87f3-8b902966939e None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:24.331776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 628/1241] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:23:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 06 23:23:24.337729 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56135ee3-40ae-482f-bf8a-ac46f9631c3f None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:24.450691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56135ee3-40ae-482f-bf8a-ac46f9631c3f None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:24.485433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325cb56-f982-4d95-b589-f6b9f1d323e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:24.486285 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325cb56-f982-4d95-b589-f6b9f1d323e6 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:24.486550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325cb56-f982-4d95-b589-f6b9f1d323e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:24.486820 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325cb56-f982-4d95-b589-f6b9f1d323e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:24.497160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325cb56-f982-4d95-b589-f6b9f1d323e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:24.498603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325cb56-f982-4d95-b589-f6b9f1d323e6 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:24.516357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-c325cb56-f982-4d95-b589-f6b9f1d323e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:24.516357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:24.516357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:24.516357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:24.516357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:24.516357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:24.516357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:24.516357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:24.516357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:24.516357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:24.516357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:24.516357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:24.516357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:23:24.516357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:23:24.516357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:23:24.517492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:23:24.517492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:24.517492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:24.517492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:24.517492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:24.517492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:24.517492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:24.517492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:24.517492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:23:24.517492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:24.517492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:24.517492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:24.517492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:24.517492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:24.517492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:24.517492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:24.517492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:24.518559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:23:24.518559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:23:24.518559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:24.518559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:24.518559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 614/1242] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:23:24.523744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7e05a-e415-4008-87f3-8b902966939e None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:24.624649 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7e05a-e415-4008-87f3-8b902966939e None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:24.658948 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01eaefb-4352-4dcb-baf8-6615e7c15b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:24.659597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01eaefb-4352-4dcb-baf8-6615e7c15b83 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:24.659881 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01eaefb-4352-4dcb-baf8-6615e7c15b83 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:24.660151 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01eaefb-4352-4dcb-baf8-6615e7c15b83 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:24.660935 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01eaefb-4352-4dcb-baf8-6615e7c15b83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:24.661237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01eaefb-4352-4dcb-baf8-6615e7c15b83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:24.662632 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01eaefb-4352-4dcb-baf8-6615e7c15b83 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:24.673403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 629/1243] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:24.679089 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325cb56-f982-4d95-b589-f6b9f1d323e6 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:24.792828 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325cb56-f982-4d95-b589-f6b9f1d323e6 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:24.830019 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b3111-98bd-4b34-ab54-53ef63622d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:24.830931 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b3111-98bd-4b34-ab54-53ef63622d75 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:24.831272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b3111-98bd-4b34-ab54-53ef63622d75 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:24.831545 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b3111-98bd-4b34-ab54-53ef63622d75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:24.840733 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b3111-98bd-4b34-ab54-53ef63622d75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:24.842599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b3111-98bd-4b34-ab54-53ef63622d75 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:24.857711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-497b3111-98bd-4b34-ab54-53ef63622d75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:23:24.857711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:24.857711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:24.857711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:24.857711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:24.857711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:24.857711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:24.857711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:24.857711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:24.857711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:24.857711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:24.857711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:24.857711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:23:24.857711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:23:24.857711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:23:24.858650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:23:24.858650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:24.858650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:24.858650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:24.858650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:24.858650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:24.858650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:24.858650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:24.858650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:23:24.858650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:24.858650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:24.858650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:24.858650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:24.858650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:24.858650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:24.858650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:24.858650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:24.859576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:23:24.859576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:23:24.859576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:23:24.859576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:23:24.859576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:23:24.859576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:23:24.859576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:23:24.859576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:24.859576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 615/1244] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:23:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:24.865648 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01eaefb-4352-4dcb-baf8-6615e7c15b83 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:24.977712 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01eaefb-4352-4dcb-baf8-6615e7c15b83 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:25.012146 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724a27d-1adb-4c0c-9792-f48a2fc6cadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:25.012930 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724a27d-1adb-4c0c-9792-f48a2fc6cadb None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:25.013091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724a27d-1adb-4c0c-9792-f48a2fc6cadb None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:25.013367 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724a27d-1adb-4c0c-9792-f48a2fc6cadb None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:25.014152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724a27d-1adb-4c0c-9792-f48a2fc6cadb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:25.014452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724a27d-1adb-4c0c-9792-f48a2fc6cadb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:25.015972 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724a27d-1adb-4c0c-9792-f48a2fc6cadb None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:25.029520 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 630/1245] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:23:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:25.035672 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b3111-98bd-4b34-ab54-53ef63622d75 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:25.143247 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b3111-98bd-4b34-ab54-53ef63622d75 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:25.178687 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0174c02-7081-41cd-ad70-0d979f9b301e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:25.179341 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0174c02-7081-41cd-ad70-0d979f9b301e None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:25.179622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0174c02-7081-41cd-ad70-0d979f9b301e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:25.179899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0174c02-7081-41cd-ad70-0d979f9b301e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:25.180753 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0174c02-7081-41cd-ad70-0d979f9b301e None admin] RBAC: Adding query filter params (role.id=71050e310414462b8d07f901fef201ad, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=fb1f7704fb5644688b8764bb1ce15734) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:25.181068 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0174c02-7081-41cd-ad70-0d979f9b301e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:25.182507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0174c02-7081-41cd-ad70-0d979f9b301e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:25.188652 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 616/1246] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:23:25 2022] GET /identity/v3/role_assignments?user.id=fb1f7704fb5644688b8764bb1ce15734&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=71050e310414462b8d07f901fef201ad => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:27.880268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccec3a4-ebf1-4a0a-9b50-791e3eec332e None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:27.880792 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccec3a4-ebf1-4a0a-9b50-791e3eec332e None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:27.880906 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccec3a4-ebf1-4a0a-9b50-791e3eec332e None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:27.882370 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 631/1247] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:23:27.887823 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb8ae-1387-4fc2-80d8-7e4cee92f4c3 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:27.888283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb8ae-1387-4fc2-80d8-7e4cee92f4c3 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:27.888387 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb8ae-1387-4fc2-80d8-7e4cee92f4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:27.904952 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-26fbb8ae-1387-4fc2-80d8-7e4cee92f4c3 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:23:27.906133 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-26fbb8ae-1387-4fc2-80d8-7e4cee92f4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:23:27.986586 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 617/1248] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:23:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:23:28.010260 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccec3a4-ebf1-4a0a-9b50-791e3eec332e None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:28.116802 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccec3a4-ebf1-4a0a-9b50-791e3eec332e None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:28.150647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466fe4c-e507-4072-88e2-77523fee330a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:28.151613 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466fe4c-e507-4072-88e2-77523fee330a None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:28.151905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466fe4c-e507-4072-88e2-77523fee330a None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:28.152218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466fe4c-e507-4072-88e2-77523fee330a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:28.164818 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466fe4c-e507-4072-88e2-77523fee330a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:23:28.173780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-f466fe4c-e507-4072-88e2-77523fee330a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:23:28.173780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:28.173780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:28.173780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:28.173780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:28.173780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:28.173780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:28.173780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:28.173780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:28.173780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:28.173780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:28.173780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:28.173780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:23:28.173780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:23:28.173780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:23:28.173780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:23:28.174816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:23:28.174816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:23:28.174816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:23:28.174816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:23:28.174816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:28.174816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:28.174816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:28.174816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:28.174816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:28.174816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:28.174816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:28.174816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:23:28.174816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:28.174816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:28.174816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:28.174816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:28.175650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:28.175650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:28.175650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:28.175650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:28.175650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:23:28.175650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:23:28.175650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:23:28.175650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:23:28.175650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:23:28.175650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:23:28.175650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:23:28.175650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:23:28.175650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 632/1249] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:23:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:28.181086 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbb8ae-1387-4fc2-80d8-7e4cee92f4c3 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:28.278329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbb8ae-1387-4fc2-80d8-7e4cee92f4c3 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:28.317599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a6ee7-dd14-4aea-8d6b-f6e7d60c08ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:28.318270 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6ee7-dd14-4aea-8d6b-f6e7d60c08ec None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:28.318611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6ee7-dd14-4aea-8d6b-f6e7d60c08ec None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:28.318890 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6ee7-dd14-4aea-8d6b-f6e7d60c08ec None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:28.319607 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a6ee7-dd14-4aea-8d6b-f6e7d60c08ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:28.319911 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a6ee7-dd14-4aea-8d6b-f6e7d60c08ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:28.321352 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a6ee7-dd14-4aea-8d6b-f6e7d60c08ec None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:28.330680 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 618/1250] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:23:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:28.337674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466fe4c-e507-4072-88e2-77523fee330a None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:28.446219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466fe4c-e507-4072-88e2-77523fee330a None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:28.480034 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c57cd7-4f15-46af-a64d-85a20f64d559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:28.480840 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c57cd7-4f15-46af-a64d-85a20f64d559 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:28.481154 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c57cd7-4f15-46af-a64d-85a20f64d559 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:28.481395 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c57cd7-4f15-46af-a64d-85a20f64d559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:28.492104 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c57cd7-4f15-46af-a64d-85a20f64d559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:28.493578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c57cd7-4f15-46af-a64d-85a20f64d559 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:28.512386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-51c57cd7-4f15-46af-a64d-85a20f64d559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:28.512386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:28.512386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:28.512386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:28.512386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:28.512386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:28.512386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:28.512386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:28.512386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:28.512386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:28.512386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:28.512386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:28.512386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:23:28.512386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:23:28.512386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:23:28.513537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:23:28.513537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:28.513537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:28.513537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:28.513537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:28.513537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:28.513537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:28.513537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:28.513537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:23:28.513537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:28.513537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:28.513537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:28.513537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:28.513537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:28.513537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:28.513537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:28.513537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:28.514776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:23:28.514776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:23:28.514776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:28.514776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:23:28.518366 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 633/1251] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:23:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:23:28.519386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a6ee7-dd14-4aea-8d6b-f6e7d60c08ec None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:28.621986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a6ee7-dd14-4aea-8d6b-f6e7d60c08ec None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:28.657865 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64386a37-4442-4770-95ad-691e3e4e7343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:28.658538 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64386a37-4442-4770-95ad-691e3e4e7343 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:28.658820 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64386a37-4442-4770-95ad-691e3e4e7343 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:28.659093 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64386a37-4442-4770-95ad-691e3e4e7343 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:28.659821 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64386a37-4442-4770-95ad-691e3e4e7343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:28.660129 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64386a37-4442-4770-95ad-691e3e4e7343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:28.662115 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64386a37-4442-4770-95ad-691e3e4e7343 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:28.680108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 619/1252] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:28.681469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c57cd7-4f15-46af-a64d-85a20f64d559 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:28.786261 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c57cd7-4f15-46af-a64d-85a20f64d559 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:28.820548 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25d62a-c18c-4624-92cc-c324a0684e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:28.821389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25d62a-c18c-4624-92cc-c324a0684e88 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:28.821671 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25d62a-c18c-4624-92cc-c324a0684e88 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:28.821944 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25d62a-c18c-4624-92cc-c324a0684e88 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:28.830254 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25d62a-c18c-4624-92cc-c324a0684e88 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:28.831736 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25d62a-c18c-4624-92cc-c324a0684e88 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:28.847833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-ac25d62a-c18c-4624-92cc-c324a0684e88 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 06 23:23:28.847833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:28.847833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:28.847833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:28.847833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:28.847833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:28.847833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:28.847833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:28.847833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:28.847833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:28.847833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:28.847833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:28.847833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:23:28.847833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:23:28.847833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:23:28.847833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:23:28.849692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:28.849692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:28.849692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:23:28.849692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:23:28.849692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:23:28.849692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:23:28.849692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:28.849692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:28.849692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:28.849692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:28.849692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:28.849692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:23:28.849692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:28.849692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:28.849692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:28.849692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:28.849692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:28.849692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:28.850902 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:28.850902 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:28.850902 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:23:28.850902 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:23:28.850902 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:23:28.850902 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:23:28.850902 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:23:28.850902 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:23:28.850902 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 06 23:23:28.850902 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:23:28.850902 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 634/1253] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:23:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:28.855581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64386a37-4442-4770-95ad-691e3e4e7343 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:28.955748 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64386a37-4442-4770-95ad-691e3e4e7343 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:28.990968 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa29aa-ca20-460a-a9b8-f63e692c96c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:28.991646 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa29aa-ca20-460a-a9b8-f63e692c96c1 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:28.991924 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa29aa-ca20-460a-a9b8-f63e692c96c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:28.992197 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa29aa-ca20-460a-a9b8-f63e692c96c1 None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:28.993065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa29aa-ca20-460a-a9b8-f63e692c96c1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:28.993375 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa29aa-ca20-460a-a9b8-f63e692c96c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:28.994823 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa29aa-ca20-460a-a9b8-f63e692c96c1 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:29.013123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 620/1254] 10.222.0.60 () {56 vars in 1143 bytes} [Fri May 6 23:23:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:29.018796 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25d62a-c18c-4624-92cc-c324a0684e88 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:29.115753 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25d62a-c18c-4624-92cc-c324a0684e88 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:29.148144 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b4381-7d23-42c3-b1c7-bc336bf8fab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:29.148827 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b4381-7d23-42c3-b1c7-bc336bf8fab0 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:29.149099 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b4381-7d23-42c3-b1c7-bc336bf8fab0 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:29.149368 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b4381-7d23-42c3-b1c7-bc336bf8fab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:29.212984 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b4381-7d23-42c3-b1c7-bc336bf8fab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:29.214422 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b4381-7d23-42c3-b1c7-bc336bf8fab0 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:29.309635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 635/1255] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:23:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 06 23:23:29.315405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa29aa-ca20-460a-a9b8-f63e692c96c1 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:29.408145 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa29aa-ca20-460a-a9b8-f63e692c96c1 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:29.438884 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe1a8d-bc8d-40d7-b3b9-23ad2117754b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:29.439646 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe1a8d-bc8d-40d7-b3b9-23ad2117754b None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:29.439923 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe1a8d-bc8d-40d7-b3b9-23ad2117754b None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:29.440192 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe1a8d-bc8d-40d7-b3b9-23ad2117754b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:29.450090 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe1a8d-bc8d-40d7-b3b9-23ad2117754b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:29.451516 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe1a8d-bc8d-40d7-b3b9-23ad2117754b None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:29.468689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-0abe1a8d-bc8d-40d7-b3b9-23ad2117754b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:29.468689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:29.468689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:29.468689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:29.468689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:29.468689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:29.468689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:29.468689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:29.468689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:29.468689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:29.468689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:29.468689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:29.468689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:23:29.468689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:23:29.468689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:23:29.469722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:23:29.469722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:29.469722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:29.469722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:29.469722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:29.469722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:29.469722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:29.469722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:29.469722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:23:29.469722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:29.469722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:29.469722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:29.469722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:29.469722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:29.469722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:29.469722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:29.469722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:29.470832 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:23:29.470832 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:23:29.470832 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:29.470832 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:29.470832 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 621/1256] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:29.475529 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b4381-7d23-42c3-b1c7-bc336bf8fab0 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:29.566803 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b4381-7d23-42c3-b1c7-bc336bf8fab0 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:29.598371 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d966d3-469b-40cf-ba99-dbe62eb50541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:29.599008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d966d3-469b-40cf-ba99-dbe62eb50541 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:29.599284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d966d3-469b-40cf-ba99-dbe62eb50541 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:29.599554 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d966d3-469b-40cf-ba99-dbe62eb50541 None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:29.600260 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d966d3-469b-40cf-ba99-dbe62eb50541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:29.600585 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d966d3-469b-40cf-ba99-dbe62eb50541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:29.601928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d966d3-469b-40cf-ba99-dbe62eb50541 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:29.612470 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 636/1257] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:29.618323 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe1a8d-bc8d-40d7-b3b9-23ad2117754b None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:29.711154 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe1a8d-bc8d-40d7-b3b9-23ad2117754b None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:29.743884 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b0f05-938b-4b5a-9d89-64148c5c9aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:29.744676 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b0f05-938b-4b5a-9d89-64148c5c9aa2 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:29.744955 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b0f05-938b-4b5a-9d89-64148c5c9aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:29.745223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b0f05-938b-4b5a-9d89-64148c5c9aa2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:29.751443 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b0f05-938b-4b5a-9d89-64148c5c9aa2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:29.752891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b0f05-938b-4b5a-9d89-64148c5c9aa2 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:29.766346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-e39b0f05-938b-4b5a-9d89-64148c5c9aa2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:23:29.766346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:29.766346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:29.766346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:29.766346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:29.766346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:29.766346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:29.766346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:29.766346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:29.766346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:29.766346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:29.766346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:29.766346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:23:29.766346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:23:29.766346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:23:29.767396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:23:29.767396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:29.767396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:29.767396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:29.767396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:29.767396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:29.767396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:29.767396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:29.767396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:23:29.767396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:29.767396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:29.767396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:29.767396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:29.767396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:29.767396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:29.767396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:29.767396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:29.768584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:23:29.768584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:23:29.768584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:23:29.768584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:23:29.768584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:23:29.768584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:23:29.768584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:23:29.768584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:29.768584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 622/1258] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:23:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:29.775136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d966d3-469b-40cf-ba99-dbe62eb50541 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:29.868873 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d966d3-469b-40cf-ba99-dbe62eb50541 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:29.899331 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7393c7-f32f-473c-a9a4-d42a5d1d4701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:29.899972 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7393c7-f32f-473c-a9a4-d42a5d1d4701 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:29.900251 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7393c7-f32f-473c-a9a4-d42a5d1d4701 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:29.900524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7393c7-f32f-473c-a9a4-d42a5d1d4701 None admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:29.901329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7393c7-f32f-473c-a9a4-d42a5d1d4701 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:29.901637 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7393c7-f32f-473c-a9a4-d42a5d1d4701 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:29.903059 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7393c7-f32f-473c-a9a4-d42a5d1d4701 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:29.914832 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 637/1259] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:23:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:29.920873 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b0f05-938b-4b5a-9d89-64148c5c9aa2 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:30.016831 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b0f05-938b-4b5a-9d89-64148c5c9aa2 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:30.047456 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983d1af-a285-4372-a398-384973903b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:30.048086 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983d1af-a285-4372-a398-384973903b15 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:30.048362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983d1af-a285-4372-a398-384973903b15 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:30.048664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983d1af-a285-4372-a398-384973903b15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:30.049477 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983d1af-a285-4372-a398-384973903b15 None admin] RBAC: Adding query filter params (role.id=408ee9a3a38640a48dbcdb2c377efcd8, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=fb1f7704fb5644688b8764bb1ce15734) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:30.049784 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983d1af-a285-4372-a398-384973903b15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:30.051831 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983d1af-a285-4372-a398-384973903b15 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:30.056969 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 623/1260] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:23:29 2022] GET /identity/v3/role_assignments?user.id=fb1f7704fb5644688b8764bb1ce15734&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=408ee9a3a38640a48dbcdb2c377efcd8 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:32.234216 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0de63-de14-49d6-bc53-67c60a790e9a None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:32.234724 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0de63-de14-49d6-bc53-67c60a790e9a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:32.234724 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0de63-de14-49d6-bc53-67c60a790e9a None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:32.236029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 638/1261] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:23:32.241102 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cbb18-19b2-4998-be5a-9fdff2f934d6 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:32.241535 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cbb18-19b2-4998-be5a-9fdff2f934d6 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:32.241648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cbb18-19b2-4998-be5a-9fdff2f934d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:32.259094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-636cbb18-19b2-4998-be5a-9fdff2f934d6 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:23:32.260265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-636cbb18-19b2-4998-be5a-9fdff2f934d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:23:32.325182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 624/1262] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:23:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:23:32.349698 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0de63-de14-49d6-bc53-67c60a790e9a None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:32.444161 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0de63-de14-49d6-bc53-67c60a790e9a None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:32.475357 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086a394-7bcf-4c40-85c7-d614822f5d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:32.476121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086a394-7bcf-4c40-85c7-d614822f5d72 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:32.476396 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086a394-7bcf-4c40-85c7-d614822f5d72 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:32.476689 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086a394-7bcf-4c40-85c7-d614822f5d72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:32.486139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086a394-7bcf-4c40-85c7-d614822f5d72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:23:32.494109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-0086a394-7bcf-4c40-85c7-d614822f5d72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:23:32.494109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:32.494109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:32.494109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:32.494109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:32.494109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:32.494109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:32.494109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:32.494109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:32.494109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:32.494109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:32.494109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:32.494109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:23:32.494109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:23:32.494109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:23:32.494109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:23:32.495218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:23:32.495218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:23:32.495218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:23:32.495218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:23:32.495218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:32.495218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:32.495218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:32.495218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:32.495218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:32.495218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:32.495218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:32.495218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:23:32.495218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:32.495218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:32.495218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:32.495218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:32.496268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:32.496268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:32.496268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:32.496268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:32.496268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:23:32.496268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:23:32.496268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:23:32.496268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:23:32.496268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:23:32.496268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:23:32.496268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:23:32.496268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:23:32.496268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 639/1263] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:23:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:23:32.503085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cbb18-19b2-4998-be5a-9fdff2f934d6 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:32.595641 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cbb18-19b2-4998-be5a-9fdff2f934d6 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:32.626519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b80983-2e1c-4931-b9ea-e0b3be6dadf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:32.627159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b80983-2e1c-4931-b9ea-e0b3be6dadf3 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:32.627432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b80983-2e1c-4931-b9ea-e0b3be6dadf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:32.627698 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b80983-2e1c-4931-b9ea-e0b3be6dadf3 None admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:32.628428 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b80983-2e1c-4931-b9ea-e0b3be6dadf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:32.628753 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b80983-2e1c-4931-b9ea-e0b3be6dadf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:32.630129 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b80983-2e1c-4931-b9ea-e0b3be6dadf3 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:32.637559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 625/1264] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:23:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:23:32.643127 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086a394-7bcf-4c40-85c7-d614822f5d72 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:32.740979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086a394-7bcf-4c40-85c7-d614822f5d72 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:32.771696 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5c31b-e07a-48db-abc5-c8490081604f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:32.772459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5c31b-e07a-48db-abc5-c8490081604f None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:32.772764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5c31b-e07a-48db-abc5-c8490081604f None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:32.773034 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5c31b-e07a-48db-abc5-c8490081604f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:32.782828 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5c31b-e07a-48db-abc5-c8490081604f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:32.784260 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5c31b-e07a-48db-abc5-c8490081604f None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:32.800891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-60f5c31b-e07a-48db-abc5-c8490081604f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:32.800891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:32.800891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:32.800891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:32.800891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:32.800891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:32.800891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:32.800891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:32.800891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:32.800891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:32.800891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:32.800891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:32.800891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:23:32.800891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:23:32.800891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:23:32.801897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:23:32.801897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:32.801897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:32.801897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:32.801897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:32.801897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:32.801897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:32.801897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:32.801897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:23:32.801897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:32.801897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:32.801897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:32.801897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:32.801897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:32.801897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:32.801897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:32.801897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:32.802989 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:23:32.802989 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:23:32.802989 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:32.802989 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:23:32.802989 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 640/1265] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:32.807405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b80983-2e1c-4931-b9ea-e0b3be6dadf3 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:32.902035 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b80983-2e1c-4931-b9ea-e0b3be6dadf3 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:32.932871 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea42aad-095b-42d9-9ee7-4eb801df002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:32.933545 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea42aad-095b-42d9-9ee7-4eb801df002f None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:32.933828 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea42aad-095b-42d9-9ee7-4eb801df002f None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:32.934102 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea42aad-095b-42d9-9ee7-4eb801df002f None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:32.934810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea42aad-095b-42d9-9ee7-4eb801df002f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:32.935113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea42aad-095b-42d9-9ee7-4eb801df002f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:32.936484 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea42aad-095b-42d9-9ee7-4eb801df002f None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:32.949737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 626/1266] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:32.955300 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5c31b-e07a-48db-abc5-c8490081604f None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:33.055464 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5c31b-e07a-48db-abc5-c8490081604f None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:33.090659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bf5ee-90c6-4a86-9e2f-969f3d65144b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:33.091692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bf5ee-90c6-4a86-9e2f-969f3d65144b None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:33.091975 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bf5ee-90c6-4a86-9e2f-969f3d65144b None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:33.092251 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bf5ee-90c6-4a86-9e2f-969f3d65144b None admin] PATH_INFO: `/v3/users/placement` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:33.099345 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bf5ee-90c6-4a86-9e2f-969f3d65144b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:33.100810 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bf5ee-90c6-4a86-9e2f-969f3d65144b None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:33.114564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-d92bf5ee-90c6-4a86-9e2f-969f3d65144b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 06 23:23:33.114564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:33.114564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:33.114564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:33.114564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:33.114564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:33.114564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:33.114564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:33.114564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:33.114564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:33.114564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:33.114564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:33.114564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:23:33.114564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:23:33.114564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:23:33.114564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:23:33.115635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:33.115635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:33.115635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:23:33.115635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:23:33.115635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:23:33.115635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:23:33.115635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:33.115635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:33.115635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:33.115635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:33.115635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:33.115635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:23:33.115635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:33.115635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:33.115635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:33.115635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:33.115635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:33.115635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:33.116893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:33.116893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:33.116893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:23:33.116893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:23:33.116893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:23:33.116893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:23:33.116893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:23:33.116893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:23:33.116893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 06 23:23:33.116893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:23:33.116893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 641/1267] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:23:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:33.121495 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea42aad-095b-42d9-9ee7-4eb801df002f None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:33.212618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea42aad-095b-42d9-9ee7-4eb801df002f None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:33.243921 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc8394-2388-488f-8fc1-1afd5fd4966b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:33.244580 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc8394-2388-488f-8fc1-1afd5fd4966b None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:33.244858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc8394-2388-488f-8fc1-1afd5fd4966b None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:33.245124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc8394-2388-488f-8fc1-1afd5fd4966b None admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:33.245936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc8394-2388-488f-8fc1-1afd5fd4966b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:33.246238 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc8394-2388-488f-8fc1-1afd5fd4966b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:33.247644 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc8394-2388-488f-8fc1-1afd5fd4966b None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:33.264021 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 627/1268] 10.222.0.60 () {56 vars in 1143 bytes} [Fri May 6 23:23:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:33.269387 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bf5ee-90c6-4a86-9e2f-969f3d65144b None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:33.371637 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bf5ee-90c6-4a86-9e2f-969f3d65144b None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:33.402695 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0314cb6-b137-4874-82d9-88c7bb42c2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:33.403475 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0314cb6-b137-4874-82d9-88c7bb42c2de None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:33.403756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0314cb6-b137-4874-82d9-88c7bb42c2de None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:33.404030 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0314cb6-b137-4874-82d9-88c7bb42c2de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:33.413999 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0314cb6-b137-4874-82d9-88c7bb42c2de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:33.415426 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0314cb6-b137-4874-82d9-88c7bb42c2de None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:33.432149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-a0314cb6-b137-4874-82d9-88c7bb42c2de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:33.432149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:33.432149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:33.432149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:33.432149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:33.432149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:33.432149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:33.432149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:33.432149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:33.432149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:33.432149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:33.432149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:33.432149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:23:33.432149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:23:33.432149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:23:33.433252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:23:33.433252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:33.433252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:33.433252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:33.433252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:33.433252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:33.433252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:33.433252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:33.433252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:23:33.433252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:33.433252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:33.433252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:33.433252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:33.433252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:33.433252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:33.433252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:33.433252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:33.434194 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:23:33.434194 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:23:33.434194 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:33.434194 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:23:33.434194 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 642/1269] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:33.439060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc8394-2388-488f-8fc1-1afd5fd4966b None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:33.531780 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc8394-2388-488f-8fc1-1afd5fd4966b None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:33.563318 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720441e-d3c7-4e92-bcb2-1e306217d231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:33.563963 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720441e-d3c7-4e92-bcb2-1e306217d231 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:33.564243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720441e-d3c7-4e92-bcb2-1e306217d231 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:33.564517 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720441e-d3c7-4e92-bcb2-1e306217d231 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:33.565252 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720441e-d3c7-4e92-bcb2-1e306217d231 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:33.565557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720441e-d3c7-4e92-bcb2-1e306217d231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:33.567490 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720441e-d3c7-4e92-bcb2-1e306217d231 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:33.577947 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 628/1270] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:33.583451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0314cb6-b137-4874-82d9-88c7bb42c2de None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:33.675599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0314cb6-b137-4874-82d9-88c7bb42c2de None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:33.706128 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9f5f9-bf7f-4ae3-a70f-b0eb29259af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:33.706880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9f5f9-bf7f-4ae3-a70f-b0eb29259af9 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:33.707179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9f5f9-bf7f-4ae3-a70f-b0eb29259af9 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:33.707450 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9f5f9-bf7f-4ae3-a70f-b0eb29259af9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:33.713821 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9f5f9-bf7f-4ae3-a70f-b0eb29259af9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:33.715279 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9f5f9-bf7f-4ae3-a70f-b0eb29259af9 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:33.730029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-b2e9f5f9-bf7f-4ae3-a70f-b0eb29259af9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:23:33.730029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:33.730029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:33.730029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:33.730029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:33.730029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:33.730029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:33.730029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:33.730029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:33.730029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:33.730029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:33.730029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:33.730029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:23:33.730029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:23:33.730029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:23:33.731044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:23:33.731044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:33.731044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:33.731044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:33.731044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:33.731044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:33.731044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:33.731044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:33.731044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:23:33.731044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:33.731044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:33.731044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:33.731044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:33.731044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:33.731044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:33.731044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:33.731044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:33.732153 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:23:33.732153 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:23:33.732153 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:23:33.732153 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:23:33.732153 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:23:33.732153 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:23:33.732153 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:23:33.732153 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:23:33.732153 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 643/1271] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:23:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:33.736891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720441e-d3c7-4e92-bcb2-1e306217d231 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:33.830455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720441e-d3c7-4e92-bcb2-1e306217d231 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:33.862277 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9f2ab-e2e8-4e91-a88b-c58e1ee2e0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:33.862921 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9f2ab-e2e8-4e91-a88b-c58e1ee2e0d7 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:33.863200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9f2ab-e2e8-4e91-a88b-c58e1ee2e0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:33.864112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9f2ab-e2e8-4e91-a88b-c58e1ee2e0d7 None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:33.864961 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9f2ab-e2e8-4e91-a88b-c58e1ee2e0d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:33.865267 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9f2ab-e2e8-4e91-a88b-c58e1ee2e0d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:33.866713 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9f2ab-e2e8-4e91-a88b-c58e1ee2e0d7 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:33.878261 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 629/1272] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:23:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:33.884037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9f5f9-bf7f-4ae3-a70f-b0eb29259af9 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:33.976365 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9f5f9-bf7f-4ae3-a70f-b0eb29259af9 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:34.007834 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253126f-119f-4830-9824-6f839d7d97b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:34.008790 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253126f-119f-4830-9824-6f839d7d97b5 None admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:34.009073 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253126f-119f-4830-9824-6f839d7d97b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:34.009349 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253126f-119f-4830-9824-6f839d7d97b5 None admin] PATH_INFO: `/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/fb1f7704fb5644688b8764bb1ce15734/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:34.011274 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253126f-119f-4830-9824-6f839d7d97b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=4389eb256aba4b7182e33cb3720b1073, user_id=fb1f7704fb5644688b8764bb1ce15734, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:34.012716 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253126f-119f-4830-9824-6f839d7d97b5 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:34.025941 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 644/1273] 10.222.0.60 () {58 vars in 1439 bytes} [Fri May 6 23:23:33 2022] PUT /identity/v3/projects/4389eb256aba4b7182e33cb3720b1073/users/fb1f7704fb5644688b8764bb1ce15734/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:23:36.176716 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1ed9e-fc4f-4417-ad9d-053992e3bd21 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:36.177232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1ed9e-fc4f-4417-ad9d-053992e3bd21 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:36.177232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1ed9e-fc4f-4417-ad9d-053992e3bd21 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:36.178545 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 630/1274] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:23:36.184976 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955162e8-ea25-4acd-8b26-8eb9712b2858 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:36.185395 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955162e8-ea25-4acd-8b26-8eb9712b2858 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:36.185506 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955162e8-ea25-4acd-8b26-8eb9712b2858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:36.201969 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-955162e8-ea25-4acd-8b26-8eb9712b2858 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:23:36.203122 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-955162e8-ea25-4acd-8b26-8eb9712b2858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:23:36.265486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 645/1275] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:23:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:23:36.288407 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1ed9e-fc4f-4417-ad9d-053992e3bd21 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:36.388589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1ed9e-fc4f-4417-ad9d-053992e3bd21 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:36.419223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb37930-2f1f-457a-b28e-c24085e5508a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:36.419992 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb37930-2f1f-457a-b28e-c24085e5508a None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:36.420268 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb37930-2f1f-457a-b28e-c24085e5508a None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:36.420567 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb37930-2f1f-457a-b28e-c24085e5508a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:36.430528 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb37930-2f1f-457a-b28e-c24085e5508a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 06 23:23:36.437891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-fdb37930-2f1f-457a-b28e-c24085e5508a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:23:36.437891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:36.437891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:36.437891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:36.437891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:36.437891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:36.437891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:36.437891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:36.437891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:36.437891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:36.437891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:36.437891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:36.437891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 06 23:23:36.437891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(role_id) May 06 23:23:36.437891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 06 23:23:36.437891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 06 23:23:36.438976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 06 23:23:36.438976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 06 23:23:36.438976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 06 23:23:36.438976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 06 23:23:36.438976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:36.438976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:36.438976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:36.438976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:36.438976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:36.438976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:36.438976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:36.438976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:23:36.438976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:36.438976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:36.438976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:36.438976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:36.445475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:36.445475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:36.445475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:36.445475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:36.445475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 06 23:23:36.445475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 06 23:23:36.445475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 06 23:23:36.445475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 06 23:23:36.445475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 06 23:23:36.445475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 06 23:23:36.445475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 06 23:23:36.445475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:36.445475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 631/1276] 10.222.0.60 () {56 vars in 1096 bytes} [Fri May 6 23:23:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:23:36.446353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955162e8-ea25-4acd-8b26-8eb9712b2858 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:36.536141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955162e8-ea25-4acd-8b26-8eb9712b2858 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:36.568109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa2782-ff67-49df-af96-0e1cd0290ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:36.568809 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa2782-ff67-49df-af96-0e1cd0290ed8 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:36.569079 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa2782-ff67-49df-af96-0e1cd0290ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:36.569351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa2782-ff67-49df-af96-0e1cd0290ed8 None admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:36.570096 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa2782-ff67-49df-af96-0e1cd0290ed8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:36.570397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa2782-ff67-49df-af96-0e1cd0290ed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:36.571752 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa2782-ff67-49df-af96-0e1cd0290ed8 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:36.579339 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 646/1277] 10.222.0.60 () {56 vars in 1099 bytes} [Fri May 6 23:23:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:36.584799 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb37930-2f1f-457a-b28e-c24085e5508a None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:36.677345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb37930-2f1f-457a-b28e-c24085e5508a None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:36.707584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540afda-93ac-425e-9d67-efd36fd647be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:36.708273 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540afda-93ac-425e-9d67-efd36fd647be None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:36.708572 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540afda-93ac-425e-9d67-efd36fd647be None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:36.708847 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540afda-93ac-425e-9d67-efd36fd647be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:36.718848 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540afda-93ac-425e-9d67-efd36fd647be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:36.720266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540afda-93ac-425e-9d67-efd36fd647be None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:36.736705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-4540afda-93ac-425e-9d67-efd36fd647be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:36.736705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:36.736705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:36.736705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:36.736705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:36.736705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:36.736705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:36.736705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:36.736705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:36.736705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:36.736705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:36.736705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:36.736705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:23:36.736705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:23:36.736705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:23:36.737802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:23:36.737802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:36.737802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:36.737802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:36.737802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:36.737802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:36.737802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:36.737802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:36.737802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:23:36.737802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:36.737802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:36.737802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:36.737802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:36.737802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:36.737802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:36.737802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:36.737802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:36.739356 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:23:36.739356 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:23:36.739356 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:36.739356 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:36.739356 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 632/1278] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:23:36.743842 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa2782-ff67-49df-af96-0e1cd0290ed8 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:36.835766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa2782-ff67-49df-af96-0e1cd0290ed8 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:36.867976 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41529d4-822a-4d8c-a8a5-09b902164a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:36.868652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41529d4-822a-4d8c-a8a5-09b902164a7d None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:36.868943 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41529d4-822a-4d8c-a8a5-09b902164a7d None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:36.869218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41529d4-822a-4d8c-a8a5-09b902164a7d None admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:36.869934 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41529d4-822a-4d8c-a8a5-09b902164a7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:36.870233 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41529d4-822a-4d8c-a8a5-09b902164a7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:36.871618 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41529d4-822a-4d8c-a8a5-09b902164a7d None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:36.882892 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 647/1279] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:36.888473 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540afda-93ac-425e-9d67-efd36fd647be None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:36.981670 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540afda-93ac-425e-9d67-efd36fd647be None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:37.012735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f5ff6-d752-4d41-aa2b-e9b99ca06944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:37.013511 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f5ff6-d752-4d41-aa2b-e9b99ca06944 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:37.013792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f5ff6-d752-4d41-aa2b-e9b99ca06944 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:37.014066 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f5ff6-d752-4d41-aa2b-e9b99ca06944 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:37.021592 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f5ff6-d752-4d41-aa2b-e9b99ca06944 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:37.023048 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f5ff6-d752-4d41-aa2b-e9b99ca06944 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:37.037275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-8a5f5ff6-d752-4d41-aa2b-e9b99ca06944 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 06 23:23:37.037275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:37.037275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:37.037275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:37.037275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:37.037275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:37.037275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:37.037275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:37.037275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:37.037275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:37.037275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:37.037275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:37.037275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 06 23:23:37.037275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_user(user_id) May 06 23:23:37.037275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 06 23:23:37.037275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 06 23:23:37.038392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:37.038392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:37.038392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 06 23:23:37.038392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:23:37.038392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 06 23:23:37.038392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 06 23:23:37.038392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:37.038392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:37.038392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:37.038392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:37.038392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:37.038392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:23:37.038392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:37.038392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:37.038392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:37.038392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:37.038392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:37.038392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:37.039740 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:37.039740 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:37.039740 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 06 23:23:37.039740 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 06 23:23:37.039740 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 06 23:23:37.039740 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 06 23:23:37.039740 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 06 23:23:37.039740 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 06 23:23:37.039740 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 06 23:23:37.039740 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:37.039740 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 633/1280] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:23:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:37.044088 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41529d4-822a-4d8c-a8a5-09b902164a7d None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:37.136906 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41529d4-822a-4d8c-a8a5-09b902164a7d None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:37.169359 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ae21f-f334-4dad-b0f6-80ffc82784b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:37.169999 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ae21f-f334-4dad-b0f6-80ffc82784b7 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:37.170273 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ae21f-f334-4dad-b0f6-80ffc82784b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:37.170543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ae21f-f334-4dad-b0f6-80ffc82784b7 None admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:37.171355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ae21f-f334-4dad-b0f6-80ffc82784b7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:37.171657 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ae21f-f334-4dad-b0f6-80ffc82784b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:37.173080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ae21f-f334-4dad-b0f6-80ffc82784b7 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:37.189021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 648/1281] 10.222.0.60 () {56 vars in 1143 bytes} [Fri May 6 23:23:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:37.194411 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f5ff6-d752-4d41-aa2b-e9b99ca06944 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:37.292450 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f5ff6-d752-4d41-aa2b-e9b99ca06944 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:37.333929 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b05bd-b11d-47e2-805c-20c669d0ffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:37.334568 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b05bd-b11d-47e2-805c-20c669d0ffd4 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:37.334846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b05bd-b11d-47e2-805c-20c669d0ffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:37.335118 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b05bd-b11d-47e2-805c-20c669d0ffd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:37.397602 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b05bd-b11d-47e2-805c-20c669d0ffd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:37.399053 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b05bd-b11d-47e2-805c-20c669d0ffd4 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:37.487457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 634/1282] 10.222.0.60 () {58 vars in 1282 bytes} [Fri May 6 23:23:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 06 23:23:37.493226 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ae21f-f334-4dad-b0f6-80ffc82784b7 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:37.585570 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ae21f-f334-4dad-b0f6-80ffc82784b7 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:37.616459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dab8bb-bb81-418d-8579-3c4242743154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:37.617254 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dab8bb-bb81-418d-8579-3c4242743154 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:37.617531 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dab8bb-bb81-418d-8579-3c4242743154 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:37.617802 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dab8bb-bb81-418d-8579-3c4242743154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:37.627281 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dab8bb-bb81-418d-8579-3c4242743154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:37.628743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dab8bb-bb81-418d-8579-3c4242743154 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:37.645868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-a8dab8bb-bb81-418d-8579-3c4242743154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:37.645868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:37.645868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:37.645868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:37.645868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:37.645868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:37.645868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:37.645868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:37.645868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:37.645868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:37.645868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:37.645868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:37.645868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 06 23:23:37.645868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 06 23:23:37.645868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 06 23:23:37.646929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 06 23:23:37.646929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:37.646929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:37.646929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:37.646929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:37.646929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:37.646929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:37.646929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:37.646929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:23:37.646929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:37.646929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:37.646929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:37.646929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:37.646929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:37.646929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:37.646929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:37.646929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:37.652794 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 06 23:23:37.652794 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 06 23:23:37.652794 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 06 23:23:37.652794 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:23:37.652794 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 649/1283] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:37.653086 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b05bd-b11d-47e2-805c-20c669d0ffd4 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:37.754524 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b05bd-b11d-47e2-805c-20c669d0ffd4 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:37.787038 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecebad-1ab8-4248-bb56-a1ca8cb56ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:37.787684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecebad-1ab8-4248-bb56-a1ca8cb56ef5 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:37.787966 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecebad-1ab8-4248-bb56-a1ca8cb56ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:37.788240 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecebad-1ab8-4248-bb56-a1ca8cb56ef5 None admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:37.788977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecebad-1ab8-4248-bb56-a1ca8cb56ef5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:37.789283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecebad-1ab8-4248-bb56-a1ca8cb56ef5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:37.790641 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecebad-1ab8-4248-bb56-a1ca8cb56ef5 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:37.801364 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 635/1284] 10.222.0.60 () {56 vars in 1109 bytes} [Fri May 6 23:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:37.806975 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dab8bb-bb81-418d-8579-3c4242743154 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:37.899126 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dab8bb-bb81-418d-8579-3c4242743154 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:37.930491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e924a9-9bd0-443b-9411-b70a6d1d38dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:37.931274 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e924a9-9bd0-443b-9411-b70a6d1d38dc None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:37.931555 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e924a9-9bd0-443b-9411-b70a6d1d38dc None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:37.931824 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e924a9-9bd0-443b-9411-b70a6d1d38dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:37.938366 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e924a9-9bd0-443b-9411-b70a6d1d38dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:37.939804 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e924a9-9bd0-443b-9411-b70a6d1d38dc None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:37.953048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application [None req-b9e924a9-9bd0-443b-9411-b70a6d1d38dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:23:37.953048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:37.953048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:37.953048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:37.953048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:37.953048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:37.953048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:37.953048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:37.953048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:37.953048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:37.953048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:37.953048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:37.953048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 06 23:23:37.953048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(project_id) May 06 23:23:37.953048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 06 23:23:37.954083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 06 23:23:37.954083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:37.954083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:37.954083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:37.954083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:37.954083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:37.954083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:37.954083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:37.954083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application with Lock( May 06 23:23:37.954083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:37.954083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:37.954083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:37.954083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:37.954083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:37.954083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:37.954083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:37.954083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:37.955195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 06 23:23:37.955195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 06 23:23:37.955195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 06 23:23:37.955195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 06 23:23:37.955195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 06 23:23:37.955195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 06 23:23:37.955195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 06 23:23:37.955195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: ERROR keystone.server.flask.application May 06 23:23:37.955195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 650/1285] 10.222.0.60 () {56 vars in 1111 bytes} [Fri May 6 23:23:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:37.960477 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecebad-1ab8-4248-bb56-a1ca8cb56ef5 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:38.053113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecebad-1ab8-4248-bb56-a1ca8cb56ef5 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:38.085028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7442fe5-2763-4b77-a9c0-1b309bc77855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:38.085701 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7442fe5-2763-4b77-a9c0-1b309bc77855 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:38.085987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7442fe5-2763-4b77-a9c0-1b309bc77855 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:38.086411 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7442fe5-2763-4b77-a9c0-1b309bc77855 None admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:38.087049 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7442fe5-2763-4b77-a9c0-1b309bc77855 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:38.087358 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7442fe5-2763-4b77-a9c0-1b309bc77855 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:38.088875 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7442fe5-2763-4b77-a9c0-1b309bc77855 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:38.106785 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 636/1286] 10.222.0.60 () {56 vars in 1148 bytes} [Fri May 6 23:23:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:38.112741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e924a9-9bd0-443b-9411-b70a6d1d38dc None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:38.205715 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e924a9-9bd0-443b-9411-b70a6d1d38dc None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:38.237013 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171aba91-d10b-4a6d-9a67-fb8ade9b90f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:38.237654 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171aba91-d10b-4a6d-9a67-fb8ade9b90f8 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:38.237932 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171aba91-d10b-4a6d-9a67-fb8ade9b90f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:38.238205 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171aba91-d10b-4a6d-9a67-fb8ade9b90f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:38.239076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171aba91-d10b-4a6d-9a67-fb8ade9b90f8 None admin] RBAC: Adding query filter params (role.id=408ee9a3a38640a48dbcdb2c377efcd8, scope.project.id=4389eb256aba4b7182e33cb3720b1073, user.id=fb1f7704fb5644688b8764bb1ce15734) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:38.239384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171aba91-d10b-4a6d-9a67-fb8ade9b90f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:38.240831 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171aba91-d10b-4a6d-9a67-fb8ade9b90f8 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:38.246377 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 651/1287] 10.222.0.60 () {56 vars in 1374 bytes} [Fri May 6 23:23:38 2022] GET /identity/v3/role_assignments?user.id=fb1f7704fb5644688b8764bb1ce15734&scope.project.id=4389eb256aba4b7182e33cb3720b1073&role.id=408ee9a3a38640a48dbcdb2c377efcd8 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:40.478064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e9239-fec0-48e5-a943-a093a98688f5 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:40.478590 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e9239-fec0-48e5-a943-a093a98688f5 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:40.478590 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e9239-fec0-48e5-a943-a093a98688f5 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:40.479964 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 637/1288] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:23:40.485219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f59b6-c7a8-4876-862a-877993ada472 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:40.485637 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f59b6-c7a8-4876-862a-877993ada472 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:40.485773 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f59b6-c7a8-4876-862a-877993ada472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:40.501897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-434f59b6-c7a8-4876-862a-877993ada472 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:23:40.503066 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-434f59b6-c7a8-4876-862a-877993ada472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:23:40.564808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 652/1289] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:23:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:23:40.586426 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e9239-fec0-48e5-a943-a093a98688f5 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:40.685464 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e9239-fec0-48e5-a943-a093a98688f5 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:40.716366 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5cc43-478d-4bb7-aaa0-bf021e4a83af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:40.717166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5cc43-478d-4bb7-aaa0-bf021e4a83af None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:40.717442 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5cc43-478d-4bb7-aaa0-bf021e4a83af None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:40.717708 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5cc43-478d-4bb7-aaa0-bf021e4a83af None admin] PATH_INFO: `/v3/services/placement` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:40.718343 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5cc43-478d-4bb7-aaa0-bf021e4a83af None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:40.719704 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5cc43-478d-4bb7-aaa0-bf021e4a83af None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:40.731462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-5bb5cc43-478d-4bb7-aaa0-bf021e4a83af None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 06 23:23:40.731462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:40.731462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:23:40.731462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:23:40.731462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:23:40.731462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:23:40.731462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:23:40.731462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:23:40.731462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 06 23:23:40.731462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:40.731462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:23:40.731462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:40.731462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:40.731462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:40.731462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:40.731462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:40.731462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:40.732775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:40.732775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:40.732775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:40.732775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:40.732775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:40.732775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:40.732775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:23:40.732775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:23:40.732775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:23:40.732775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:23:40.732775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:40.732775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:40.732775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:40.732775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:40.732775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:40.732775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:40.733946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:40.733946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:23:40.733946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:40.733946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:40.733946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:40.733946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:40.733946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:40.733946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:40.733946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:40.733946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:40.733946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:23:40.733946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:23:40.733946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 06 23:23:40.733946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:40.733946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 638/1290] 10.222.0.60 () {56 vars in 1117 bytes} [Fri May 6 23:23:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 06 23:23:40.739281 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f59b6-c7a8-4876-862a-877993ada472 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:40.830610 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f59b6-c7a8-4876-862a-877993ada472 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:40.863903 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908cbdf-8fca-4f4e-9657-34fa4a8cbca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:40.864574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908cbdf-8fca-4f4e-9657-34fa4a8cbca9 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:40.864858 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908cbdf-8fca-4f4e-9657-34fa4a8cbca9 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:40.865129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908cbdf-8fca-4f4e-9657-34fa4a8cbca9 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:40.865821 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908cbdf-8fca-4f4e-9657-34fa4a8cbca9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:40.866125 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908cbdf-8fca-4f4e-9657-34fa4a8cbca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:40.867486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908cbdf-8fca-4f4e-9657-34fa4a8cbca9 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:40.872060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 653/1291] 10.222.0.60 () {56 vars in 1116 bytes} [Fri May 6 23:23:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:40.877649 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5cc43-478d-4bb7-aaa0-bf021e4a83af None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:40.977645 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5cc43-478d-4bb7-aaa0-bf021e4a83af None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:41.008822 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cab8b-aea4-4da9-b161-a433947a9827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:41.009408 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cab8b-aea4-4da9-b161-a433947a9827 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:41.009689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cab8b-aea4-4da9-b161-a433947a9827 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:41.009961 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cab8b-aea4-4da9-b161-a433947a9827 None admin] PATH_INFO: `/v3/services` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:41.010661 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96cab8b-aea4-4da9-b161-a433947a9827 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:41.010963 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96cab8b-aea4-4da9-b161-a433947a9827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:41.012342 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96cab8b-aea4-4da9-b161-a433947a9827 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:41.016706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 639/1292] 10.222.0.60 () {56 vars in 1116 bytes} [Fri May 6 23:23:40 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:43.180252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ef122-1b28-4b4f-b9a6-1a56b9d063e0 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:43.180798 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ef122-1b28-4b4f-b9a6-1a56b9d063e0 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:43.180798 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ef122-1b28-4b4f-b9a6-1a56b9d063e0 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:43.182114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 654/1293] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:23:43.187431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be3191-7479-481f-918e-ba539f1ac353 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:43.187795 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be3191-7479-481f-918e-ba539f1ac353 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:43.187971 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be3191-7479-481f-918e-ba539f1ac353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:43.204479 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-33be3191-7479-481f-918e-ba539f1ac353 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:23:43.205670 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-33be3191-7479-481f-918e-ba539f1ac353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:23:43.266173 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 640/1294] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:23:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:23:43.288811 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ef122-1b28-4b4f-b9a6-1a56b9d063e0 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:43.392149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ef122-1b28-4b4f-b9a6-1a56b9d063e0 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:43.423470 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896ee7c-641f-4df6-8322-df6e01f196e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:43.424120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896ee7c-641f-4df6-8322-df6e01f196e3 None admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:43.424399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896ee7c-641f-4df6-8322-df6e01f196e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:43.424703 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896ee7c-641f-4df6-8322-df6e01f196e3 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:43.425428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896ee7c-641f-4df6-8322-df6e01f196e3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:43.426777 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896ee7c-641f-4df6-8322-df6e01f196e3 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:43.438597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 655/1295] 10.222.0.60 () {60 vars in 1141 bytes} [Fri May 6 23:23:43 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:23:45.625007 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab2923-7b75-4769-b536-fa800904fc5f None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:45.625564 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab2923-7b75-4769-b536-fa800904fc5f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:45.625564 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab2923-7b75-4769-b536-fa800904fc5f None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:45.626920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 641/1296] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:23:45.632508 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a50d04-daa5-4c3b-a365-07c9af381a3c None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:45.632971 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a50d04-daa5-4c3b-a365-07c9af381a3c None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:45.633085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a50d04-daa5-4c3b-a365-07c9af381a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:45.649779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-e8a50d04-daa5-4c3b-a365-07c9af381a3c None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:23:45.650947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-e8a50d04-daa5-4c3b-a365-07c9af381a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:23:45.718585 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 656/1297] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:23:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:23:45.740368 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab2923-7b75-4769-b536-fa800904fc5f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:45.834075 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab2923-7b75-4769-b536-fa800904fc5f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:45.866832 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba82eb9-def0-47cb-9bd2-4e6a234109df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:45.867608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba82eb9-def0-47cb-9bd2-4e6a234109df None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:45.867888 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba82eb9-def0-47cb-9bd2-4e6a234109df None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:45.868159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba82eb9-def0-47cb-9bd2-4e6a234109df None admin] PATH_INFO: `/v3/services/placement` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:45.868833 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba82eb9-def0-47cb-9bd2-4e6a234109df None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:45.870192 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba82eb9-def0-47cb-9bd2-4e6a234109df None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:45.881579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-3ba82eb9-def0-47cb-9bd2-4e6a234109df None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 06 23:23:45.881579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:45.881579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:23:45.881579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:23:45.881579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:23:45.881579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:23:45.881579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:23:45.881579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:23:45.881579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 06 23:23:45.881579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:45.881579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:23:45.881579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:45.881579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:45.881579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:45.881579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:45.881579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:45.881579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:45.882718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:45.882718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:45.882718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:45.882718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:45.882718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:45.882718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:45.882718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:23:45.882718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:23:45.882718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:23:45.882718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:23:45.882718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:45.882718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:45.882718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:45.882718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:45.882718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:45.882718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:45.883556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:45.883556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:23:45.883556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:45.883556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:45.883556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:45.883556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:45.883556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:45.883556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:45.883556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:45.883556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:45.883556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:23:45.883556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:23:45.883556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 06 23:23:45.883556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:45.883556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 642/1298] 10.222.0.60 () {56 vars in 1117 bytes} [Fri May 6 23:23:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:45.888691 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a50d04-daa5-4c3b-a365-07c9af381a3c None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:45.979129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a50d04-daa5-4c3b-a365-07c9af381a3c None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:46.010199 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1978ec-5b7c-46a7-8044-efc5b19e08c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:46.010830 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1978ec-5b7c-46a7-8044-efc5b19e08c9 None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:46.011107 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1978ec-5b7c-46a7-8044-efc5b19e08c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:46.011377 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1978ec-5b7c-46a7-8044-efc5b19e08c9 None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:46.012063 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1978ec-5b7c-46a7-8044-efc5b19e08c9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:46.012362 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1978ec-5b7c-46a7-8044-efc5b19e08c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:46.013742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1978ec-5b7c-46a7-8044-efc5b19e08c9 None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:46.018515 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 657/1299] 10.222.0.60 () {56 vars in 1116 bytes} [Fri May 6 23:23:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:46.024587 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba82eb9-def0-47cb-9bd2-4e6a234109df None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:46.118191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba82eb9-def0-47cb-9bd2-4e6a234109df None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:46.148942 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785bd5b-1bd8-45a7-a3ab-5a127f14923f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:46.149515 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785bd5b-1bd8-45a7-a3ab-5a127f14923f None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:46.149795 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785bd5b-1bd8-45a7-a3ab-5a127f14923f None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:46.150068 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785bd5b-1bd8-45a7-a3ab-5a127f14923f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:46.150842 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785bd5b-1bd8-45a7-a3ab-5a127f14923f None admin] RBAC: Adding query filter params (interface=public, service_id=5962c31c340b409d9693d8ed4de01413, region_id=RegionOne) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:46.151149 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785bd5b-1bd8-45a7-a3ab-5a127f14923f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:46.152513 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785bd5b-1bd8-45a7-a3ab-5a127f14923f None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:46.157233 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 643/1300] 10.222.0.60 () {56 vars in 1251 bytes} [Fri May 6 23:23:46 2022] GET /identity/v3/endpoints?service_id=5962c31c340b409d9693d8ed4de01413&interface=public®ion_id=RegionOne => generated 194 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:46.162783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1978ec-5b7c-46a7-8044-efc5b19e08c9 None admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:46.255180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1978ec-5b7c-46a7-8044-efc5b19e08c9 None admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:46.285564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018d82b-b93f-4cc2-872c-666191b4a41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:46.286225 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018d82b-b93f-4cc2-872c-666191b4a41c None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:46.286505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018d82b-b93f-4cc2-872c-666191b4a41c None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:46.286780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018d82b-b93f-4cc2-872c-666191b4a41c None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:46.287470 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018d82b-b93f-4cc2-872c-666191b4a41c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:46.288862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018d82b-b93f-4cc2-872c-666191b4a41c None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:46.295561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 658/1301] 10.222.0.60 () {56 vars in 1087 bytes} [Fri May 6 23:23:46 2022] GET /identity/v3/services => generated 2191 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:23:48.470880 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73799d4-ef53-4fc7-b5a0-b64ed524acbb None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:48.471457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73799d4-ef53-4fc7-b5a0-b64ed524acbb None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:48.471457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73799d4-ef53-4fc7-b5a0-b64ed524acbb None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:48.472933 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 644/1302] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:23:48.478025 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617225b-abb8-4c26-8674-d6c2ebbe9257 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:48.478396 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617225b-abb8-4c26-8674-d6c2ebbe9257 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:48.478580 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617225b-abb8-4c26-8674-d6c2ebbe9257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:48.495183 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-4617225b-abb8-4c26-8674-d6c2ebbe9257 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:23:48.496351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-4617225b-abb8-4c26-8674-d6c2ebbe9257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:23:48.557747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 659/1303] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:23:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 06 23:23:48.579413 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73799d4-ef53-4fc7-b5a0-b64ed524acbb None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:48.680289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73799d4-ef53-4fc7-b5a0-b64ed524acbb None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:48.711920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccd425-5cc9-4662-b7e3-5ecf1d37c0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:48.712878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd425-5cc9-4662-b7e3-5ecf1d37c0e8 None admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:48.713163 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd425-5cc9-4662-b7e3-5ecf1d37c0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:48.713434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd425-5cc9-4662-b7e3-5ecf1d37c0e8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:48.714107 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccd425-5cc9-4662-b7e3-5ecf1d37c0e8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:48.715578 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccd425-5cc9-4662-b7e3-5ecf1d37c0e8 None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:48.727200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application [None req-cfccd425-5cc9-4662-b7e3-5ecf1d37c0e8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 06 23:23:48.727200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:48.727200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 06 23:23:48.727200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 06 23:23:48.727200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 06 23:23:48.727200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 06 23:23:48.727200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 06 23:23:48.727200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:23:48.727200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 06 23:23:48.727200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:48.727200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 06 23:23:48.727200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:48.727200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application Traceback (most recent call last): May 06 23:23:48.727200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 06 23:23:48.727200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 06 23:23:48.727200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 06 23:23:48.727200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 06 23:23:48.728372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 06 23:23:48.728372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 06 23:23:48.728372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 06 23:23:48.728372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 06 23:23:48.728372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 06 23:23:48.728372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 06 23:23:48.728372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 06 23:23:48.728372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._get_service(service_id) May 06 23:23:48.728372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 06 23:23:48.728372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 06 23:23:48.728372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 06 23:23:48.728372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 06 23:23:48.728372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 06 23:23:48.728372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 06 23:23:48.728372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 06 23:23:48.728372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.get_or_create( May 06 23:23:48.729618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 06 23:23:48.729618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application with Lock( May 06 23:23:48.729618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 06 23:23:48.729618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self._enter() May 06 23:23:48.729618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 06 23:23:48.729618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 06 23:23:48.729618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 06 23:23:48.729618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application return self.creator() May 06 23:23:48.729618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 06 23:23:48.729618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application created_value = creator( May 06 23:23:48.729618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 06 23:23:48.729618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 06 23:23:48.729618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 06 23:23:48.729618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: ERROR keystone.server.flask.application May 06 23:23:48.729618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 645/1304] 10.222.0.60 () {56 vars in 1117 bytes} [Fri May 6 23:23:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 06 23:23:48.734357 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617225b-abb8-4c26-8674-d6c2ebbe9257 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:48.826478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617225b-abb8-4c26-8674-d6c2ebbe9257 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:48.859334 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eda110-4a7e-4ba3-802e-91dde694fa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:48.859986 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eda110-4a7e-4ba3-802e-91dde694fa0c None admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:48.860264 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eda110-4a7e-4ba3-802e-91dde694fa0c None admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:48.860566 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eda110-4a7e-4ba3-802e-91dde694fa0c None admin] PATH_INFO: `/v3/services` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:48.861267 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eda110-4a7e-4ba3-802e-91dde694fa0c None admin] RBAC: Adding query filter params (name=placement) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:23:48.861570 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eda110-4a7e-4ba3-802e-91dde694fa0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:48.862932 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eda110-4a7e-4ba3-802e-91dde694fa0c None admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:48.867811 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 660/1305] 10.222.0.60 () {56 vars in 1116 bytes} [Fri May 6 23:23:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:23:48.873444 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccd425-5cc9-4662-b7e3-5ecf1d37c0e8 None admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:23:48.967508 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccd425-5cc9-4662-b7e3-5ecf1d37c0e8 None admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:23:48.998865 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502c324-f483-41d1-97ce-662b5c1c0c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:23:48.999441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502c324-f483-41d1-97ce-662b5c1c0c5e None admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:23:48.999722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502c324-f483-41d1-97ce-662b5c1c0c5e None admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:23:48.999996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502c324-f483-41d1-97ce-662b5c1c0c5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:23:49.000764 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502c324-f483-41d1-97ce-662b5c1c0c5e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:23:49.002125 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502c324-f483-41d1-97ce-662b5c1c0c5e None admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:23:49.020121 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 646/1306] 10.222.0.60 () {60 vars in 1144 bytes} [Fri May 6 23:23:48 2022] POST /identity/v3/endpoints => generated 331 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:24:51.717540 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3caff-924c-444d-bed4-9505f9043bc9 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:24:51.718644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3caff-924c-444d-bed4-9505f9043bc9 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:24:51.719142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3caff-924c-444d-bed4-9505f9043bc9 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:24:51.721880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 661/1307] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:24:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:24:51.726692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190f4d0-2ca4-410a-8bb0-325f89a9b9ff None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:24:51.727495 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190f4d0-2ca4-410a-8bb0-325f89a9b9ff None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:24:51.727787 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190f4d0-2ca4-410a-8bb0-325f89a9b9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:24:51.806353 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-3190f4d0-2ca4-410a-8bb0-325f89a9b9ff None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:24:51.807909 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-3190f4d0-2ca4-410a-8bb0-325f89a9b9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:24:51.933606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 647/1308] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:24:51.983965 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa304fc8-0538-4c3b-93d7-df1cb463fdd1 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:24:51.984349 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa304fc8-0538-4c3b-93d7-df1cb463fdd1 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:24:51.984521 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa304fc8-0538-4c3b-93d7-df1cb463fdd1 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:24:51.986176 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 662/1309] 10.222.0.60 () {54 vars in 964 bytes} [Fri May 6 23:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:24:51.992777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcca62-3fd1-4a6a-a883-feabda2c0429 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:24:51.993081 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcca62-3fd1-4a6a-a883-feabda2c0429 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:24:51.993358 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcca62-3fd1-4a6a-a883-feabda2c0429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:24:52.081594 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-e1dcca62-3fd1-4a6a-a883-feabda2c0429 None None] MFA Rules not processed for user `046352b8553c4f23b6dda151f6f7ce00`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:24:52.082880 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e1dcca62-3fd1-4a6a-a883-feabda2c0429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:24:52.164679 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 648/1310] 10.222.0.60 () {58 vars in 1061 bytes} [Fri May 6 23:24:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:24:52.176115 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa304fc8-0538-4c3b-93d7-df1cb463fdd1 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:24:52.180146 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-aa304fc8-0538-4c3b-93d7-df1cb463fdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:24:52.315910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa304fc8-0538-4c3b-93d7-df1cb463fdd1 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:24:52.387308 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ababb6-ed4e-42d2-ab75-f9d25ed710a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:24:52.387959 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ababb6-ed4e-42d2-ab75-f9d25ed710a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:24:52.388237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ababb6-ed4e-42d2-ab75-f9d25ed710a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:24:52.388503 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ababb6-ed4e-42d2-ab75-f9d25ed710a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:24:52.391247 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-48ababb6-ed4e-42d2-ab75-f9d25ed710a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:24:52.498446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ababb6-ed4e-42d2-ab75-f9d25ed710a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:24:52.499840 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ababb6-ed4e-42d2-ab75-f9d25ed710a6 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:24:52.519253 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 663/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:24:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:24:55.046032 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b019782-ce82-44ba-a6dc-351c3b2398f5 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:24:55.046476 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b019782-ce82-44ba-a6dc-351c3b2398f5 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:24:55.046586 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b019782-ce82-44ba-a6dc-351c3b2398f5 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:24:55.048107 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 649/1312] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:24:55.053463 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dec8da-c950-44f2-8dc3-517631bf4697 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:24:55.054242 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dec8da-c950-44f2-8dc3-517631bf4697 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:24:55.054517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dec8da-c950-44f2-8dc3-517631bf4697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:24:55.141467 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-36dec8da-c950-44f2-8dc3-517631bf4697 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:24:55.143547 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-36dec8da-c950-44f2-8dc3-517631bf4697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:24:55.243702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 664/1313] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:24:55.291185 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b019782-ce82-44ba-a6dc-351c3b2398f5 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:24:55.292799 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-0b019782-ce82-44ba-a6dc-351c3b2398f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:24:55.393207 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b019782-ce82-44ba-a6dc-351c3b2398f5 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:24:55.466408 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3431f-c765-4691-8325-a145bb986561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:24:55.467313 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3431f-c765-4691-8325-a145bb986561 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:24:55.467594 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3431f-c765-4691-8325-a145bb986561 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:24:55.467867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3431f-c765-4691-8325-a145bb986561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:24:55.469527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-fcc3431f-c765-4691-8325-a145bb986561 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:24:55.572504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3431f-c765-4691-8325-a145bb986561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:24:55.575025 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3431f-c765-4691-8325-a145bb986561 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:24:55.598234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 650/1314] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:24:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:24:58.116159 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a20ab6-ebdc-458d-bcee-b4ec1fdbb674 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:24:58.116746 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a20ab6-ebdc-458d-bcee-b4ec1fdbb674 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:24:58.116746 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a20ab6-ebdc-458d-bcee-b4ec1fdbb674 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:24:58.118110 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 665/1315] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:24:58.123232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ccc4a-3670-4378-8a95-b37a9639bf41 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:24:58.123680 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ccc4a-3670-4378-8a95-b37a9639bf41 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:24:58.123810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ccc4a-3670-4378-8a95-b37a9639bf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:24:58.194772 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-f86ccc4a-3670-4378-8a95-b37a9639bf41 None None] MFA Rules not processed for user `7653c14067224481aa0bb76e61dcb69e`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:24:58.195953 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f86ccc4a-3670-4378-8a95-b37a9639bf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:24:58.297177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 651/1316] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:24:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:24:58.336722 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a20ab6-ebdc-458d-bcee-b4ec1fdbb674 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:24:58.338255 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-73a20ab6-ebdc-458d-bcee-b4ec1fdbb674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:24:58.451214 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a20ab6-ebdc-458d-bcee-b4ec1fdbb674 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:24:58.523281 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb1adb-aef3-4e24-8903-163726dddbf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:24:58.523930 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb1adb-aef3-4e24-8903-163726dddbf7 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:24:58.524212 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb1adb-aef3-4e24-8903-163726dddbf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:24:58.524485 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb1adb-aef3-4e24-8903-163726dddbf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:24:58.526160 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-79eb1adb-aef3-4e24-8903-163726dddbf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:24:58.629534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb1adb-aef3-4e24-8903-163726dddbf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:24:58.630975 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb1adb-aef3-4e24-8903-163726dddbf7 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:24:58.648845 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 666/1317] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:24:58 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:25:01.439142 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140ca97-d026-421e-90ac-33a676aeba90 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:01.440261 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140ca97-d026-421e-90ac-33a676aeba90 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:01.440261 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140ca97-d026-421e-90ac-33a676aeba90 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:01.441614 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 652/1318] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:25:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:01.446975 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef05f7-4285-444d-9032-702ca77dcb00 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:01.447429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef05f7-4285-444d-9032-702ca77dcb00 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:01.447537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef05f7-4285-444d-9032-702ca77dcb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:01.510507 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-eaef05f7-4285-444d-9032-702ca77dcb00 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:01.511721 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-eaef05f7-4285-444d-9032-702ca77dcb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:01.604363 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 667/1319] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:25:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:01.641725 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140ca97-d026-421e-90ac-33a676aeba90 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:25:01.643857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c140ca97-d026-421e-90ac-33a676aeba90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:01.741152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140ca97-d026-421e-90ac-33a676aeba90 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:25:01.809955 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5cab6-014d-4839-92fc-7639fa5afb46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:25:01.810590 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5cab6-014d-4839-92fc-7639fa5afb46 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:01.810872 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5cab6-014d-4839-92fc-7639fa5afb46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:01.811148 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5cab6-014d-4839-92fc-7639fa5afb46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:01.812806 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-57e5cab6-014d-4839-92fc-7639fa5afb46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:01.916866 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5cab6-014d-4839-92fc-7639fa5afb46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:25:01.918298 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5cab6-014d-4839-92fc-7639fa5afb46 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:25:01.935678 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 653/1320] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:25:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:25:04.777210 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce3ed8-47d1-4f95-96b8-97ef324efcc4 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:04.777785 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce3ed8-47d1-4f95-96b8-97ef324efcc4 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:04.777785 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce3ed8-47d1-4f95-96b8-97ef324efcc4 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:04.779125 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 668/1321] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:04.784901 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a390e-40b4-4c4e-aa2b-68e441869e85 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:04.785349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a390e-40b4-4c4e-aa2b-68e441869e85 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:04.785452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a390e-40b4-4c4e-aa2b-68e441869e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:04.848323 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-c59a390e-40b4-4c4e-aa2b-68e441869e85 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:04.849542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c59a390e-40b4-4c4e-aa2b-68e441869e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:04.939514 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 654/1322] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:04.980685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce3ed8-47d1-4f95-96b8-97ef324efcc4 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:25:04.982207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-70ce3ed8-47d1-4f95-96b8-97ef324efcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:05.080498 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce3ed8-47d1-4f95-96b8-97ef324efcc4 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:25:05.151806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff6dd8-fcac-4bb8-9875-ecf48a738a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:25:05.152472 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff6dd8-fcac-4bb8-9875-ecf48a738a4b service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:05.152779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff6dd8-fcac-4bb8-9875-ecf48a738a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:05.153048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff6dd8-fcac-4bb8-9875-ecf48a738a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:05.154669 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-77ff6dd8-fcac-4bb8-9875-ecf48a738a4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:05.258550 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff6dd8-fcac-4bb8-9875-ecf48a738a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:25:05.259988 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff6dd8-fcac-4bb8-9875-ecf48a738a4b service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:25:05.279690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 669/1323] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:25:07.587432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b581e7-97be-4837-9a7b-dc773c89dc4e None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:07.588005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b581e7-97be-4837-9a7b-dc773c89dc4e None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:07.588005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b581e7-97be-4837-9a7b-dc773c89dc4e None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:07.589654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 655/1324] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:07.595086 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9357fe-8416-4534-8c75-cf838f4c99d5 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:07.596032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9357fe-8416-4534-8c75-cf838f4c99d5 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:07.596246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9357fe-8416-4534-8c75-cf838f4c99d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:07.659442 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-6d9357fe-8416-4534-8c75-cf838f4c99d5 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:07.660758 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-6d9357fe-8416-4534-8c75-cf838f4c99d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:07.753797 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 670/1325] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:07.788939 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b581e7-97be-4837-9a7b-dc773c89dc4e None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:25:07.790477 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-14b581e7-97be-4837-9a7b-dc773c89dc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:07.888900 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b581e7-97be-4837-9a7b-dc773c89dc4e None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:25:07.957705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d209f2-8831-4283-bbcf-474cdcb972bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:25:07.958344 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d209f2-8831-4283-bbcf-474cdcb972bd service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:07.958624 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d209f2-8831-4283-bbcf-474cdcb972bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:07.958893 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d209f2-8831-4283-bbcf-474cdcb972bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:07.960505 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-03d209f2-8831-4283-bbcf-474cdcb972bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:08.062975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d209f2-8831-4283-bbcf-474cdcb972bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:25:08.064626 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d209f2-8831-4283-bbcf-474cdcb972bd service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:25:08.082165 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 656/1326] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:25:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:25:10.320815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281aa2c-db71-4ca7-9650-57a6ee8fcf21 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:10.321399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281aa2c-db71-4ca7-9650-57a6ee8fcf21 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:10.321399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281aa2c-db71-4ca7-9650-57a6ee8fcf21 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:10.322741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 671/1327] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:10.327974 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a0d39-0fbe-4f5a-a71f-3e38dead336a None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:10.328363 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a0d39-0fbe-4f5a-a71f-3e38dead336a None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:10.328675 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a0d39-0fbe-4f5a-a71f-3e38dead336a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:10.393791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-d45a0d39-0fbe-4f5a-a71f-3e38dead336a None None] MFA Rules not processed for user `7653c14067224481aa0bb76e61dcb69e`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:10.394994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-d45a0d39-0fbe-4f5a-a71f-3e38dead336a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:10.505382 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 657/1328] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:25:10 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:10.558290 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd88ae-6803-41fb-a5ed-b56411dfcdbc None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:10.558572 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd88ae-6803-41fb-a5ed-b56411dfcdbc None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:10.558846 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd88ae-6803-41fb-a5ed-b56411dfcdbc None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:10.560253 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 672/1329] 10.222.0.60 () {54 vars in 964 bytes} [Fri May 6 23:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:10.566526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1e394-bcc1-4b7d-a66a-26b648cf39fa None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:10.566808 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1e394-bcc1-4b7d-a66a-26b648cf39fa None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:10.567078 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1e394-bcc1-4b7d-a66a-26b648cf39fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:10.637639 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-ffa1e394-bcc1-4b7d-a66a-26b648cf39fa None None] MFA Rules not processed for user `046352b8553c4f23b6dda151f6f7ce00`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:10.638756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-ffa1e394-bcc1-4b7d-a66a-26b648cf39fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:10.713374 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 658/1330] 10.222.0.60 () {58 vars in 1061 bytes} [Fri May 6 23:25:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:10.722659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd88ae-6803-41fb-a5ed-b56411dfcdbc None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:25:10.724193 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-87bd88ae-6803-41fb-a5ed-b56411dfcdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:10.827129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd88ae-6803-41fb-a5ed-b56411dfcdbc None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:25:10.898525 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3afb16-1297-427c-bfb2-ef04391e977d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:25:10.899097 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3afb16-1297-427c-bfb2-ef04391e977d service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:10.899379 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3afb16-1297-427c-bfb2-ef04391e977d service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:10.899672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3afb16-1297-427c-bfb2-ef04391e977d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:10.901333 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-5c3afb16-1297-427c-bfb2-ef04391e977d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:11.005348 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3afb16-1297-427c-bfb2-ef04391e977d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:25:11.006793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3afb16-1297-427c-bfb2-ef04391e977d service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:25:11.024681 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 673/1331] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:25:10 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:25:13.887180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1f124-518d-42f3-a492-e347f6cfd719 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:13.887732 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1f124-518d-42f3-a492-e347f6cfd719 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:13.887732 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1f124-518d-42f3-a492-e347f6cfd719 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:13.890611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 659/1332] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:13.894750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46226f-23ef-46ce-9d16-3897c9b07e57 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:13.895258 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46226f-23ef-46ce-9d16-3897c9b07e57 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:13.895364 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46226f-23ef-46ce-9d16-3897c9b07e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:13.968079 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-eb46226f-23ef-46ce-9d16-3897c9b07e57 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:13.969417 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-eb46226f-23ef-46ce-9d16-3897c9b07e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:14.084712 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 674/1333] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:14.112177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1f124-518d-42f3-a492-e347f6cfd719 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:25:14.113935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-1ef1f124-518d-42f3-a492-e347f6cfd719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:14.217932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1f124-518d-42f3-a492-e347f6cfd719 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:25:14.287529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90e56c-1209-4714-bbc4-e8a6ca5ba211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:25:14.288167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90e56c-1209-4714-bbc4-e8a6ca5ba211 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:14.288441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90e56c-1209-4714-bbc4-e8a6ca5ba211 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:14.288734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90e56c-1209-4714-bbc4-e8a6ca5ba211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:14.290337 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-7c90e56c-1209-4714-bbc4-e8a6ca5ba211 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:14.395152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90e56c-1209-4714-bbc4-e8a6ca5ba211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:25:14.396580 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90e56c-1209-4714-bbc4-e8a6ca5ba211 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:25:14.416335 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 660/1334] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:25:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:25:16.669712 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487587f7-1175-4e46-aca8-be3b3609af10 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:16.670248 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487587f7-1175-4e46-aca8-be3b3609af10 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:16.670248 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487587f7-1175-4e46-aca8-be3b3609af10 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:16.671653 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 675/1335] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:16.677665 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e750c74-ac34-4e69-8375-924fc334e6ab None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:16.678111 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e750c74-ac34-4e69-8375-924fc334e6ab None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:16.678232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e750c74-ac34-4e69-8375-924fc334e6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:16.750093 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-8e750c74-ac34-4e69-8375-924fc334e6ab None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:16.751301 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-8e750c74-ac34-4e69-8375-924fc334e6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:16.843693 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 661/1336] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:16.882962 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487587f7-1175-4e46-aca8-be3b3609af10 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:25:16.884478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-487587f7-1175-4e46-aca8-be3b3609af10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:16.983222 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487587f7-1175-4e46-aca8-be3b3609af10 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:25:17.052159 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd62800-de22-42eb-866c-6fb2eb2bb725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:25:17.052815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd62800-de22-42eb-866c-6fb2eb2bb725 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:17.053093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd62800-de22-42eb-866c-6fb2eb2bb725 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:17.053360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd62800-de22-42eb-866c-6fb2eb2bb725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:17.054996 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-abd62800-de22-42eb-866c-6fb2eb2bb725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:17.157510 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd62800-de22-42eb-866c-6fb2eb2bb725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:25:17.158966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd62800-de22-42eb-866c-6fb2eb2bb725 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:25:17.176260 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 676/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:25:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:25:19.856360 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc7342-9a8d-4324-bb15-5da9794312b0 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:19.856789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc7342-9a8d-4324-bb15-5da9794312b0 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:19.856947 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc7342-9a8d-4324-bb15-5da9794312b0 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:19.858328 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 662/1338] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:19.863988 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d2ba3-8434-403f-9360-42d8e6511bb4 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:19.864393 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d2ba3-8434-403f-9360-42d8e6511bb4 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:19.864529 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d2ba3-8434-403f-9360-42d8e6511bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:19.925713 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-c51d2ba3-8434-403f-9360-42d8e6511bb4 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:19.926889 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c51d2ba3-8434-403f-9360-42d8e6511bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:20.019138 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 677/1339] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:25:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:20.053912 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc7342-9a8d-4324-bb15-5da9794312b0 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:25:20.055435 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-d4fc7342-9a8d-4324-bb15-5da9794312b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:20.153467 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc7342-9a8d-4324-bb15-5da9794312b0 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:25:20.223465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e1f8d-d2c1-4f0a-a9b8-bbc1db8657e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:25:20.224097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e1f8d-d2c1-4f0a-a9b8-bbc1db8657e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:20.224379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e1f8d-d2c1-4f0a-a9b8-bbc1db8657e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:20.224687 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e1f8d-d2c1-4f0a-a9b8-bbc1db8657e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:20.226302 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-909e1f8d-d2c1-4f0a-a9b8-bbc1db8657e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:20.329537 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e1f8d-d2c1-4f0a-a9b8-bbc1db8657e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:25:20.330914 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e1f8d-d2c1-4f0a-a9b8-bbc1db8657e9 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:25:20.348975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 663/1340] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:25:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:25:24.552651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eeecf6-ce4e-45ed-87ec-beccdc66417c None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:24.553210 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eeecf6-ce4e-45ed-87ec-beccdc66417c None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:24.553210 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eeecf6-ce4e-45ed-87ec-beccdc66417c None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:24.554521 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 678/1341] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:24.559657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c3750-619f-4813-bf25-b8f1b70a7bf1 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:24.560065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c3750-619f-4813-bf25-b8f1b70a7bf1 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:24.560274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c3750-619f-4813-bf25-b8f1b70a7bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:24.629783 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-9a8c3750-619f-4813-bf25-b8f1b70a7bf1 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:24.630980 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9a8c3750-619f-4813-bf25-b8f1b70a7bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:24.729384 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 664/1342] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:24.767151 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eeecf6-ce4e-45ed-87ec-beccdc66417c None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:25:24.769341 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d8eeecf6-ce4e-45ed-87ec-beccdc66417c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:24.867401 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eeecf6-ce4e-45ed-87ec-beccdc66417c None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:25:24.871122 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6786417-b9ab-499e-8fd7-2fab8195760f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:25:24.871767 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786417-b9ab-499e-8fd7-2fab8195760f service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:24.872052 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786417-b9ab-499e-8fd7-2fab8195760f service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:24.872329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786417-b9ab-499e-8fd7-2fab8195760f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:24.881842 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6786417-b9ab-499e-8fd7-2fab8195760f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:25:24.883278 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6786417-b9ab-499e-8fd7-2fab8195760f service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:25:24.892661 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 679/1343] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:25:27.688311 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554705f-2a82-4e10-8466-92e694ef0ac3 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:27.689378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554705f-2a82-4e10-8466-92e694ef0ac3 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:27.689468 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554705f-2a82-4e10-8466-92e694ef0ac3 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:27.690813 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 665/1344] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:25:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:27.696017 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e956f-ed8f-49f8-a8c6-26fcc058c359 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:27.696417 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e956f-ed8f-49f8-a8c6-26fcc058c359 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:27.696624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e956f-ed8f-49f8-a8c6-26fcc058c359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:27.724683 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-306e956f-ed8f-49f8-a8c6-26fcc058c359 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:27.725878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-306e956f-ed8f-49f8-a8c6-26fcc058c359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:27.800149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 680/1345] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:25:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:27.836241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554705f-2a82-4e10-8466-92e694ef0ac3 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:25:27.848725 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554705f-2a82-4e10-8466-92e694ef0ac3 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:25:27.852360 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443da097-c88e-4271-ab2b-02a5bdb16f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:25:27.853040 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443da097-c88e-4271-ab2b-02a5bdb16f08 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:27.853317 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443da097-c88e-4271-ab2b-02a5bdb16f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:27.853583 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443da097-c88e-4271-ab2b-02a5bdb16f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:27.862787 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443da097-c88e-4271-ab2b-02a5bdb16f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:25:27.864446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443da097-c88e-4271-ab2b-02a5bdb16f08 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:25:27.874102 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 666/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:25:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:25:32.130353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08beeb7-b261-4d92-a71e-02e4c1737592 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:32.130929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08beeb7-b261-4d92-a71e-02e4c1737592 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:32.130929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08beeb7-b261-4d92-a71e-02e4c1737592 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:32.132271 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 681/1347] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:32.137508 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64525f1a-b2e9-4fdb-9c09-5344f4ec741b None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:32.137933 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64525f1a-b2e9-4fdb-9c09-5344f4ec741b None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:32.138120 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64525f1a-b2e9-4fdb-9c09-5344f4ec741b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:32.156525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-64525f1a-b2e9-4fdb-9c09-5344f4ec741b None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:32.157763 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-64525f1a-b2e9-4fdb-9c09-5344f4ec741b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:32.173056 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 667/1348] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:32.210885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08beeb7-b261-4d92-a71e-02e4c1737592 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:25:32.221789 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08beeb7-b261-4d92-a71e-02e4c1737592 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:25:32.225311 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f83484-2036-4320-ab0b-8776df5c87ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:25:32.225944 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f83484-2036-4320-ab0b-8776df5c87ea service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:32.226224 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f83484-2036-4320-ab0b-8776df5c87ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:32.226500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f83484-2036-4320-ab0b-8776df5c87ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:32.235312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f83484-2036-4320-ab0b-8776df5c87ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:25:32.236773 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f83484-2036-4320-ab0b-8776df5c87ea service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:25:32.246201 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 682/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:25:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:25:37.478673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f266ed-968d-4947-bca2-f440d04f3df3 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:37.478673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f266ed-968d-4947-bca2-f440d04f3df3 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:37.479280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f266ed-968d-4947-bca2-f440d04f3df3 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:37.480721 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 668/1350] 10.222.0.60 () {54 vars in 921 bytes} [Fri May 6 23:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:37.486038 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111183c-ecd2-4d7d-b487-7d2c4b6f3c19 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:37.486446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111183c-ecd2-4d7d-b487-7d2c4b6f3c19 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:37.486584 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111183c-ecd2-4d7d-b487-7d2c4b6f3c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:37.588888 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-8111183c-ecd2-4d7d-b487-7d2c4b6f3c19 None None] MFA Rules not processed for user `fb1f7704fb5644688b8764bb1ce15734`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:37.591373 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-8111183c-ecd2-4d7d-b487-7d2c4b6f3c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:37.673269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 683/1351] 10.222.0.60 () {58 vars in 1018 bytes} [Fri May 6 23:25:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:41.927214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd857e-1243-410f-bc2e-493da4003817 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:41.927738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd857e-1243-410f-bc2e-493da4003817 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:41.927738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd857e-1243-410f-bc2e-493da4003817 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:41.929159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 669/1352] 10.222.0.60 () {54 vars in 921 bytes} [Fri May 6 23:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:41.934732 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c5e4b-b684-4654-8fa0-3b6d6355b91c None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:41.935683 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c5e4b-b684-4654-8fa0-3b6d6355b91c None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:41.936199 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c5e4b-b684-4654-8fa0-3b6d6355b91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:41.956758 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-da8c5e4b-b684-4654-8fa0-3b6d6355b91c None None] MFA Rules not processed for user `fb1f7704fb5644688b8764bb1ce15734`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:41.958250 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-da8c5e4b-b684-4654-8fa0-3b6d6355b91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:41.968631 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 684/1353] 10.222.0.60 () {58 vars in 1018 bytes} [Fri May 6 23:25:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:43.580032 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6671c91-b9f0-4eaf-a643-856bfb544796 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:43.580621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6671c91-b9f0-4eaf-a643-856bfb544796 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:43.580908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6671c91-b9f0-4eaf-a643-856bfb544796 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:43.582536 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 670/1354] 10.222.0.60 () {54 vars in 921 bytes} [Fri May 6 23:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:25:43.587784 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c680d-e55c-4471-a872-3e88d46d550a None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:43.588204 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c680d-e55c-4471-a872-3e88d46d550a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:43.588327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c680d-e55c-4471-a872-3e88d46d550a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:43.609091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-945c680d-e55c-4471-a872-3e88d46d550a None None] MFA Rules not processed for user `fb1f7704fb5644688b8764bb1ce15734`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:43.610717 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-945c680d-e55c-4471-a872-3e88d46d550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:43.619478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 685/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Fri May 6 23:25:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:47.436464 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0b8dd-530d-4d85-b6ae-4c3fdf358e52 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:47.436987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0b8dd-530d-4d85-b6ae-4c3fdf358e52 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:47.436987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0b8dd-530d-4d85-b6ae-4c3fdf358e52 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:47.438349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 671/1356] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:25:47.443452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740166e-e38b-45b7-8cfe-72e1d491b48e None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:47.443831 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740166e-e38b-45b7-8cfe-72e1d491b48e None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:47.444005 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740166e-e38b-45b7-8cfe-72e1d491b48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:47.462094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-2740166e-e38b-45b7-8cfe-72e1d491b48e None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:47.463382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-2740166e-e38b-45b7-8cfe-72e1d491b48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:47.472727 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 686/1357] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:47.519227 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129885e-132c-4e65-933c-0430d4a24b49 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:47.519504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129885e-132c-4e65-933c-0430d4a24b49 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:47.519964 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129885e-132c-4e65-933c-0430d4a24b49 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:47.521731 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 672/1358] 10.222.0.60 () {54 vars in 961 bytes} [Fri May 6 23:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:47.528643 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3bf38-5792-4867-bdff-2add32ca16c6 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:47.529000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3bf38-5792-4867-bdff-2add32ca16c6 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:47.529347 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3bf38-5792-4867-bdff-2add32ca16c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:47.589218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-dfc3bf38-5792-4867-bdff-2add32ca16c6 None None] MFA Rules not processed for user `9b74631c6e1547d991753a65c41bc7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:47.590406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-dfc3bf38-5792-4867-bdff-2add32ca16c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:47.671974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 687/1359] 10.222.0.60 () {58 vars in 1058 bytes} [Fri May 6 23:25:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:47.680181 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129885e-132c-4e65-933c-0430d4a24b49 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:25:47.696435 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129885e-132c-4e65-933c-0430d4a24b49 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:25:47.702482 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492528ee-45ed-4cb9-80e6-83dc920e4bd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:25:47.704167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492528ee-45ed-4cb9-80e6-83dc920e4bd1 service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:47.704683 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492528ee-45ed-4cb9-80e6-83dc920e4bd1 service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:47.705254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492528ee-45ed-4cb9-80e6-83dc920e4bd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:47.715466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492528ee-45ed-4cb9-80e6-83dc920e4bd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:25:47.717345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492528ee-45ed-4cb9-80e6-83dc920e4bd1 service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:25:47.727552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 673/1360] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:25:50.162255 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06e5c6-4ef8-41d3-abd0-f86fe717d721 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:50.162761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06e5c6-4ef8-41d3-abd0-f86fe717d721 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:50.162986 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06e5c6-4ef8-41d3-abd0-f86fe717d721 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:50.164577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 688/1361] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:50.169924 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76511c1e-f890-4ff1-b6b3-a866b0c8e01e None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:50.170682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76511c1e-f890-4ff1-b6b3-a866b0c8e01e None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:50.171198 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76511c1e-f890-4ff1-b6b3-a866b0c8e01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:50.192719 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-76511c1e-f890-4ff1-b6b3-a866b0c8e01e None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:50.194117 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-76511c1e-f890-4ff1-b6b3-a866b0c8e01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:50.202296 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 674/1362] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:50.245755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06e5c6-4ef8-41d3-abd0-f86fe717d721 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:25:50.261403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06e5c6-4ef8-41d3-abd0-f86fe717d721 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:25:50.267093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06951299-5adb-4cec-8cc7-3edfa9a01deb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:25:50.267797 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06951299-5adb-4cec-8cc7-3edfa9a01deb service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:50.268147 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06951299-5adb-4cec-8cc7-3edfa9a01deb service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:50.268489 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06951299-5adb-4cec-8cc7-3edfa9a01deb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:50.276846 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06951299-5adb-4cec-8cc7-3edfa9a01deb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:25:50.278586 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06951299-5adb-4cec-8cc7-3edfa9a01deb service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:25:50.288727 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 689/1363] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:25:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:25:52.906551 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67652fb3-23c0-4ddc-99b7-f8d6f324907d None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:52.907593 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67652fb3-23c0-4ddc-99b7-f8d6f324907d None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:52.907593 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67652fb3-23c0-4ddc-99b7-f8d6f324907d None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:52.908954 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 675/1364] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:52.914196 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2c108-fae1-41cf-b162-b168c8a706ac None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:52.914614 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2c108-fae1-41cf-b162-b168c8a706ac None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:52.914749 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2c108-fae1-41cf-b162-b168c8a706ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:52.933157 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-29f2c108-fae1-41cf-b162-b168c8a706ac None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:52.934356 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-29f2c108-fae1-41cf-b162-b168c8a706ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:52.942235 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 690/1365] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:52.987084 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee26703-e0b1-486e-853e-c42b0d67f6a7 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:52.987367 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee26703-e0b1-486e-853e-c42b0d67f6a7 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:52.987639 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee26703-e0b1-486e-853e-c42b0d67f6a7 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:52.989019 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 676/1366] 10.222.0.60 () {54 vars in 961 bytes} [Fri May 6 23:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:52.994074 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a250c8-13e6-4134-bee7-883f1702896e None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:52.994353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a250c8-13e6-4134-bee7-883f1702896e None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:52.994626 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a250c8-13e6-4134-bee7-883f1702896e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:53.012717 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-32a250c8-13e6-4134-bee7-883f1702896e None None] MFA Rules not processed for user `9b74631c6e1547d991753a65c41bc7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:53.013888 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-32a250c8-13e6-4134-bee7-883f1702896e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:53.023437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 691/1367] 10.222.0.60 () {58 vars in 1058 bytes} [Fri May 6 23:25:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:25:53.031257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee26703-e0b1-486e-853e-c42b0d67f6a7 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:25:53.046006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee26703-e0b1-486e-853e-c42b0d67f6a7 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:25:53.051468 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f5ae1-9261-4c8d-ad59-16223764ef12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:25:53.052285 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f5ae1-9261-4c8d-ad59-16223764ef12 service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:53.052596 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f5ae1-9261-4c8d-ad59-16223764ef12 service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:53.052872 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f5ae1-9261-4c8d-ad59-16223764ef12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:53.061095 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f5ae1-9261-4c8d-ad59-16223764ef12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:25:53.062683 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f5ae1-9261-4c8d-ad59-16223764ef12 service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:25:53.079177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 677/1368] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:25:55.339001 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882c4ea-cbb2-49ac-a160-0e8c92580e4c None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:55.339550 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882c4ea-cbb2-49ac-a160-0e8c92580e4c None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:55.339550 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882c4ea-cbb2-49ac-a160-0e8c92580e4c None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:55.340952 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 692/1369] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:55.346748 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185434b-224f-4926-9a5d-82978524fc93 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:55.347155 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185434b-224f-4926-9a5d-82978524fc93 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:55.347289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185434b-224f-4926-9a5d-82978524fc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:55.365511 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-e185434b-224f-4926-9a5d-82978524fc93 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:55.366947 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e185434b-224f-4926-9a5d-82978524fc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:55.375975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 678/1370] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:55.421552 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882c4ea-cbb2-49ac-a160-0e8c92580e4c None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:25:55.435836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882c4ea-cbb2-49ac-a160-0e8c92580e4c None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:25:55.442059 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90dde9d-393c-4278-a1d6-0a299a8c9fbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:25:55.442900 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dde9d-393c-4278-a1d6-0a299a8c9fbb service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:55.443396 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dde9d-393c-4278-a1d6-0a299a8c9fbb service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:55.443866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dde9d-393c-4278-a1d6-0a299a8c9fbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:55.452662 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dde9d-393c-4278-a1d6-0a299a8c9fbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:25:55.455169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dde9d-393c-4278-a1d6-0a299a8c9fbb service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:25:55.465089 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 693/1371] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:25:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:25:55.568180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b171fc-5c36-44f3-930f-bc5548dae0b1 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:55.568581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b171fc-5c36-44f3-930f-bc5548dae0b1 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:55.568807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b171fc-5c36-44f3-930f-bc5548dae0b1 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:55.570466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 679/1372] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:55.576563 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba8cc-a089-43e4-812c-54ff963031aa None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:55.576846 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba8cc-a089-43e4-812c-54ff963031aa None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:55.577311 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba8cc-a089-43e4-812c-54ff963031aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:55.596681 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-64fba8cc-a089-43e4-812c-54ff963031aa None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:55.597929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-64fba8cc-a089-43e4-812c-54ff963031aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:55.606215 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 694/1373] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:55.925939 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26724504-d304-45e2-8fd7-c56b4fb002f6 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:55.925939 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26724504-d304-45e2-8fd7-c56b4fb002f6 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:55.926246 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26724504-d304-45e2-8fd7-c56b4fb002f6 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:55.927875 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 680/1374] 10.222.0.60 () {54 vars in 963 bytes} [Fri May 6 23:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:55.933063 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bccff-4786-4301-b5a7-99491fa450ba None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:55.933468 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bccff-4786-4301-b5a7-99491fa450ba None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:55.933856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bccff-4786-4301-b5a7-99491fa450ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:55.983976 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-833bccff-4786-4301-b5a7-99491fa450ba None None] MFA Rules not processed for user `36d2df2ca106409995e139652ee995e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:55.985449 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-833bccff-4786-4301-b5a7-99491fa450ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:56.045505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 695/1375] 10.222.0.60 () {58 vars in 1060 bytes} [Fri May 6 23:25:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:56.053295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26724504-d304-45e2-8fd7-c56b4fb002f6 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:25:56.064469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26724504-d304-45e2-8fd7-c56b4fb002f6 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:25:56.068130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc865f50-3c63-43f0-ba25-9f238642db71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:25:56.068911 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc865f50-3c63-43f0-ba25-9f238642db71 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:56.069333 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc865f50-3c63-43f0-ba25-9f238642db71 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:56.069716 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc865f50-3c63-43f0-ba25-9f238642db71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:56.079720 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc865f50-3c63-43f0-ba25-9f238642db71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:25:56.081326 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc865f50-3c63-43f0-ba25-9f238642db71 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:25:56.090998 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 681/1376] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:25:57.709953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ab48e-c4aa-4859-b43c-66c71ffbc61a None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:57.710500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ab48e-c4aa-4859-b43c-66c71ffbc61a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:57.710500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ab48e-c4aa-4859-b43c-66c71ffbc61a None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:57.711918 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 696/1377] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:25:57.718236 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714d98d-2c00-4b0d-bf76-bb1612c50047 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:57.718789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714d98d-2c00-4b0d-bf76-bb1612c50047 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:57.718789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714d98d-2c00-4b0d-bf76-bb1612c50047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:57.738171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-9714d98d-2c00-4b0d-bf76-bb1612c50047 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:25:57.739298 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9714d98d-2c00-4b0d-bf76-bb1612c50047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:25:57.747427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 682/1378] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:25:57.792809 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ab48e-c4aa-4859-b43c-66c71ffbc61a None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:25:57.808412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ab48e-c4aa-4859-b43c-66c71ffbc61a None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:25:57.814354 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5eec45-c8f8-4c24-b12b-5dca82778ea9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:25:57.815012 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5eec45-c8f8-4c24-b12b-5dca82778ea9 service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:25:57.815285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5eec45-c8f8-4c24-b12b-5dca82778ea9 service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:25:57.815556 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5eec45-c8f8-4c24-b12b-5dca82778ea9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:25:57.826292 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5eec45-c8f8-4c24-b12b-5dca82778ea9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:25:57.828231 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5eec45-c8f8-4c24-b12b-5dca82778ea9 service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:25:57.839857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 697/1379] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:25:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:26:00.151777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a32623-f77b-44bc-9ab1-1056521300bc None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:00.152305 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a32623-f77b-44bc-9ab1-1056521300bc None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:00.152305 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a32623-f77b-44bc-9ab1-1056521300bc None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:00.153809 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 683/1380] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:00.159597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c39d4b-19c2-4e7c-8a6e-1b648de17a4b None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:00.160427 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c39d4b-19c2-4e7c-8a6e-1b648de17a4b None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:00.160750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c39d4b-19c2-4e7c-8a6e-1b648de17a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:00.181477 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-99c39d4b-19c2-4e7c-8a6e-1b648de17a4b None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:00.183493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-99c39d4b-19c2-4e7c-8a6e-1b648de17a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:00.193912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 698/1381] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:00.237553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a32623-f77b-44bc-9ab1-1056521300bc None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:00.252724 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a32623-f77b-44bc-9ab1-1056521300bc None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:00.258321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06802c-daf0-4c59-9ba7-43ef1af5b35b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:00.258955 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06802c-daf0-4c59-9ba7-43ef1af5b35b service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:00.259233 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06802c-daf0-4c59-9ba7-43ef1af5b35b service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:00.259503 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06802c-daf0-4c59-9ba7-43ef1af5b35b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:00.267968 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06802c-daf0-4c59-9ba7-43ef1af5b35b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:00.269557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06802c-daf0-4c59-9ba7-43ef1af5b35b service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:00.278870 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 684/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:26:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:26:02.555949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d381c-97ec-4f38-a74c-3ce4898cac84 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:02.556836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d381c-97ec-4f38-a74c-3ce4898cac84 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:02.556836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d381c-97ec-4f38-a74c-3ce4898cac84 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:02.558311 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 699/1383] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:26:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:26:02.565164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0b142-2c31-4ec0-bd06-d34198b29c97 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:02.565777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0b142-2c31-4ec0-bd06-d34198b29c97 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:02.565777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0b142-2c31-4ec0-bd06-d34198b29c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:02.585391 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-f8b0b142-2c31-4ec0-bd06-d34198b29c97 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:02.586640 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f8b0b142-2c31-4ec0-bd06-d34198b29c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:02.595879 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 685/1384] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:02.637317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d381c-97ec-4f38-a74c-3ce4898cac84 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:02.652098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d381c-97ec-4f38-a74c-3ce4898cac84 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:02.657645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da33a5-3067-4712-a05d-c81b3a4bad4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:02.658414 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da33a5-3067-4712-a05d-c81b3a4bad4c service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:02.658810 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da33a5-3067-4712-a05d-c81b3a4bad4c service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:02.659355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da33a5-3067-4712-a05d-c81b3a4bad4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:02.667849 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da33a5-3067-4712-a05d-c81b3a4bad4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:02.669693 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da33a5-3067-4712-a05d-c81b3a4bad4c service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:02.680057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 700/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:26:04.886074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2df23f-7fb7-4cd5-aebe-b4781392d972 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:04.886579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2df23f-7fb7-4cd5-aebe-b4781392d972 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:04.886689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2df23f-7fb7-4cd5-aebe-b4781392d972 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:04.887991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 686/1386] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:04.893275 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0afaa0-24b3-4e04-a86c-db8d9f62d1d5 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:04.893714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0afaa0-24b3-4e04-a86c-db8d9f62d1d5 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:04.893835 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0afaa0-24b3-4e04-a86c-db8d9f62d1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:04.912222 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-4a0afaa0-24b3-4e04-a86c-db8d9f62d1d5 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:04.913509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-4a0afaa0-24b3-4e04-a86c-db8d9f62d1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:04.926091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 701/1387] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:04.969136 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2df23f-7fb7-4cd5-aebe-b4781392d972 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:04.983033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2df23f-7fb7-4cd5-aebe-b4781392d972 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:04.988907 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee304284-8843-4e77-bc1e-b543f7469ab3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:04.989531 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee304284-8843-4e77-bc1e-b543f7469ab3 service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:04.989807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee304284-8843-4e77-bc1e-b543f7469ab3 service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:04.990076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee304284-8843-4e77-bc1e-b543f7469ab3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:04.997832 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee304284-8843-4e77-bc1e-b543f7469ab3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:04.999399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee304284-8843-4e77-bc1e-b543f7469ab3 service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:05.008970 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 687/1388] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:26:07.211057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88dd23-2f48-41d5-af0f-fc7fc94b6717 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:07.211606 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88dd23-2f48-41d5-af0f-fc7fc94b6717 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:07.211606 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88dd23-2f48-41d5-af0f-fc7fc94b6717 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:07.212942 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 702/1389] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:07.220367 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed7d01-e002-4939-8b39-afd4604791c6 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:07.220877 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed7d01-e002-4939-8b39-afd4604791c6 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:07.220977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed7d01-e002-4939-8b39-afd4604791c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:07.239672 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-c2ed7d01-e002-4939-8b39-afd4604791c6 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:07.240891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c2ed7d01-e002-4939-8b39-afd4604791c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:07.249347 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 688/1390] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:07.297952 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88dd23-2f48-41d5-af0f-fc7fc94b6717 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:07.312519 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88dd23-2f48-41d5-af0f-fc7fc94b6717 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:07.317978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258e303-ce64-4c6a-af71-179e1f067606 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:07.318604 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258e303-ce64-4c6a-af71-179e1f067606 service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:07.318880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258e303-ce64-4c6a-af71-179e1f067606 service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:07.319154 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258e303-ce64-4c6a-af71-179e1f067606 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:07.326891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258e303-ce64-4c6a-af71-179e1f067606 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:07.329010 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258e303-ce64-4c6a-af71-179e1f067606 service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:07.337973 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 703/1391] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:26:09.620666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd2c2b-cf1f-436e-ac6b-4b84bf577574 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:09.621330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd2c2b-cf1f-436e-ac6b-4b84bf577574 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:09.621330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd2c2b-cf1f-436e-ac6b-4b84bf577574 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:09.622620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 689/1392] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:09.628038 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730967c-5011-49b2-bd21-c86f7a7cdd30 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:09.628475 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730967c-5011-49b2-bd21-c86f7a7cdd30 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:09.628648 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730967c-5011-49b2-bd21-c86f7a7cdd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:09.646374 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-8730967c-5011-49b2-bd21-c86f7a7cdd30 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:09.647559 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-8730967c-5011-49b2-bd21-c86f7a7cdd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:09.656487 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 704/1393] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:09.704859 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd2c2b-cf1f-436e-ac6b-4b84bf577574 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:09.719912 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd2c2b-cf1f-436e-ac6b-4b84bf577574 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:09.725477 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991ca66-b2ea-4816-a3f2-a25cf7008f93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:09.726108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991ca66-b2ea-4816-a3f2-a25cf7008f93 service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:09.726396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991ca66-b2ea-4816-a3f2-a25cf7008f93 service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:09.726675 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991ca66-b2ea-4816-a3f2-a25cf7008f93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:09.735659 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991ca66-b2ea-4816-a3f2-a25cf7008f93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:09.737492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991ca66-b2ea-4816-a3f2-a25cf7008f93 service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:09.748294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 690/1394] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:26:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:26:12.382574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4257fa-6443-4f47-8a5a-1ade6404d36a None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:12.383115 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4257fa-6443-4f47-8a5a-1ade6404d36a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:12.383284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4257fa-6443-4f47-8a5a-1ade6404d36a None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:12.385080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 705/1395] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:12.392206 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496379e0-652f-4d58-8c27-525e167aee58 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:12.392693 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496379e0-652f-4d58-8c27-525e167aee58 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:12.392794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496379e0-652f-4d58-8c27-525e167aee58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:12.410715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-496379e0-652f-4d58-8c27-525e167aee58 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:12.411902 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-496379e0-652f-4d58-8c27-525e167aee58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:12.419847 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 691/1396] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:12.463108 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4257fa-6443-4f47-8a5a-1ade6404d36a None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:12.478164 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4257fa-6443-4f47-8a5a-1ade6404d36a None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:12.483492 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3be5e9-5f4d-4d19-a318-99e1d08d9c03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:12.484161 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3be5e9-5f4d-4d19-a318-99e1d08d9c03 service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:12.484441 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3be5e9-5f4d-4d19-a318-99e1d08d9c03 service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:12.484753 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3be5e9-5f4d-4d19-a318-99e1d08d9c03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:12.492927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3be5e9-5f4d-4d19-a318-99e1d08d9c03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:12.494656 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3be5e9-5f4d-4d19-a318-99e1d08d9c03 service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:12.504195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 706/1397] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:26:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:26:14.780266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53609a66-9dc7-4e44-b2f9-f8eec6fd5e82 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:14.780952 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53609a66-9dc7-4e44-b2f9-f8eec6fd5e82 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:14.780952 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53609a66-9dc7-4e44-b2f9-f8eec6fd5e82 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:14.782270 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 692/1398] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:14.787515 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd1d96-fcc6-43df-bef7-3cf656193ac0 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:14.787965 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd1d96-fcc6-43df-bef7-3cf656193ac0 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:14.788073 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd1d96-fcc6-43df-bef7-3cf656193ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:14.805998 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-93bd1d96-fcc6-43df-bef7-3cf656193ac0 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:14.807220 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-93bd1d96-fcc6-43df-bef7-3cf656193ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:14.815922 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 707/1399] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:26:14.860386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53609a66-9dc7-4e44-b2f9-f8eec6fd5e82 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:14.874464 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53609a66-9dc7-4e44-b2f9-f8eec6fd5e82 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:14.879785 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3427e-10ac-429d-8f74-35c51c57c352 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:14.880413 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3427e-10ac-429d-8f74-35c51c57c352 service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:14.880726 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3427e-10ac-429d-8f74-35c51c57c352 service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:14.880997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3427e-10ac-429d-8f74-35c51c57c352 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:14.888964 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3427e-10ac-429d-8f74-35c51c57c352 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:14.890527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3427e-10ac-429d-8f74-35c51c57c352 service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:14.899622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 693/1400] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:26:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:26:16.277879 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d57d-17b4-467d-9cf8-deddc6d03dc4 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:16.278428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d57d-17b4-467d-9cf8-deddc6d03dc4 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:16.278428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d57d-17b4-467d-9cf8-deddc6d03dc4 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:16.279789 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 708/1401] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:16.285042 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf3446-6153-47fc-b7bc-cb5bca7ef443 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:16.285469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf3446-6153-47fc-b7bc-cb5bca7ef443 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:16.285581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf3446-6153-47fc-b7bc-cb5bca7ef443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:16.303270 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-8eaf3446-6153-47fc-b7bc-cb5bca7ef443 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:16.304472 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-8eaf3446-6153-47fc-b7bc-cb5bca7ef443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:16.312854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 694/1402] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:16.367894 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662be1c-89f2-4a5a-81b2-9f1fcf3e39e1 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:16.368179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662be1c-89f2-4a5a-81b2-9f1fcf3e39e1 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:16.368455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662be1c-89f2-4a5a-81b2-9f1fcf3e39e1 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:16.369862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 709/1403] 10.222.0.60 () {54 vars in 962 bytes} [Fri May 6 23:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:16.374875 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59c11d-af6d-4a98-8b69-1e8e7a32d7ec None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:16.375165 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59c11d-af6d-4a98-8b69-1e8e7a32d7ec None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:16.375442 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59c11d-af6d-4a98-8b69-1e8e7a32d7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:16.422515 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-cc59c11d-af6d-4a98-8b69-1e8e7a32d7ec None None] MFA Rules not processed for user `a63ecc7210574058aad75a3114b57202`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:16.423687 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-cc59c11d-af6d-4a98-8b69-1e8e7a32d7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:16.479116 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 695/1404] 10.222.0.60 () {58 vars in 1059 bytes} [Fri May 6 23:26:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:16.486864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662be1c-89f2-4a5a-81b2-9f1fcf3e39e1 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:16.497035 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662be1c-89f2-4a5a-81b2-9f1fcf3e39e1 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:16.500505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb337239-ced7-4c67-979b-921218ec6178 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a63ecc7210574058aad75a3114b57202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:16.501152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb337239-ced7-4c67-979b-921218ec6178 service glance] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:16.501433 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb337239-ced7-4c67-979b-921218ec6178 service glance] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:16.501707 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb337239-ced7-4c67-979b-921218ec6178 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:16.510263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb337239-ced7-4c67-979b-921218ec6178 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:16.511676 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb337239-ced7-4c67-979b-921218ec6178 service glance] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:16.520747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 710/1405] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:26:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:26:16.950691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0de0b-78c6-4232-9b89-402e7b5b1204 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:16.951189 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0de0b-78c6-4232-9b89-402e7b5b1204 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:16.951468 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0de0b-78c6-4232-9b89-402e7b5b1204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:17.013916 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-84d0de0b-78c6-4232-9b89-402e7b5b1204 None None] MFA Rules not processed for user `d211582f9fc34b0e815e27db081c50c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:17.015049 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-84d0de0b-78c6-4232-9b89-402e7b5b1204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:17.076479 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 696/1406] 10.222.0.60 () {58 vars in 1009 bytes} [Fri May 6 23:26:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:17.120872 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04fbc9-a748-4ce4-b560-a2d754bcb0dd None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:17.121159 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04fbc9-a748-4ce4-b560-a2d754bcb0dd None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:17.121435 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04fbc9-a748-4ce4-b560-a2d754bcb0dd None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:17.122806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 711/1407] 10.222.0.60 () {54 vars in 942 bytes} [Fri May 6 23:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:17.128855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2093c-e76f-4c79-8c6f-e3fe6169add8 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:17.129146 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2093c-e76f-4c79-8c6f-e3fe6169add8 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:17.129423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2093c-e76f-4c79-8c6f-e3fe6169add8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:17.176024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-fcf2093c-e76f-4c79-8c6f-e3fe6169add8 None None] MFA Rules not processed for user `48b3ec57aee94b87889d578e114fa0db`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:17.177237 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-fcf2093c-e76f-4c79-8c6f-e3fe6169add8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:17.244472 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 697/1408] 10.222.0.60 () {58 vars in 1039 bytes} [Fri May 6 23:26:17 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:17.254196 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04fbc9-a748-4ce4-b560-a2d754bcb0dd None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:17.267853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04fbc9-a748-4ce4-b560-a2d754bcb0dd None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:17.272614 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c933382-df96-4aeb-bee0-b6e1c9d6749f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b3ec57aee94b87889d578e114fa0db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:17.273232 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c933382-df96-4aeb-bee0-b6e1c9d6749f service swift] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:17.273509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c933382-df96-4aeb-bee0-b6e1c9d6749f service swift] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:17.273780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c933382-df96-4aeb-bee0-b6e1c9d6749f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:17.281379 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c933382-df96-4aeb-bee0-b6e1c9d6749f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:17.282933 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c933382-df96-4aeb-bee0-b6e1c9d6749f service swift] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:17.290595 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 712/1409] 10.222.0.60 () {60 vars in 1384 bytes} [Fri May 6 23:26:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 06 23:26:40.397717 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbcb1d-8765-4d51-b88d-a87582b3e51d None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:40.398388 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbcb1d-8765-4d51-b88d-a87582b3e51d None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:40.398388 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbcb1d-8765-4d51-b88d-a87582b3e51d None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:40.399645 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 698/1410] 10.222.0.60 () {54 vars in 918 bytes} [Fri May 6 23:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:40.404688 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ab913-4b22-4816-a0a9-5ec55648d3ee None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:40.405732 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ab913-4b22-4816-a0a9-5ec55648d3ee None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:40.405862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ab913-4b22-4816-a0a9-5ec55648d3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:40.423145 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-c43ab913-4b22-4816-a0a9-5ec55648d3ee None None] MFA Rules not processed for user `fb1f7704fb5644688b8764bb1ce15734`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:40.424319 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c43ab913-4b22-4816-a0a9-5ec55648d3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:40.432610 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 713/1411] 10.222.0.60 () {58 vars in 1015 bytes} [Fri May 6 23:26:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:40.446258 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd8581-d836-449a-92c5-bd7d9177e0e6 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:40.446543 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd8581-d836-449a-92c5-bd7d9177e0e6 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:40.446818 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd8581-d836-449a-92c5-bd7d9177e0e6 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:40.448193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 699/1412] 10.222.0.60 () {54 vars in 918 bytes} [Fri May 6 23:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:40.453113 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03bd84-ef6e-48f9-9b1d-ff3d782aaf5e None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:40.453395 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03bd84-ef6e-48f9-9b1d-ff3d782aaf5e None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:40.453666 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03bd84-ef6e-48f9-9b1d-ff3d782aaf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:40.471093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-6d03bd84-ef6e-48f9-9b1d-ff3d782aaf5e None None] MFA Rules not processed for user `9b74631c6e1547d991753a65c41bc7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:40.472236 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-6d03bd84-ef6e-48f9-9b1d-ff3d782aaf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:40.481120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 714/1413] 10.222.0.60 () {58 vars in 1015 bytes} [Fri May 6 23:26:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:43.119542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acc1eb-1421-466e-9549-6ecc39fcc3a7 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:43.120069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acc1eb-1421-466e-9549-6ecc39fcc3a7 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:43.120069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acc1eb-1421-466e-9549-6ecc39fcc3a7 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:43.121397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 700/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 6 23:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:43.127095 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f7f57-9a4b-4e98-9623-7c1f5336a11d None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:43.127540 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f7f57-9a4b-4e98-9623-7c1f5336a11d None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:43.127644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f7f57-9a4b-4e98-9623-7c1f5336a11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:43.146302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-771f7f57-9a4b-4e98-9623-7c1f5336a11d None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:43.147471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-771f7f57-9a4b-4e98-9623-7c1f5336a11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:43.155193 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 715/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 6 23:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:43.195719 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acc1eb-1421-466e-9549-6ecc39fcc3a7 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:43.210254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acc1eb-1421-466e-9549-6ecc39fcc3a7 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:43.215544 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0e940-a5ec-4a33-83ef-a265cf1fa1ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:43.216169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0e940-a5ec-4a33-83ef-a265cf1fa1ff service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:43.216450 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0e940-a5ec-4a33-83ef-a265cf1fa1ff service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:43.216754 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0e940-a5ec-4a33-83ef-a265cf1fa1ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:43.224812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0e940-a5ec-4a33-83ef-a265cf1fa1ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:43.226385 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0e940-a5ec-4a33-83ef-a265cf1fa1ff service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:43.235407 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 701/1416] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:26:44.229257 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368fae2-378c-4243-88e3-b7c669bebd34 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:44.229799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368fae2-378c-4243-88e3-b7c669bebd34 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:44.229799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368fae2-378c-4243-88e3-b7c669bebd34 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:44.231105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 716/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 6 23:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:44.236071 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd583f-711c-4d69-8b6b-8468cff2b9de None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:44.236521 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd583f-711c-4d69-8b6b-8468cff2b9de None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:44.236666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd583f-711c-4d69-8b6b-8468cff2b9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:44.254177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-e5fd583f-711c-4d69-8b6b-8468cff2b9de None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:44.255363 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e5fd583f-711c-4d69-8b6b-8468cff2b9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:44.263159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 702/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 6 23:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:26:44.415865 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368fae2-378c-4243-88e3-b7c669bebd34 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:44.429816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368fae2-378c-4243-88e3-b7c669bebd34 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:44.435152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6427e-4ac0-4e14-b7fd-bd822dedb2bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:44.435777 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6427e-4ac0-4e14-b7fd-bd822dedb2bb service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:44.436059 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6427e-4ac0-4e14-b7fd-bd822dedb2bb service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:44.436373 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6427e-4ac0-4e14-b7fd-bd822dedb2bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:44.444273 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6427e-4ac0-4e14-b7fd-bd822dedb2bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:44.445888 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6427e-4ac0-4e14-b7fd-bd822dedb2bb service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:44.455518 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 717/1419] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:26:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:26:45.388813 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b83223-4411-4820-b21f-4bfe52356e1d None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:45.389920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b83223-4411-4820-b21f-4bfe52356e1d None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:45.390026 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b83223-4411-4820-b21f-4bfe52356e1d None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:45.391365 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 703/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 6 23:26:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:45.396304 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecafc0-d237-4e1d-b694-06646d9f5e2d None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:45.396736 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecafc0-d237-4e1d-b694-06646d9f5e2d None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:45.396883 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecafc0-d237-4e1d-b694-06646d9f5e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:45.414401 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-6cecafc0-d237-4e1d-b694-06646d9f5e2d None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:45.415612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-6cecafc0-d237-4e1d-b694-06646d9f5e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:45.423341 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 718/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 6 23:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:45.574324 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b83223-4411-4820-b21f-4bfe52356e1d None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:45.588933 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b83223-4411-4820-b21f-4bfe52356e1d None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:45.594609 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf045a3-8bbd-454d-b4c1-008e912b2d92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:45.595263 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf045a3-8bbd-454d-b4c1-008e912b2d92 service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:45.595543 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf045a3-8bbd-454d-b4c1-008e912b2d92 service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:45.595818 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf045a3-8bbd-454d-b4c1-008e912b2d92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:45.603669 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf045a3-8bbd-454d-b4c1-008e912b2d92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:45.605277 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf045a3-8bbd-454d-b4c1-008e912b2d92 service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:45.614940 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 704/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:26:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:26:46.540404 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1a37d-73eb-45c3-bada-8266cd354e2f None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:46.540998 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1a37d-73eb-45c3-bada-8266cd354e2f None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:46.540998 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1a37d-73eb-45c3-bada-8266cd354e2f None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:46.542334 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 719/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 6 23:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:46.547329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24943a-3db2-497b-b957-6a149b233be5 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:46.547755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24943a-3db2-497b-b957-6a149b233be5 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:46.547883 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24943a-3db2-497b-b957-6a149b233be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:46.565298 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-4f24943a-3db2-497b-b957-6a149b233be5 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:46.566472 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-4f24943a-3db2-497b-b957-6a149b233be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:46.574118 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 705/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 6 23:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:46.720077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1a37d-73eb-45c3-bada-8266cd354e2f None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:46.733831 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1a37d-73eb-45c3-bada-8266cd354e2f None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:46.739043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73102c86-7f21-455e-bcec-ead7dda2b42b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:46.739661 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73102c86-7f21-455e-bcec-ead7dda2b42b service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:46.739937 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73102c86-7f21-455e-bcec-ead7dda2b42b service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:46.740207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73102c86-7f21-455e-bcec-ead7dda2b42b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:46.749213 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73102c86-7f21-455e-bcec-ead7dda2b42b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:46.750787 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73102c86-7f21-455e-bcec-ead7dda2b42b service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:46.759862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 720/1425] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:26:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:26:47.672023 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf08327-9f80-4f31-baf2-1e114586760d None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:47.672636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf08327-9f80-4f31-baf2-1e114586760d None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:47.672636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf08327-9f80-4f31-baf2-1e114586760d None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:47.673974 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 706/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 6 23:26:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:47.678806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474a133-4899-41ad-91bb-bb464da65fe8 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:47.679197 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474a133-4899-41ad-91bb-bb464da65fe8 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:47.679381 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474a133-4899-41ad-91bb-bb464da65fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:47.696569 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-1474a133-4899-41ad-91bb-bb464da65fe8 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:47.697752 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-1474a133-4899-41ad-91bb-bb464da65fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:47.705419 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 721/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 6 23:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:47.856869 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf08327-9f80-4f31-baf2-1e114586760d None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:47.871242 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf08327-9f80-4f31-baf2-1e114586760d None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:47.876526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47939303-70b6-40a7-9d21-ce2d4062d868 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:47.877167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47939303-70b6-40a7-9d21-ce2d4062d868 service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:47.877441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47939303-70b6-40a7-9d21-ce2d4062d868 service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:47.877709 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47939303-70b6-40a7-9d21-ce2d4062d868 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:47.885450 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47939303-70b6-40a7-9d21-ce2d4062d868 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:47.887017 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47939303-70b6-40a7-9d21-ce2d4062d868 service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:47.896862 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 707/1428] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:26:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:26:48.755254 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc4725-7343-4c5b-bccd-e40f0e04038b None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:48.755718 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc4725-7343-4c5b-bccd-e40f0e04038b None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:48.755828 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc4725-7343-4c5b-bccd-e40f0e04038b None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:48.757210 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 722/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 6 23:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:48.762037 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bdc59-f783-4d8b-82fd-4a2f138c4398 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:48.762420 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bdc59-f783-4d8b-82fd-4a2f138c4398 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:48.762581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bdc59-f783-4d8b-82fd-4a2f138c4398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:48.779751 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-918bdc59-f783-4d8b-82fd-4a2f138c4398 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:48.780989 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-918bdc59-f783-4d8b-82fd-4a2f138c4398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:48.788686 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 708/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 6 23:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:48.937393 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc4725-7343-4c5b-bccd-e40f0e04038b None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:48.951172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc4725-7343-4c5b-bccd-e40f0e04038b None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:48.956509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28673a5-4a65-490d-a528-d6d7998dc731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:48.957163 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28673a5-4a65-490d-a528-d6d7998dc731 service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:48.957443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28673a5-4a65-490d-a528-d6d7998dc731 service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:48.957716 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28673a5-4a65-490d-a528-d6d7998dc731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:48.965609 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28673a5-4a65-490d-a528-d6d7998dc731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:48.967127 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28673a5-4a65-490d-a528-d6d7998dc731 service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:48.976494 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 723/1431] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:26:49.856783 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44c254-8eca-4a13-9088-68322f59bcc9 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:49.857223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44c254-8eca-4a13-9088-68322f59bcc9 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:49.857338 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44c254-8eca-4a13-9088-68322f59bcc9 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:49.858741 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 709/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 6 23:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:49.863653 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7ed5b-be4d-491a-83a1-0e03840988c9 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:49.864058 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7ed5b-be4d-491a-83a1-0e03840988c9 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:49.864193 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7ed5b-be4d-491a-83a1-0e03840988c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:49.882197 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-afc7ed5b-be4d-491a-83a1-0e03840988c9 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:49.883388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-afc7ed5b-be4d-491a-83a1-0e03840988c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:49.891674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 724/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 6 23:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:26:50.038598 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44c254-8eca-4a13-9088-68322f59bcc9 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:50.052483 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44c254-8eca-4a13-9088-68322f59bcc9 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:50.057771 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cfe45-ddae-490f-8fda-b35dc0beea6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:50.058395 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cfe45-ddae-490f-8fda-b35dc0beea6a service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:50.058675 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cfe45-ddae-490f-8fda-b35dc0beea6a service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:50.058950 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cfe45-ddae-490f-8fda-b35dc0beea6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:50.067459 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cfe45-ddae-490f-8fda-b35dc0beea6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:50.069020 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cfe45-ddae-490f-8fda-b35dc0beea6a service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:50.078601 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 710/1434] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:26:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:26:50.945209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec65ab7-dfbc-4f47-8096-fcda0c65afbd None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:50.945760 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec65ab7-dfbc-4f47-8096-fcda0c65afbd None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:50.945760 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec65ab7-dfbc-4f47-8096-fcda0c65afbd None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:50.947132 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 725/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 6 23:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:50.952058 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedcca3-2c77-4607-bc59-54f9885b40b4 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:50.952503 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedcca3-2c77-4607-bc59-54f9885b40b4 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:50.952715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedcca3-2c77-4607-bc59-54f9885b40b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:50.971047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-9fedcca3-2c77-4607-bc59-54f9885b40b4 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:50.972213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9fedcca3-2c77-4607-bc59-54f9885b40b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:50.979844 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 711/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 6 23:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:51.126178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec65ab7-dfbc-4f47-8096-fcda0c65afbd None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:51.140090 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec65ab7-dfbc-4f47-8096-fcda0c65afbd None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:51.145351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2775c-a8e1-4d2a-8eff-af6a4a0ace57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:51.146007 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2775c-a8e1-4d2a-8eff-af6a4a0ace57 service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:51.146283 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2775c-a8e1-4d2a-8eff-af6a4a0ace57 service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:51.146553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2775c-a8e1-4d2a-8eff-af6a4a0ace57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:51.154461 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2775c-a8e1-4d2a-8eff-af6a4a0ace57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:51.156078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2775c-a8e1-4d2a-8eff-af6a4a0ace57 service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:51.165526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 726/1437] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:26:52.023079 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48612879-ef2d-4f28-8f32-70924dd8a163 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:52.023629 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48612879-ef2d-4f28-8f32-70924dd8a163 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:52.023629 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48612879-ef2d-4f28-8f32-70924dd8a163 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:52.025070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 712/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 6 23:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:52.030353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3811e2d-a4e0-42d0-ae52-ff1cf27c8823 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:52.030794 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3811e2d-a4e0-42d0-ae52-ff1cf27c8823 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:52.030899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3811e2d-a4e0-42d0-ae52-ff1cf27c8823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:52.048663 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-c3811e2d-a4e0-42d0-ae52-ff1cf27c8823 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:52.049828 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c3811e2d-a4e0-42d0-ae52-ff1cf27c8823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:52.057410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 727/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 6 23:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:26:52.205172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48612879-ef2d-4f28-8f32-70924dd8a163 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:52.220307 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48612879-ef2d-4f28-8f32-70924dd8a163 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:52.225656 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ef4fc-335a-4841-b6b9-9be6c8681aa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:52.226281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ef4fc-335a-4841-b6b9-9be6c8681aa6 service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:52.226556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ef4fc-335a-4841-b6b9-9be6c8681aa6 service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:52.226826 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ef4fc-335a-4841-b6b9-9be6c8681aa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:52.235326 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ef4fc-335a-4841-b6b9-9be6c8681aa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:52.236956 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ef4fc-335a-4841-b6b9-9be6c8681aa6 service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:52.245872 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 713/1440] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:26:54.307990 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c09e7-696a-44e1-b4f8-5f12ad6c3554 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:54.308579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c09e7-696a-44e1-b4f8-5f12ad6c3554 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:54.308579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c09e7-696a-44e1-b4f8-5f12ad6c3554 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:54.309930 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 728/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 6 23:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:54.315168 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf1dc5-ab06-4e60-87f8-e1b42f1320d2 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:54.315573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf1dc5-ab06-4e60-87f8-e1b42f1320d2 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:54.315711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf1dc5-ab06-4e60-87f8-e1b42f1320d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:54.332566 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-9fcf1dc5-ab06-4e60-87f8-e1b42f1320d2 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:54.333731 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9fcf1dc5-ab06-4e60-87f8-e1b42f1320d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:54.341255 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 714/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 6 23:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:54.378849 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c09e7-696a-44e1-b4f8-5f12ad6c3554 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:54.389368 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c09e7-696a-44e1-b4f8-5f12ad6c3554 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:54.392955 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3f8b4-cc25-4d56-ad56-29daf0e61145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:54.393577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3f8b4-cc25-4d56-ad56-29daf0e61145 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:54.393856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3f8b4-cc25-4d56-ad56-29daf0e61145 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:54.394127 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3f8b4-cc25-4d56-ad56-29daf0e61145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:54.402878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3f8b4-cc25-4d56-ad56-29daf0e61145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:54.404299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3f8b4-cc25-4d56-ad56-29daf0e61145 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:54.413931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 729/1443] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:26:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:26:56.748985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d607c-ef19-49b5-9c05-641fee3f3a7c None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:56.749511 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d607c-ef19-49b5-9c05-641fee3f3a7c None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:56.749511 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d607c-ef19-49b5-9c05-641fee3f3a7c None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:56.750924 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 715/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 6 23:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:56.756027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0273d4-84c7-4f96-952f-72e7b667ddb7 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:56.756453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0273d4-84c7-4f96-952f-72e7b667ddb7 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:56.756638 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0273d4-84c7-4f96-952f-72e7b667ddb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:56.773816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-2a0273d4-84c7-4f96-952f-72e7b667ddb7 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:56.775013 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-2a0273d4-84c7-4f96-952f-72e7b667ddb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:56.783471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 730/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 6 23:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:56.820140 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d607c-ef19-49b5-9c05-641fee3f3a7c None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:56.830768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d607c-ef19-49b5-9c05-641fee3f3a7c None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:56.834343 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d67c74-31b5-43bc-9d50-e49b1fe3c5b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:56.834928 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d67c74-31b5-43bc-9d50-e49b1fe3c5b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:56.835210 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d67c74-31b5-43bc-9d50-e49b1fe3c5b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:56.835480 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d67c74-31b5-43bc-9d50-e49b1fe3c5b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:56.845216 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d67c74-31b5-43bc-9d50-e49b1fe3c5b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:56.846659 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d67c74-31b5-43bc-9d50-e49b1fe3c5b9 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:56.855865 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 716/1446] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:26:59.347235 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584ef92-2488-4aca-abc9-697ecc5c42fd None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:59.347769 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584ef92-2488-4aca-abc9-697ecc5c42fd None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:59.347769 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584ef92-2488-4aca-abc9-697ecc5c42fd None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:59.349198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 731/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 6 23:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:26:59.354550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca3e19-8414-4de1-9fdf-e88c36e1b2e4 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:59.354944 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca3e19-8414-4de1-9fdf-e88c36e1b2e4 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:59.355129 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca3e19-8414-4de1-9fdf-e88c36e1b2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:59.372716 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-c5ca3e19-8414-4de1-9fdf-e88c36e1b2e4 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:26:59.374507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c5ca3e19-8414-4de1-9fdf-e88c36e1b2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:26:59.382202 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 717/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 6 23:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:26:59.418835 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584ef92-2488-4aca-abc9-697ecc5c42fd None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:26:59.429616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584ef92-2488-4aca-abc9-697ecc5c42fd None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:26:59.433055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70505170-bbad-4b59-994d-399270f9c39d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:26:59.433674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70505170-bbad-4b59-994d-399270f9c39d service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:26:59.433951 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70505170-bbad-4b59-994d-399270f9c39d service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:26:59.434222 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70505170-bbad-4b59-994d-399270f9c39d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:26:59.443470 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70505170-bbad-4b59-994d-399270f9c39d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:26:59.444924 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70505170-bbad-4b59-994d-399270f9c39d service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:26:59.454023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 732/1449] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:26:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:27:01.852216 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa87369-ba83-4a16-bc06-b193967303a8 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:01.852699 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa87369-ba83-4a16-bc06-b193967303a8 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:01.852802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa87369-ba83-4a16-bc06-b193967303a8 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:01.854177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 718/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 6 23:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:27:01.860282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd8a4b-c803-4cf8-b26c-71e6264baf33 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:01.860735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd8a4b-c803-4cf8-b26c-71e6264baf33 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:01.860874 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd8a4b-c803-4cf8-b26c-71e6264baf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:01.878232 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-e1dd8a4b-c803-4cf8-b26c-71e6264baf33 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:27:01.879452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-e1dd8a4b-c803-4cf8-b26c-71e6264baf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:27:01.887220 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 733/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 6 23:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:27:01.925254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa87369-ba83-4a16-bc06-b193967303a8 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:27:01.935510 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa87369-ba83-4a16-bc06-b193967303a8 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:27:01.938969 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bab0bc-4de7-425e-b3c1-f64040cb78e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:27:01.939588 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bab0bc-4de7-425e-b3c1-f64040cb78e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:01.939870 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bab0bc-4de7-425e-b3c1-f64040cb78e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:01.940144 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bab0bc-4de7-425e-b3c1-f64040cb78e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:01.948701 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bab0bc-4de7-425e-b3c1-f64040cb78e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:27:01.950125 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bab0bc-4de7-425e-b3c1-f64040cb78e0 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:27:01.959140 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 719/1452] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:27:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:27:04.207704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e08bf7-e4ec-4745-ab59-e997d69315a2 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:04.208227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e08bf7-e4ec-4745-ab59-e997d69315a2 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:04.208227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e08bf7-e4ec-4745-ab59-e997d69315a2 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:04.209591 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 734/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 6 23:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:27:04.214968 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c11f7-427e-4098-b15c-8ca759877cb0 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:04.215390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c11f7-427e-4098-b15c-8ca759877cb0 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:04.215523 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c11f7-427e-4098-b15c-8ca759877cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:04.234881 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-381c11f7-427e-4098-b15c-8ca759877cb0 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:27:04.236060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-381c11f7-427e-4098-b15c-8ca759877cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:27:04.243817 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 720/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 6 23:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:27:04.280374 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e08bf7-e4ec-4745-ab59-e997d69315a2 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:27:04.290926 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e08bf7-e4ec-4745-ab59-e997d69315a2 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:27:04.294444 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff7914-3ef2-4b79-ad0d-58bc29ecd37b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:27:04.295662 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff7914-3ef2-4b79-ad0d-58bc29ecd37b service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:04.295947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff7914-3ef2-4b79-ad0d-58bc29ecd37b service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:04.296225 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff7914-3ef2-4b79-ad0d-58bc29ecd37b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:04.304918 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff7914-3ef2-4b79-ad0d-58bc29ecd37b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:27:04.306383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff7914-3ef2-4b79-ad0d-58bc29ecd37b service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:27:04.315651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 735/1455] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:27:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:27:06.561612 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099cb9c-9551-46b8-aa1d-daf12a2c5bbe None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:06.562177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099cb9c-9551-46b8-aa1d-daf12a2c5bbe None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:06.562177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099cb9c-9551-46b8-aa1d-daf12a2c5bbe None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:06.563523 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 721/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 6 23:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:27:06.568986 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c04d3-d1f2-487c-b1eb-4e902cfee765 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:06.569419 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c04d3-d1f2-487c-b1eb-4e902cfee765 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:06.569529 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c04d3-d1f2-487c-b1eb-4e902cfee765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:06.587232 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-075c04d3-d1f2-487c-b1eb-4e902cfee765 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:27:06.588410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-075c04d3-d1f2-487c-b1eb-4e902cfee765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:27:06.596344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 736/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 6 23:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:27:06.633814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099cb9c-9551-46b8-aa1d-daf12a2c5bbe None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:27:06.644071 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099cb9c-9551-46b8-aa1d-daf12a2c5bbe None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:27:06.647477 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fb560-8b0e-4294-a3a1-1cf8b1a198b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:27:06.648122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fb560-8b0e-4294-a3a1-1cf8b1a198b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:06.648398 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fb560-8b0e-4294-a3a1-1cf8b1a198b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:06.648699 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fb560-8b0e-4294-a3a1-1cf8b1a198b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:06.657111 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fb560-8b0e-4294-a3a1-1cf8b1a198b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:27:06.658531 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fb560-8b0e-4294-a3a1-1cf8b1a198b8 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:27:06.667399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 722/1458] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:27:08.924208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0533e1-02a4-4c4e-95cd-73f2ef9e4b9b None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:08.924740 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0533e1-02a4-4c4e-95cd-73f2ef9e4b9b None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:08.924836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0533e1-02a4-4c4e-95cd-73f2ef9e4b9b None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:08.926142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 737/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 6 23:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:27:08.931319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20597f5-f301-40d9-a712-f0d9d1a3cc97 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:08.931733 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20597f5-f301-40d9-a712-f0d9d1a3cc97 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:08.931873 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20597f5-f301-40d9-a712-f0d9d1a3cc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:08.949005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-e20597f5-f301-40d9-a712-f0d9d1a3cc97 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:27:08.950183 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e20597f5-f301-40d9-a712-f0d9d1a3cc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:27:08.958416 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 723/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 6 23:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:27:08.996686 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0533e1-02a4-4c4e-95cd-73f2ef9e4b9b None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:27:08.998337 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-0e0533e1-02a4-4c4e-95cd-73f2ef9e4b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:27:09.010697 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0533e1-02a4-4c4e-95cd-73f2ef9e4b9b None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:27:09.014630 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0d7e5-a213-48ed-a4be-acf3006424d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:27:09.015245 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0d7e5-a213-48ed-a4be-acf3006424d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:09.015522 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0d7e5-a213-48ed-a4be-acf3006424d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:09.015793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0d7e5-a213-48ed-a4be-acf3006424d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:09.024902 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0d7e5-a213-48ed-a4be-acf3006424d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:27:09.026390 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0d7e5-a213-48ed-a4be-acf3006424d9 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:27:09.036306 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 738/1461] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:27:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:27:11.291048 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da433dea-4849-4720-9fdf-47969a0922d2 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:11.291600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da433dea-4849-4720-9fdf-47969a0922d2 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:11.291600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da433dea-4849-4720-9fdf-47969a0922d2 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:11.292996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 724/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 6 23:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:27:11.298690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b13b3-5bac-4a9d-a096-296aa0c5045c None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:11.299118 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b13b3-5bac-4a9d-a096-296aa0c5045c None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:11.299239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b13b3-5bac-4a9d-a096-296aa0c5045c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:11.317306 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-704b13b3-5bac-4a9d-a096-296aa0c5045c None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:27:11.318490 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-704b13b3-5bac-4a9d-a096-296aa0c5045c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:27:11.326210 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 739/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 6 23:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:27:11.362226 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da433dea-4849-4720-9fdf-47969a0922d2 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:27:11.372409 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da433dea-4849-4720-9fdf-47969a0922d2 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:27:11.376403 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f68880-a4b6-43b6-ac63-1dc9202c3e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:27:11.377051 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f68880-a4b6-43b6-ac63-1dc9202c3e31 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:11.377328 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f68880-a4b6-43b6-ac63-1dc9202c3e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:11.377597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f68880-a4b6-43b6-ac63-1dc9202c3e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:11.386000 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f68880-a4b6-43b6-ac63-1dc9202c3e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:27:11.387418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f68880-a4b6-43b6-ac63-1dc9202c3e31 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:27:11.396623 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 725/1464] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:27:13.637551 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f54718-12bd-47f5-b8ad-059b73702685 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:13.638120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f54718-12bd-47f5-b8ad-059b73702685 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:13.638120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f54718-12bd-47f5-b8ad-059b73702685 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:13.639984 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 740/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 6 23:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:27:13.645295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5fda2-8ec3-4765-a681-0f151fa28a92 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:13.645686 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5fda2-8ec3-4765-a681-0f151fa28a92 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:13.645841 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5fda2-8ec3-4765-a681-0f151fa28a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:13.663568 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-8be5fda2-8ec3-4765-a681-0f151fa28a92 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:27:13.664799 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-8be5fda2-8ec3-4765-a681-0f151fa28a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:27:13.672730 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 726/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 6 23:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:27:13.707899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f54718-12bd-47f5-b8ad-059b73702685 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:27:13.719064 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f54718-12bd-47f5-b8ad-059b73702685 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:27:13.722939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3707ba7-6e63-44fb-897e-7e44db844023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:27:13.723569 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3707ba7-6e63-44fb-897e-7e44db844023 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:13.723853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3707ba7-6e63-44fb-897e-7e44db844023 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:13.724132 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3707ba7-6e63-44fb-897e-7e44db844023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:13.733054 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3707ba7-6e63-44fb-897e-7e44db844023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:27:13.734475 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3707ba7-6e63-44fb-897e-7e44db844023 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:27:13.743625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 741/1467] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:27:15.999841 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed21c3f-303e-4fbb-93ed-fa86ce63cc59 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:16.000377 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed21c3f-303e-4fbb-93ed-fa86ce63cc59 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:16.000377 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed21c3f-303e-4fbb-93ed-fa86ce63cc59 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:16.001814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 727/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 6 23:27:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:27:16.007053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1ca8d-8d9e-49d6-9a61-418f2ffe2f8e None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:16.007458 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1ca8d-8d9e-49d6-9a61-418f2ffe2f8e None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:16.007600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1ca8d-8d9e-49d6-9a61-418f2ffe2f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:16.025523 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-aca1ca8d-8d9e-49d6-9a61-418f2ffe2f8e None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:27:16.026692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-aca1ca8d-8d9e-49d6-9a61-418f2ffe2f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:27:16.034366 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 742/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 6 23:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:27:16.069124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed21c3f-303e-4fbb-93ed-fa86ce63cc59 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:27:16.080236 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed21c3f-303e-4fbb-93ed-fa86ce63cc59 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:27:16.083665 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bc806-1e4a-4eda-87ac-505e92f46737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:27:16.084289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bc806-1e4a-4eda-87ac-505e92f46737 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:16.084596 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bc806-1e4a-4eda-87ac-505e92f46737 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:16.084870 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bc806-1e4a-4eda-87ac-505e92f46737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:16.093677 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bc806-1e4a-4eda-87ac-505e92f46737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:27:16.095100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bc806-1e4a-4eda-87ac-505e92f46737 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:27:16.104094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 728/1470] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:27:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:27:49.074801 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa75cbf-2219-4aeb-8ea4-b6a96c8a94d4 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:49.075399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa75cbf-2219-4aeb-8ea4-b6a96c8a94d4 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:49.075399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa75cbf-2219-4aeb-8ea4-b6a96c8a94d4 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:49.076785 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 743/1471] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:27:49.081755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58685c-5bf7-43d4-809d-f6b831f2b062 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:49.082175 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58685c-5bf7-43d4-809d-f6b831f2b062 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:49.082305 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58685c-5bf7-43d4-809d-f6b831f2b062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:49.099963 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-1d58685c-5bf7-43d4-809d-f6b831f2b062 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:27:49.101153 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-1d58685c-5bf7-43d4-809d-f6b831f2b062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:27:49.109392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 729/1472] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:27:49.154620 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa1729-9fb6-4574-bd1a-fa33a68387a2 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:49.154903 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa1729-9fb6-4574-bd1a-fa33a68387a2 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:49.155173 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa1729-9fb6-4574-bd1a-fa33a68387a2 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:49.156517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 744/1473] 10.222.0.60 () {54 vars in 962 bytes} [Fri May 6 23:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:27:49.161235 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec679b-20fe-4488-8e44-ed66ea9864a9 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:49.161516 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec679b-20fe-4488-8e44-ed66ea9864a9 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:49.161785 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec679b-20fe-4488-8e44-ed66ea9864a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:49.179540 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-c5ec679b-20fe-4488-8e44-ed66ea9864a9 None None] MFA Rules not processed for user `a63ecc7210574058aad75a3114b57202`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:27:49.180725 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c5ec679b-20fe-4488-8e44-ed66ea9864a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:27:49.186984 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 730/1474] 10.222.0.60 () {58 vars in 1059 bytes} [Fri May 6 23:27:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:27:49.193806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa1729-9fb6-4574-bd1a-fa33a68387a2 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:27:49.204183 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa1729-9fb6-4574-bd1a-fa33a68387a2 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:27:49.207620 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54db94d-4f2a-40dd-968f-8d81d1a985f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a63ecc7210574058aad75a3114b57202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:27:49.208221 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54db94d-4f2a-40dd-968f-8d81d1a985f8 service glance] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:49.208496 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54db94d-4f2a-40dd-968f-8d81d1a985f8 service glance] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:49.208796 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54db94d-4f2a-40dd-968f-8d81d1a985f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:49.218221 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54db94d-4f2a-40dd-968f-8d81d1a985f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:27:49.219922 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54db94d-4f2a-40dd-968f-8d81d1a985f8 service glance] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:27:49.229285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 745/1475] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:27:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:27:51.517071 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ce297-4a05-4d52-bcb4-df16d3c7194f None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:51.517597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ce297-4a05-4d52-bcb4-df16d3c7194f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:51.517597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ce297-4a05-4d52-bcb4-df16d3c7194f None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:51.518905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 731/1476] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:27:51.524041 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e9062-da6e-476f-b747-818a7faa91b1 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:51.524443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e9062-da6e-476f-b747-818a7faa91b1 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:51.524621 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e9062-da6e-476f-b747-818a7faa91b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:51.542077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-156e9062-da6e-476f-b747-818a7faa91b1 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:27:51.543244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-156e9062-da6e-476f-b747-818a7faa91b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:27:51.551811 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 746/1477] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:27:51.574118 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ce297-4a05-4d52-bcb4-df16d3c7194f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:27:51.586066 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ce297-4a05-4d52-bcb4-df16d3c7194f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:27:51.590390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19195e90-99fb-4f8b-9282-590aecb46dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:27:51.591530 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19195e90-99fb-4f8b-9282-590aecb46dec admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:51.591809 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19195e90-99fb-4f8b-9282-590aecb46dec admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:51.592083 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19195e90-99fb-4f8b-9282-590aecb46dec admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:51.592834 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19195e90-99fb-4f8b-9282-590aecb46dec admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:27:51.594826 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: WARNING py.warnings [None req-19195e90-99fb-4f8b-9282-590aecb46dec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 06 23:27:51.594826 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: warnings.warn(msg) May 06 23:27:51.594826 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: May 06 23:27:51.595966 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19195e90-99fb-4f8b-9282-590aecb46dec admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:27:51.614770 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 732/1478] 10.222.0.60 () {56 vars in 1108 bytes} [Fri May 6 23:27:51 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:27:53.825934 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdee17b-a46a-4cf9-a2b0-f0a999b44997 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:53.826480 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdee17b-a46a-4cf9-a2b0-f0a999b44997 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:53.826480 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdee17b-a46a-4cf9-a2b0-f0a999b44997 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:53.827843 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 747/1479] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:27:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:27:53.833220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13a0e3-02a7-48b9-a61b-691a38684e56 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:53.833644 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13a0e3-02a7-48b9-a61b-691a38684e56 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:53.833768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13a0e3-02a7-48b9-a61b-691a38684e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:53.852148 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-fe13a0e3-02a7-48b9-a61b-691a38684e56 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:27:53.853383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-fe13a0e3-02a7-48b9-a61b-691a38684e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:27:53.861884 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 733/1480] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:27:53.903240 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdee17b-a46a-4cf9-a2b0-f0a999b44997 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:27:53.917026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdee17b-a46a-4cf9-a2b0-f0a999b44997 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:27:53.922774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bd9b5-b30c-4aae-959d-e76620d8707e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:27:53.923395 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bd9b5-b30c-4aae-959d-e76620d8707e service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:53.923672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bd9b5-b30c-4aae-959d-e76620d8707e service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:53.923949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bd9b5-b30c-4aae-959d-e76620d8707e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:53.931652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bd9b5-b30c-4aae-959d-e76620d8707e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:27:53.933253 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bd9b5-b30c-4aae-959d-e76620d8707e service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:27:53.942906 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 748/1481] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:27:56.311253 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fbfaf-a36c-403c-87b2-f8e36280bc70 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:56.311835 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fbfaf-a36c-403c-87b2-f8e36280bc70 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:56.311835 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fbfaf-a36c-403c-87b2-f8e36280bc70 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:56.313271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 734/1482] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:27:56.318766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610b6b8-d13b-4721-8a62-a5e88a4a4855 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:56.319185 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610b6b8-d13b-4721-8a62-a5e88a4a4855 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:56.319323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610b6b8-d13b-4721-8a62-a5e88a4a4855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:56.337005 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-b610b6b8-d13b-4721-8a62-a5e88a4a4855 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:27:56.338189 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b610b6b8-d13b-4721-8a62-a5e88a4a4855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:27:56.346841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 749/1483] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:27:56.381409 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fbfaf-a36c-403c-87b2-f8e36280bc70 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:27:56.392466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fbfaf-a36c-403c-87b2-f8e36280bc70 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:27:56.396242 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6fe3d-c3f3-4a4b-b6d5-927acbcb0a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:27:56.396890 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6fe3d-c3f3-4a4b-b6d5-927acbcb0a5b service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:56.397168 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6fe3d-c3f3-4a4b-b6d5-927acbcb0a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:56.397438 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6fe3d-c3f3-4a4b-b6d5-927acbcb0a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:56.406506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6fe3d-c3f3-4a4b-b6d5-927acbcb0a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:27:56.407920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6fe3d-c3f3-4a4b-b6d5-927acbcb0a5b service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:27:56.417081 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 735/1484] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:27:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:27:58.680498 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a9f8a-8a50-469f-a1a0-808fb2176d55 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:58.681118 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a9f8a-8a50-469f-a1a0-808fb2176d55 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:58.681118 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a9f8a-8a50-469f-a1a0-808fb2176d55 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:58.682456 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 750/1485] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:27:58.688253 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfa7b0-d631-47b8-a9d1-46368e94da87 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:58.688678 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfa7b0-d631-47b8-a9d1-46368e94da87 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:58.688831 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfa7b0-d631-47b8-a9d1-46368e94da87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:58.705747 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-5fbfa7b0-d631-47b8-a9d1-46368e94da87 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:27:58.706917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-5fbfa7b0-d631-47b8-a9d1-46368e94da87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:27:58.714599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 736/1486] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:27:58.751973 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a9f8a-8a50-469f-a1a0-808fb2176d55 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:27:58.762344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a9f8a-8a50-469f-a1a0-808fb2176d55 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:27:58.766162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb0b68-f4d3-4faa-a409-74b8da3197de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:27:58.766795 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb0b68-f4d3-4faa-a409-74b8da3197de service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:27:58.767077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb0b68-f4d3-4faa-a409-74b8da3197de service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:27:58.767351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb0b68-f4d3-4faa-a409-74b8da3197de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:27:58.776268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb0b68-f4d3-4faa-a409-74b8da3197de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:27:58.778246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb0b68-f4d3-4faa-a409-74b8da3197de service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:27:58.787468 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 751/1487] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:27:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:28:01.131393 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c409b-6882-40b6-a453-bc51339ba569 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:28:01.131950 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c409b-6882-40b6-a453-bc51339ba569 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:28:01.131950 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c409b-6882-40b6-a453-bc51339ba569 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:28:01.133267 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 737/1488] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:28:01.138374 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87063af-5335-4e3b-a997-dd27350bbe66 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:28:01.138817 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87063af-5335-4e3b-a997-dd27350bbe66 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:28:01.138926 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87063af-5335-4e3b-a997-dd27350bbe66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:28:01.157596 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-d87063af-5335-4e3b-a997-dd27350bbe66 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:28:01.158796 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d87063af-5335-4e3b-a997-dd27350bbe66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:28:01.166573 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 752/1489] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:28:01.206151 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c409b-6882-40b6-a453-bc51339ba569 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:28:01.216957 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c409b-6882-40b6-a453-bc51339ba569 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:28:01.220673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26c34e-98f9-486a-90cc-050c110a6f78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:28:01.221300 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26c34e-98f9-486a-90cc-050c110a6f78 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:28:01.221581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26c34e-98f9-486a-90cc-050c110a6f78 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:28:01.221854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26c34e-98f9-486a-90cc-050c110a6f78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:28:01.230400 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26c34e-98f9-486a-90cc-050c110a6f78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:28:01.232417 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26c34e-98f9-486a-90cc-050c110a6f78 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:28:01.241407 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 738/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:28:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:28:03.803192 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9471e6-2c30-481e-adbe-969c0f7f8432 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:28:03.803797 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9471e6-2c30-481e-adbe-969c0f7f8432 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:28:03.803797 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9471e6-2c30-481e-adbe-969c0f7f8432 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:28:03.805154 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 753/1491] 10.222.0.60 () {54 vars in 926 bytes} [Fri May 6 23:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:28:03.811077 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a9bea-4439-40ca-bde7-2a06840174f4 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:28:03.811529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a9bea-4439-40ca-bde7-2a06840174f4 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:28:03.811637 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a9bea-4439-40ca-bde7-2a06840174f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:28:03.829762 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-d80a9bea-4439-40ca-bde7-2a06840174f4 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:28:03.830957 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-d80a9bea-4439-40ca-bde7-2a06840174f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:28:03.839134 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 739/1492] 10.222.0.60 () {58 vars in 1023 bytes} [Fri May 6 23:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:28:03.877912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9471e6-2c30-481e-adbe-969c0f7f8432 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:28:03.888068 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9471e6-2c30-481e-adbe-969c0f7f8432 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:28:03.891539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006069c-a219-439d-92e9-374fbb57bc3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:28:03.892159 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006069c-a219-439d-92e9-374fbb57bc3c service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:28:03.892436 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006069c-a219-439d-92e9-374fbb57bc3c service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:28:03.892741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006069c-a219-439d-92e9-374fbb57bc3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:28:03.901148 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006069c-a219-439d-92e9-374fbb57bc3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:28:03.902560 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006069c-a219-439d-92e9-374fbb57bc3c service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:28:03.911512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 754/1493] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:29:36.312058 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34b196-d1af-4601-8d47-dec14975217f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:29:36.312610 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34b196-d1af-4601-8d47-dec14975217f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:29:36.312610 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34b196-d1af-4601-8d47-dec14975217f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:29:36.331074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-bf34b196-d1af-4601-8d47-dec14975217f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:29:36.332241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-bf34b196-d1af-4601-8d47-dec14975217f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:29:36.340381 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 740/1494] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:29:36.349706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d74cd3-044d-4093-b0f9-9c4c39fc518a None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:29:36.350210 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d74cd3-044d-4093-b0f9-9c4c39fc518a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:29:36.350321 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d74cd3-044d-4093-b0f9-9c4c39fc518a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:29:36.367958 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-47d74cd3-044d-4093-b0f9-9c4c39fc518a None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:29:36.369151 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-47d74cd3-044d-4093-b0f9-9c4c39fc518a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:29:36.376811 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 755/1495] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:29:36.381084 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34b196-d1af-4601-8d47-dec14975217f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:29:36.390497 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34b196-d1af-4601-8d47-dec14975217f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:29:36.394917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57960c2a-cfb8-4c46-94f1-47148dcc9a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:29:36.395549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960c2a-cfb8-4c46-94f1-47148dcc9a5f admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:29:36.395825 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960c2a-cfb8-4c46-94f1-47148dcc9a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:29:36.396095 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960c2a-cfb8-4c46-94f1-47148dcc9a5f admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:29:36.396835 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57960c2a-cfb8-4c46-94f1-47148dcc9a5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:29:36.397136 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57960c2a-cfb8-4c46-94f1-47148dcc9a5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:29:36.398139 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: WARNING py.warnings [None req-57960c2a-cfb8-4c46-94f1-47148dcc9a5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 06 23:29:36.398139 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: warnings.warn(msg) May 06 23:29:36.398139 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: May 06 23:29:36.399029 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57960c2a-cfb8-4c46-94f1-47148dcc9a5f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:29:36.410458 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 741/1496] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:29:36.418788 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d74cd3-044d-4093-b0f9-9c4c39fc518a None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:29:36.427429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d74cd3-044d-4093-b0f9-9c4c39fc518a None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:29:36.431899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2b51d-3696-4b0b-b3fb-382108d3bca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:29:36.432573 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2b51d-3696-4b0b-b3fb-382108d3bca7 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:29:36.432858 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2b51d-3696-4b0b-b3fb-382108d3bca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:29:36.433164 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2b51d-3696-4b0b-b3fb-382108d3bca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:29:36.433853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2b51d-3696-4b0b-b3fb-382108d3bca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:29:36.435637 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: WARNING py.warnings [None req-c3a2b51d-3696-4b0b-b3fb-382108d3bca7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 06 23:29:36.435637 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: warnings.warn(msg) May 06 23:29:36.435637 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: May 06 23:29:36.436839 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2b51d-3696-4b0b-b3fb-382108d3bca7 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:29:36.471435 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 756/1497] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:29:36 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:29:36.475514 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57960c2a-cfb8-4c46-94f1-47148dcc9a5f admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:29:36.485735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57960c2a-cfb8-4c46-94f1-47148dcc9a5f admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:29:36.537354 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc14d9-845e-45c1-94d5-5f7ff6adbae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:29:36.538007 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc14d9-845e-45c1-94d5-5f7ff6adbae6 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:29:36.538288 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc14d9-845e-45c1-94d5-5f7ff6adbae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:29:36.538563 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc14d9-845e-45c1-94d5-5f7ff6adbae6 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:29:36.539237 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc14d9-845e-45c1-94d5-5f7ff6adbae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:29:36.540248 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: WARNING py.warnings [None req-01dc14d9-845e-45c1-94d5-5f7ff6adbae6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 06 23:29:36.540248 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: warnings.warn(msg) May 06 23:29:36.540248 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: May 06 23:29:36.541487 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc14d9-845e-45c1-94d5-5f7ff6adbae6 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:29:36.559517 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 742/1498] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:29:36 2022] POST /identity/v3/users => generated 290 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:29:36.563701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2b51d-3696-4b0b-b3fb-382108d3bca7 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:29:36.574346 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2b51d-3696-4b0b-b3fb-382108d3bca7 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:29:36.578810 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5bc67-61fa-4a0e-99b9-1c9504853389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:29:36.579481 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5bc67-61fa-4a0e-99b9-1c9504853389 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:29:36.579760 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5bc67-61fa-4a0e-99b9-1c9504853389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:29:36.580031 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5bc67-61fa-4a0e-99b9-1c9504853389 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:29:36.580783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5bc67-61fa-4a0e-99b9-1c9504853389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:29:36.581783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: WARNING py.warnings [None req-a0b5bc67-61fa-4a0e-99b9-1c9504853389 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 06 23:29:36.581783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: warnings.warn(msg) May 06 23:29:36.581783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: May 06 23:29:36.582649 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5bc67-61fa-4a0e-99b9-1c9504853389 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:29:36.595673 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 757/1499] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:29:36.599720 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc14d9-845e-45c1-94d5-5f7ff6adbae6 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:29:36.609192 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc14d9-845e-45c1-94d5-5f7ff6adbae6 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:29:36.613601 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265efa5-5557-45f7-8283-4d223992ec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:29:36.614236 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265efa5-5557-45f7-8283-4d223992ec3a admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:29:36.614517 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265efa5-5557-45f7-8283-4d223992ec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:29:36.614788 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265efa5-5557-45f7-8283-4d223992ec3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:29:36.615498 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265efa5-5557-45f7-8283-4d223992ec3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:29:36.616493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: WARNING py.warnings [None req-0265efa5-5557-45f7-8283-4d223992ec3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 06 23:29:36.616493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: warnings.warn(msg) May 06 23:29:36.616493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: May 06 23:29:36.617396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265efa5-5557-45f7-8283-4d223992ec3a admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:29:36.630056 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 743/1500] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:29:36.634083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5bc67-61fa-4a0e-99b9-1c9504853389 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:29:36.644143 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5bc67-61fa-4a0e-99b9-1c9504853389 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:29:36.648824 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fce47-1c2a-4e70-8ca6-0ebacf785a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:29:36.649683 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fce47-1c2a-4e70-8ca6-0ebacf785a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:29:36.649963 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fce47-1c2a-4e70-8ca6-0ebacf785a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:29:36.650234 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fce47-1c2a-4e70-8ca6-0ebacf785a5b admin admin] PATH_INFO: `/v3/projects/c01e81d16e6145c692cedc5ac1e96799/users/7b9aa0e88cda43e8b81aa349e6add9cc/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:29:36.665114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fce47-1c2a-4e70-8ca6-0ebacf785a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c01e81d16e6145c692cedc5ac1e96799, user_id=7b9aa0e88cda43e8b81aa349e6add9cc, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:29:36.666147 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: WARNING py.warnings [None req-0b3fce47-1c2a-4e70-8ca6-0ebacf785a5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 06 23:29:36.666147 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: warnings.warn(msg) May 06 23:29:36.666147 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: May 06 23:29:36.668080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fce47-1c2a-4e70-8ca6-0ebacf785a5b admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:29:36.680416 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 758/1501] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:29:36 2022] PUT /identity/v3/projects/c01e81d16e6145c692cedc5ac1e96799/users/7b9aa0e88cda43e8b81aa349e6add9cc/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:29:36.691618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ce59e-2b4f-482e-9c2e-ee5e7aeb2ba9 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:29:36.691907 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ce59e-2b4f-482e-9c2e-ee5e7aeb2ba9 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:29:36.692182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ce59e-2b4f-482e-9c2e-ee5e7aeb2ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:29:36.718135 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-a79ce59e-2b4f-482e-9c2e-ee5e7aeb2ba9 None None] MFA Rules not processed for user `7b9aa0e88cda43e8b81aa349e6add9cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:29:36.719321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-a79ce59e-2b4f-482e-9c2e-ee5e7aeb2ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:29:36.779404 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 744/1502] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:29:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:29:36.792415 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1cb12-b981-454c-8a56-1f38f6147527 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:29:36.792734 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1cb12-b981-454c-8a56-1f38f6147527 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:29:36.793008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1cb12-b981-454c-8a56-1f38f6147527 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:29:36.794381 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 759/1503] 10.222.0.60 () {54 vars in 963 bytes} [Fri May 6 23:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:29:36.799156 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b31d4a-2dfe-4a72-a393-f1473208ba86 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:29:36.799462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b31d4a-2dfe-4a72-a393-f1473208ba86 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:29:36.799714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b31d4a-2dfe-4a72-a393-f1473208ba86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:29:36.817018 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-06b31d4a-2dfe-4a72-a393-f1473208ba86 None None] MFA Rules not processed for user `36d2df2ca106409995e139652ee995e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:29:36.818188 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-06b31d4a-2dfe-4a72-a393-f1473208ba86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:29:36.867039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 745/1504] 10.222.0.60 () {58 vars in 1060 bytes} [Fri May 6 23:29:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:29:36.877257 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1cb12-b981-454c-8a56-1f38f6147527 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:29:36.887815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1cb12-b981-454c-8a56-1f38f6147527 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:29:36.891417 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe87002-8c86-4a7e-bdee-eb279daa88dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:29:36.892039 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe87002-8c86-4a7e-bdee-eb279daa88dd service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:29:36.892318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe87002-8c86-4a7e-bdee-eb279daa88dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:29:36.892625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe87002-8c86-4a7e-bdee-eb279daa88dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:29:36.900595 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe87002-8c86-4a7e-bdee-eb279daa88dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:29:36.902013 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe87002-8c86-4a7e-bdee-eb279daa88dd service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:29:36.910468 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 760/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:29:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:29:36.953450 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc77d3-895a-4081-833f-7b4f3ee59591 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:29:36.953743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc77d3-895a-4081-833f-7b4f3ee59591 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:29:36.954091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc77d3-895a-4081-833f-7b4f3ee59591 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:29:36.955406 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 746/1506] 10.222.0.60 () {52 vars in 829 bytes} [Fri May 6 23:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:29:36.958958 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe87002-8c86-4a7e-bdee-eb279daa88dd service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:29:37.017313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe87002-8c86-4a7e-bdee-eb279daa88dd service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:29:37.021924 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c2e13-b14d-4029-97a1-3e414256a1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:29:37.022777 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c2e13-b14d-4029-97a1-3e414256a1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:29:37.023055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c2e13-b14d-4029-97a1-3e414256a1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:29:37.023327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c2e13-b14d-4029-97a1-3e414256a1a5 admin admin] PATH_INFO: `/v3/users/7b9aa0e88cda43e8b81aa349e6add9cc` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:29:37.024492 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c2e13-b14d-4029-97a1-3e414256a1a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b9aa0e88cda43e8b81aa349e6add9cc)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:29:37.025533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: WARNING py.warnings [None req-b92c2e13-b14d-4029-97a1-3e414256a1a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 06 23:29:37.025533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: warnings.warn(msg) May 06 23:29:37.025533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: May 06 23:29:37.027264 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c2e13-b14d-4029-97a1-3e414256a1a5 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:29:37.089505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b92c2e13-b14d-4029-97a1-3e414256a1a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b9aa0e88cda43e8b81aa349e6add9cc'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:29:37.101620 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b92c2e13-b14d-4029-97a1-3e414256a1a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b9aa0e88cda43e8b81aa349e6add9cc'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:29:37.102378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b92c2e13-b14d-4029-97a1-3e414256a1a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b9aa0e88cda43e8b81aa349e6add9cc'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:29:37.111686 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b92c2e13-b14d-4029-97a1-3e414256a1a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b9aa0e88cda43e8b81aa349e6add9cc'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:29:37.112324 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b92c2e13-b14d-4029-97a1-3e414256a1a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b9aa0e88cda43e8b81aa349e6add9cc'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:29:37.134635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 761/1507] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:29:36 2022] DELETE /identity/v3/users/7b9aa0e88cda43e8b81aa349e6add9cc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:29:37.139004 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2c38e-693e-4869-8e3b-18b1ef9807a5 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:29:37.139310 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2c38e-693e-4869-8e3b-18b1ef9807a5 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:29:37.139603 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2c38e-693e-4869-8e3b-18b1ef9807a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:29:37.156929 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-37e2c38e-693e-4869-8e3b-18b1ef9807a5 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:29:37.158126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-37e2c38e-693e-4869-8e3b-18b1ef9807a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:29:37.214482 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 747/1508] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:29:37.224087 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c2e13-b14d-4029-97a1-3e414256a1a5 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:29:37.225473 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b92c2e13-b14d-4029-97a1-3e414256a1a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:29:37.280035 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c2e13-b14d-4029-97a1-3e414256a1a5 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:29:37.283587 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f1782-1310-4c90-988d-02ea3c72de53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:29:37.284219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f1782-1310-4c90-988d-02ea3c72de53 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:29:37.284502 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f1782-1310-4c90-988d-02ea3c72de53 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:29:37.284808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f1782-1310-4c90-988d-02ea3c72de53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:29:37.294008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f1782-1310-4c90-988d-02ea3c72de53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:29:37.295441 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f1782-1310-4c90-988d-02ea3c72de53 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:29:37.304563 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 762/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:29:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:29:37.631216 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2c38e-693e-4869-8e3b-18b1ef9807a5 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:29:37.633033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-37e2c38e-693e-4869-8e3b-18b1ef9807a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:29:37.645380 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2c38e-693e-4869-8e3b-18b1ef9807a5 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:29:37.650155 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19148a-1ba4-4551-aa83-5acb3bc879a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:29:37.652271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19148a-1ba4-4551-aa83-5acb3bc879a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:29:37.652590 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19148a-1ba4-4551-aa83-5acb3bc879a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:29:37.652870 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19148a-1ba4-4551-aa83-5acb3bc879a1 admin admin] PATH_INFO: `/v3/projects/c01e81d16e6145c692cedc5ac1e96799` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:29:37.654450 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19148a-1ba4-4551-aa83-5acb3bc879a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c01e81d16e6145c692cedc5ac1e96799)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:29:37.655557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: WARNING py.warnings [None req-dc19148a-1ba4-4551-aa83-5acb3bc879a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 06 23:29:37.655557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: warnings.warn(msg) May 06 23:29:37.655557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: May 06 23:29:37.656708 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19148a-1ba4-4551-aa83-5acb3bc879a1 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:29:37.717572 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-dc19148a-1ba4-4551-aa83-5acb3bc879a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c01e81d16e6145c692cedc5ac1e96799', 'request_id': 'req-dc19148a-1ba4-4551-aa83-5acb3bc879a1'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:29:37.730816 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-dc19148a-1ba4-4551-aa83-5acb3bc879a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c01e81d16e6145c692cedc5ac1e96799', 'request_id': 'req-dc19148a-1ba4-4551-aa83-5acb3bc879a1'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:29:37.736447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-dc19148a-1ba4-4551-aa83-5acb3bc879a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c01e81d16e6145c692cedc5ac1e96799', 'request_id': 'req-dc19148a-1ba4-4551-aa83-5acb3bc879a1'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:29:37.750474 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-dc19148a-1ba4-4551-aa83-5acb3bc879a1 admin admin] The token cache is being invalidate because project c01e81d16e6145c692cedc5ac1e96799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:29:37.750760 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-dc19148a-1ba4-4551-aa83-5acb3bc879a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:29:37.751383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-dc19148a-1ba4-4551-aa83-5acb3bc879a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:29:37.753084 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 748/1510] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:29:37 2022] DELETE /identity/v3/projects/c01e81d16e6145c692cedc5ac1e96799 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:31:15.430189 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469cf1e-0cd5-498b-aea5-92f2c700fd9b None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:15.430784 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469cf1e-0cd5-498b-aea5-92f2c700fd9b None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:15.430784 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469cf1e-0cd5-498b-aea5-92f2c700fd9b None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:15.432152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 763/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 6 23:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:31:15.437142 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01e243-80b1-4863-9ff5-81804bf31329 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:15.437623 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01e243-80b1-4863-9ff5-81804bf31329 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:15.437751 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01e243-80b1-4863-9ff5-81804bf31329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:15.456774 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-0f01e243-80b1-4863-9ff5-81804bf31329 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:31:15.457967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-0f01e243-80b1-4863-9ff5-81804bf31329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:31:15.513546 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 749/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 6 23:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:31:15.684462 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469cf1e-0cd5-498b-aea5-92f2c700fd9b None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:31:15.686103 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-3469cf1e-0cd5-498b-aea5-92f2c700fd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:31:15.756242 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469cf1e-0cd5-498b-aea5-92f2c700fd9b None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:31:15.762094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c31a7c-0328-400f-bd52-8f5730572b77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:31:15.762719 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c31a7c-0328-400f-bd52-8f5730572b77 service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:15.762999 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c31a7c-0328-400f-bd52-8f5730572b77 service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:15.763267 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c31a7c-0328-400f-bd52-8f5730572b77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:15.771048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c31a7c-0328-400f-bd52-8f5730572b77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:31:15.772652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c31a7c-0328-400f-bd52-8f5730572b77 service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:31:15.782138 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 764/1513] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:31:16.707573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a0442-066b-41c4-86a8-2ef9191ff167 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:16.708128 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a0442-066b-41c4-86a8-2ef9191ff167 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:16.708128 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a0442-066b-41c4-86a8-2ef9191ff167 None None] PATH_INFO: `/v3` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:16.709458 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 750/1514] 10.222.0.59 () {54 vars in 925 bytes} [Fri May 6 23:31:16 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:31:16.738606 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276d4e5-3091-49b3-a321-7601d2306f51 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:16.739037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276d4e5-3091-49b3-a321-7601d2306f51 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:16.739230 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276d4e5-3091-49b3-a321-7601d2306f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:16.752689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07bae9-7dff-4693-9e92-9d3765ec3789 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:16.752981 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07bae9-7dff-4693-9e92-9d3765ec3789 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:16.753263 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07bae9-7dff-4693-9e92-9d3765ec3789 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:16.754654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 751/1515] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 6 23:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:31:16.759319 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-d276d4e5-3091-49b3-a321-7601d2306f51 None None] MFA Rules not processed for user `fb1f7704fb5644688b8764bb1ce15734`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:31:16.759453 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e891b-1ae1-487f-b47f-8adcedd72886 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:16.759660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e891b-1ae1-487f-b47f-8adcedd72886 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:16.759933 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e891b-1ae1-487f-b47f-8adcedd72886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:16.760482 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d276d4e5-3091-49b3-a321-7601d2306f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:31:16.777769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-4b6e891b-1ae1-487f-b47f-8adcedd72886 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:31:16.778925 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-4b6e891b-1ae1-487f-b47f-8adcedd72886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:31:16.786576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 752/1516] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 6 23:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:31:16.939293 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e891b-1ae1-487f-b47f-8adcedd72886 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:31:16.951857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e891b-1ae1-487f-b47f-8adcedd72886 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:31:16.957263 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01000def-b927-4638-9b3d-762ea7aa91cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:31:16.957906 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01000def-b927-4638-9b3d-762ea7aa91cf service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:16.958187 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01000def-b927-4638-9b3d-762ea7aa91cf service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:16.958408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 765/1517] 10.222.0.59 () {58 vars in 1015 bytes} [Fri May 6 23:31:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:31:16.958543 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01000def-b927-4638-9b3d-762ea7aa91cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:16.968078 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01000def-b927-4638-9b3d-762ea7aa91cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:31:16.969717 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01000def-b927-4638-9b3d-762ea7aa91cf service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:31:16.980201 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 753/1518] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:31:20.802355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7121f57-a98e-4994-bbf9-354c0126b35a None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:20.802904 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7121f57-a98e-4994-bbf9-354c0126b35a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:20.802904 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7121f57-a98e-4994-bbf9-354c0126b35a None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:20.804257 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 766/1519] 10.222.0.60 () {54 vars in 960 bytes} [Fri May 6 23:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:31:20.809866 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cffa9-c685-4510-ba2b-9fcb60aacc02 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:20.810270 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cffa9-c685-4510-ba2b-9fcb60aacc02 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:20.810412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cffa9-c685-4510-ba2b-9fcb60aacc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:20.827902 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-431cffa9-c685-4510-ba2b-9fcb60aacc02 None None] MFA Rules not processed for user `fb1f7704fb5644688b8764bb1ce15734`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:31:20.829147 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-431cffa9-c685-4510-ba2b-9fcb60aacc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:31:20.837638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 754/1520] 10.222.0.60 () {58 vars in 1057 bytes} [Fri May 6 23:31:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:31:20.845049 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7121f57-a98e-4994-bbf9-354c0126b35a None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:31:20.858683 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7121f57-a98e-4994-bbf9-354c0126b35a None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:31:20.863520 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782f080-83a3-40ce-a87f-f0128f6c72dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1f7704fb5644688b8764bb1ce15734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:31:20.864134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782f080-83a3-40ce-a87f-f0128f6c72dc service placement] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:20.864408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782f080-83a3-40ce-a87f-f0128f6c72dc service placement] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:20.864718 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782f080-83a3-40ce-a87f-f0128f6c72dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:20.873328 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782f080-83a3-40ce-a87f-f0128f6c72dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:31:20.874888 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782f080-83a3-40ce-a87f-f0128f6c72dc service placement] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:31:20.884130 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 767/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:31:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:31:28.277743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03384c42-3fb3-41cd-b7c7-9ca1eb8a71e7 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:28.278304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03384c42-3fb3-41cd-b7c7-9ca1eb8a71e7 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:28.278304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03384c42-3fb3-41cd-b7c7-9ca1eb8a71e7 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:28.279651 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 6 23:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:31:28.284622 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14a61e-3a4b-4bc6-8994-cc014d8c8275 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:28.285038 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14a61e-3a4b-4bc6-8994-cc014d8c8275 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:28.285168 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14a61e-3a4b-4bc6-8994-cc014d8c8275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:28.303111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-9a14a61e-3a4b-4bc6-8994-cc014d8c8275 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:31:28.304306 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-9a14a61e-3a4b-4bc6-8994-cc014d8c8275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:31:28.312476 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 6 23:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:31:28.460424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03384c42-3fb3-41cd-b7c7-9ca1eb8a71e7 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:31:28.474483 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03384c42-3fb3-41cd-b7c7-9ca1eb8a71e7 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:31:28.480293 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c1a15-c378-49d2-8db3-eea99636fde2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:31:28.480943 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c1a15-c378-49d2-8db3-eea99636fde2 service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:28.481221 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c1a15-c378-49d2-8db3-eea99636fde2 service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:28.481489 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c1a15-c378-49d2-8db3-eea99636fde2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:28.489240 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c1a15-c378-49d2-8db3-eea99636fde2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:31:28.490802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c1a15-c378-49d2-8db3-eea99636fde2 service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:31:28.500393 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 756/1524] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:31:29.386633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d30322-8b05-4ee8-bfb6-4dd2fe6a391d None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:29.387180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d30322-8b05-4ee8-bfb6-4dd2fe6a391d None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:29.387180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d30322-8b05-4ee8-bfb6-4dd2fe6a391d None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:29.388587 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 6 23:31:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:31:29.393350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b885aa4-8d68-4da2-b98a-232c1b890a1d None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:29.393836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b885aa4-8d68-4da2-b98a-232c1b890a1d None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:29.393941 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b885aa4-8d68-4da2-b98a-232c1b890a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:29.413040 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-3b885aa4-8d68-4da2-b98a-232c1b890a1d None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:31:29.414226 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-3b885aa4-8d68-4da2-b98a-232c1b890a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:31:29.422054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 6 23:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:31:29.571497 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d30322-8b05-4ee8-bfb6-4dd2fe6a391d None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:31:29.586756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d30322-8b05-4ee8-bfb6-4dd2fe6a391d None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:31:29.592023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a8cef-5af0-42fb-8478-fed4f51bd995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:31:29.592782 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a8cef-5af0-42fb-8478-fed4f51bd995 service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:29.593262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a8cef-5af0-42fb-8478-fed4f51bd995 service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:29.593747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a8cef-5af0-42fb-8478-fed4f51bd995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:29.604136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a8cef-5af0-42fb-8478-fed4f51bd995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:31:29.605737 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a8cef-5af0-42fb-8478-fed4f51bd995 service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:31:29.614843 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 770/1527] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:31:33.561797 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6fb23-67ad-4b28-bbf9-4964e56b5769 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:33.562381 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6fb23-67ad-4b28-bbf9-4964e56b5769 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:33.562381 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6fb23-67ad-4b28-bbf9-4964e56b5769 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:33.563818 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 6 23:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:31:33.569092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e81b6-381b-4d29-b9cb-63886c406813 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:33.569490 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e81b6-381b-4d29-b9cb-63886c406813 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:33.569640 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e81b6-381b-4d29-b9cb-63886c406813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:33.587031 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-187e81b6-381b-4d29-b9cb-63886c406813 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:31:33.588749 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-187e81b6-381b-4d29-b9cb-63886c406813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:31:33.596671 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 6 23:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:31:33.632091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6fb23-67ad-4b28-bbf9-4964e56b5769 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:31:33.633760 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-fde6fb23-67ad-4b28-bbf9-4964e56b5769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:31:33.687730 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6fb23-67ad-4b28-bbf9-4964e56b5769 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:31:33.691274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38684836-1a54-454b-aa85-2696db9d4c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:31:33.691898 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38684836-1a54-454b-aa85-2696db9d4c38 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:33.692175 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38684836-1a54-454b-aa85-2696db9d4c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:33.692442 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38684836-1a54-454b-aa85-2696db9d4c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:33.701342 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38684836-1a54-454b-aa85-2696db9d4c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:31:33.702956 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38684836-1a54-454b-aa85-2696db9d4c38 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:31:33.712097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 759/1530] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:31:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:31:35.896890 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4841769-1496-4020-8be8-e5d6efb84ea3 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:35.897407 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4841769-1496-4020-8be8-e5d6efb84ea3 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:35.897407 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4841769-1496-4020-8be8-e5d6efb84ea3 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:35.898812 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 6 23:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:31:35.904504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4a9ba-5746-413e-837a-1ffb62752405 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:35.904948 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4a9ba-5746-413e-837a-1ffb62752405 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:35.905088 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4a9ba-5746-413e-837a-1ffb62752405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:35.923220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-caf4a9ba-5746-413e-837a-1ffb62752405 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:31:35.924380 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-caf4a9ba-5746-413e-837a-1ffb62752405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:31:35.932025 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 6 23:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:31:35.966010 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4841769-1496-4020-8be8-e5d6efb84ea3 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:31:35.976715 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4841769-1496-4020-8be8-e5d6efb84ea3 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:31:35.980814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9907b-28f7-47a9-9077-e331f7fa09ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:31:35.981435 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9907b-28f7-47a9-9077-e331f7fa09ae service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:35.981731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9907b-28f7-47a9-9077-e331f7fa09ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:35.981978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9907b-28f7-47a9-9077-e331f7fa09ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:35.990695 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9907b-28f7-47a9-9077-e331f7fa09ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:31:35.992116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9907b-28f7-47a9-9077-e331f7fa09ae service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:31:36.001488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 773/1533] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:31:39.658324 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703718d-288f-4dde-bdf9-aea4328bd6ca None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:39.658949 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703718d-288f-4dde-bdf9-aea4328bd6ca None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:39.659059 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703718d-288f-4dde-bdf9-aea4328bd6ca None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:39.660396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 6 23:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:31:39.665688 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f666c8c-8dbc-4f12-a135-652318a246d3 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:39.666119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f666c8c-8dbc-4f12-a135-652318a246d3 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:39.666225 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f666c8c-8dbc-4f12-a135-652318a246d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:39.684172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-3f666c8c-8dbc-4f12-a135-652318a246d3 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:31:39.685376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-3f666c8c-8dbc-4f12-a135-652318a246d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:31:39.693095 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 6 23:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:31:39.967492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703718d-288f-4dde-bdf9-aea4328bd6ca None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:31:39.969158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-8703718d-288f-4dde-bdf9-aea4328bd6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:31:40.023064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703718d-288f-4dde-bdf9-aea4328bd6ca None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:31:40.027310 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58e4bb-d679-4791-ad6f-56d39ec65571 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:31:40.027967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58e4bb-d679-4791-ad6f-56d39ec65571 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:40.028248 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58e4bb-d679-4791-ad6f-56d39ec65571 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:40.028520 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58e4bb-d679-4791-ad6f-56d39ec65571 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:40.037158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58e4bb-d679-4791-ad6f-56d39ec65571 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:31:40.038576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58e4bb-d679-4791-ad6f-56d39ec65571 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:31:40.047581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 762/1536] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:31:42.274298 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5570382-785b-4aa6-9688-f59504f7604d None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:42.274848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5570382-785b-4aa6-9688-f59504f7604d None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:42.274848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5570382-785b-4aa6-9688-f59504f7604d None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:42.276215 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 6 23:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:31:42.281565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289f5ab-75fd-4045-a4dc-fe86aac09309 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:42.281994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289f5ab-75fd-4045-a4dc-fe86aac09309 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:42.282124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289f5ab-75fd-4045-a4dc-fe86aac09309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:42.299818 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-e289f5ab-75fd-4045-a4dc-fe86aac09309 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:31:42.301040 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e289f5ab-75fd-4045-a4dc-fe86aac09309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:31:42.309523 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 6 23:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:31:42.579925 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5570382-785b-4aa6-9688-f59504f7604d None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:31:42.581621 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c5570382-785b-4aa6-9688-f59504f7604d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:31:42.595003 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5570382-785b-4aa6-9688-f59504f7604d None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:31:42.598729 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44449337-6e2c-42ba-800f-f58327e69efe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:31:42.599352 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44449337-6e2c-42ba-800f-f58327e69efe service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:31:42.599626 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44449337-6e2c-42ba-800f-f58327e69efe service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:31:42.599893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44449337-6e2c-42ba-800f-f58327e69efe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:31:42.608894 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44449337-6e2c-42ba-800f-f58327e69efe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:31:42.610304 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44449337-6e2c-42ba-800f-f58327e69efe service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:31:42.620754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 776/1539] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:14.495050 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b05eb4-6fd4-4b0c-89f3-d3786dcc4439 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:14.496170 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b05eb4-6fd4-4b0c-89f3-d3786dcc4439 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:14.496726 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b05eb4-6fd4-4b0c-89f3-d3786dcc4439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:14.527633 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-70b05eb4-6fd4-4b0c-89f3-d3786dcc4439 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:14.528833 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-70b05eb4-6fd4-4b0c-89f3-d3786dcc4439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:14.540926 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 764/1540] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:14.549954 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb6b92-ca6a-4ab8-b3f2-0653832474ec None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:14.551488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb6b92-ca6a-4ab8-b3f2-0653832474ec None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:14.552005 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb6b92-ca6a-4ab8-b3f2-0653832474ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:14.578551 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-5bfb6b92-ca6a-4ab8-b3f2-0653832474ec None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:14.580277 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-5bfb6b92-ca6a-4ab8-b3f2-0653832474ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:14.592959 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 777/1541] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:14.597727 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b05eb4-6fd4-4b0c-89f3-d3786dcc4439 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:14.613350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b05eb4-6fd4-4b0c-89f3-d3786dcc4439 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:14.625241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1cdea-ba86-484b-a055-786ac4ff85a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:14.625922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1cdea-ba86-484b-a055-786ac4ff85a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:14.626204 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1cdea-ba86-484b-a055-786ac4ff85a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:14.626476 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1cdea-ba86-484b-a055-786ac4ff85a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:14.627216 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1cdea-ba86-484b-a055-786ac4ff85a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:33:14.627518 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1cdea-ba86-484b-a055-786ac4ff85a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:14.627902 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634a4de-ae30-405d-bd46-2682eff209b5 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:14.628406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634a4de-ae30-405d-bd46-2682eff209b5 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:14.628916 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634a4de-ae30-405d-bd46-2682eff209b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:14.629392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1cdea-ba86-484b-a055-786ac4ff85a8 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:14.656588 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 765/1542] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:33:14.672585 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1cdea-ba86-484b-a055-786ac4ff85a8 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:14.672822 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-f634a4de-ae30-405d-bd46-2682eff209b5 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:14.672822 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-f634a4de-ae30-405d-bd46-2682eff209b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:14.688717 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1cdea-ba86-484b-a055-786ac4ff85a8 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:14.702134 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901f297-a594-452b-95a1-4c7ee5ce0865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:14.702508 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 778/1543] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:14.702943 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f297-a594-452b-95a1-4c7ee5ce0865 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:14.703228 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f297-a594-452b-95a1-4c7ee5ce0865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:14.703499 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f297-a594-452b-95a1-4c7ee5ce0865 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:14.704195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901f297-a594-452b-95a1-4c7ee5ce0865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:14.705262 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: WARNING py.warnings [None req-0901f297-a594-452b-95a1-4c7ee5ce0865 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 06 23:33:14.705262 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: warnings.warn(msg) May 06 23:33:14.705262 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: May 06 23:33:14.708679 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901f297-a594-452b-95a1-4c7ee5ce0865 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:14.720577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6629e1-b682-4858-925c-7088c223ee18 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:14.720577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6629e1-b682-4858-925c-7088c223ee18 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:14.720577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6629e1-b682-4858-925c-7088c223ee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:14.767807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 766/1544] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:14 2022] POST /identity/v3/projects => generated 405 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:14.769073 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-6c6629e1-b682-4858-925c-7088c223ee18 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:14.771748 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901f297-a594-452b-95a1-4c7ee5ce0865 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:14.772408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-6c6629e1-b682-4858-925c-7088c223ee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:14.873484 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 779/1545] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:14.877313 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901f297-a594-452b-95a1-4c7ee5ce0865 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:14.879181 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6629e1-b682-4858-925c-7088c223ee18 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:14.895218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6629e1-b682-4858-925c-7088c223ee18 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:14.897399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4926695-66b2-4074-a6e5-078c2c0b990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:14.898189 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4926695-66b2-4074-a6e5-078c2c0b990c admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:14.898476 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4926695-66b2-4074-a6e5-078c2c0b990c admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:14.898748 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4926695-66b2-4074-a6e5-078c2c0b990c admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:14.899498 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4926695-66b2-4074-a6e5-078c2c0b990c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:14.901718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4926695-66b2-4074-a6e5-078c2c0b990c admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:14.905321 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44803a8b-f10a-45e7-9957-ce878f0812dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:14.906002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44803a8b-f10a-45e7-9957-ce878f0812dc admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:14.906280 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44803a8b-f10a-45e7-9957-ce878f0812dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:14.906546 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44803a8b-f10a-45e7-9957-ce878f0812dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:14.907286 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44803a8b-f10a-45e7-9957-ce878f0812dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:33:14.907639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44803a8b-f10a-45e7-9957-ce878f0812dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:14.908699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: WARNING py.warnings [None req-44803a8b-f10a-45e7-9957-ce878f0812dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 06 23:33:14.908699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: warnings.warn(msg) May 06 23:33:14.908699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: May 06 23:33:14.909760 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44803a8b-f10a-45e7-9957-ce878f0812dc admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:14.927113 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 780/1546] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:33:14.931265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 767/1547] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:14 2022] POST /identity/v3/users => generated 303 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:33:14.932302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44803a8b-f10a-45e7-9957-ce878f0812dc admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:14.937971 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4926695-66b2-4074-a6e5-078c2c0b990c admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:14.944244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44803a8b-f10a-45e7-9957-ce878f0812dc admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:14.958505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6e4d1-47ef-4b83-ae4a-61ba22182b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:14.959017 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4926695-66b2-4074-a6e5-078c2c0b990c admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:14.959333 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6e4d1-47ef-4b83-ae4a-61ba22182b5c admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:14.959620 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6e4d1-47ef-4b83-ae4a-61ba22182b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:14.960136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6e4d1-47ef-4b83-ae4a-61ba22182b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:14.960961 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6e4d1-47ef-4b83-ae4a-61ba22182b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:14.963110 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6e4d1-47ef-4b83-ae4a-61ba22182b5c admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:14.974480 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e7021-c7ea-4604-a290-071098f3bf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:14.975152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e7021-c7ea-4604-a290-071098f3bf40 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:14.975429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e7021-c7ea-4604-a290-071098f3bf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:14.975698 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e7021-c7ea-4604-a290-071098f3bf40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:14.976400 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e7021-c7ea-4604-a290-071098f3bf40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:14.979234 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 781/1548] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:33:14.981061 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e7021-c7ea-4604-a290-071098f3bf40 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:14.993465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6e4d1-47ef-4b83-ae4a-61ba22182b5c admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:15.006511 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6e4d1-47ef-4b83-ae4a-61ba22182b5c admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:15.018424 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512f8f4-dee5-4475-99f3-2920b3fe1a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:15.019113 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512f8f4-dee5-4475-99f3-2920b3fe1a88 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.019394 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512f8f4-dee5-4475-99f3-2920b3fe1a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.019666 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512f8f4-dee5-4475-99f3-2920b3fe1a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.020501 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512f8f4-dee5-4475-99f3-2920b3fe1a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:15.022228 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512f8f4-dee5-4475-99f3-2920b3fe1a88 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:15.022838 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 768/1549] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:14 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:33:15.027738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e7021-c7ea-4604-a290-071098f3bf40 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:15.040594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 782/1550] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:15.041920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b51eef-d16c-4c92-a86e-b0e7c226db09 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.042250 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b51eef-d16c-4c92-a86e-b0e7c226db09 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.042575 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b51eef-d16c-4c92-a86e-b0e7c226db09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.073555 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-91b51eef-d16c-4c92-a86e-b0e7c226db09 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:15.074799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-91b51eef-d16c-4c92-a86e-b0e7c226db09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:15.109384 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e7021-c7ea-4604-a290-071098f3bf40 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:15.125273 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33774d5-7858-42e6-b27a-6b84162cddac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:15.125962 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33774d5-7858-42e6-b27a-6b84162cddac admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.126241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33774d5-7858-42e6-b27a-6b84162cddac admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.126511 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33774d5-7858-42e6-b27a-6b84162cddac admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.127229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33774d5-7858-42e6-b27a-6b84162cddac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:15.129254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33774d5-7858-42e6-b27a-6b84162cddac admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:15.149079 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 783/1551] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:15.151225 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b51eef-d16c-4c92-a86e-b0e7c226db09 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:15.159968 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 769/1552] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:15 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:33:15.162236 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427f17c-e4c9-49e0-a945-566f025cc91f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.162236 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427f17c-e4c9-49e0-a945-566f025cc91f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.162236 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427f17c-e4c9-49e0-a945-566f025cc91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.166170 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b51eef-d16c-4c92-a86e-b0e7c226db09 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:15.172429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0d960-c8a3-4df3-b41c-93c045e052d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:15.173368 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0d960-c8a3-4df3-b41c-93c045e052d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.173633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0d960-c8a3-4df3-b41c-93c045e052d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.173903 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0d960-c8a3-4df3-b41c-93c045e052d9 admin admin] PATH_INFO: `/v3/projects/c0de4aa69b36411d9a1790e4b6ad5add/users/3d0061102b0048b7a509812bb447caf9/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.181348 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-2427f17c-e4c9-49e0-a945-566f025cc91f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:15.182549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-2427f17c-e4c9-49e0-a945-566f025cc91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:15.190750 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 770/1553] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:15.190878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0d960-c8a3-4df3-b41c-93c045e052d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0de4aa69b36411d9a1790e4b6ad5add, user_id=3d0061102b0048b7a509812bb447caf9, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:15.193377 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0d960-c8a3-4df3-b41c-93c045e052d9 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:15.195320 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d83c7-781f-4f8c-9eeb-d1b5e11db534 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.196898 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d83c7-781f-4f8c-9eeb-d1b5e11db534 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.197813 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d83c7-781f-4f8c-9eeb-d1b5e11db534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.207811 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 784/1554] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:15 2022] PUT /identity/v3/projects/c0de4aa69b36411d9a1790e4b6ad5add/users/3d0061102b0048b7a509812bb447caf9/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:15.209449 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d8511-74f0-469e-81c4-6c20e598471f None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.209918 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d8511-74f0-469e-81c4-6c20e598471f None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.210370 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d8511-74f0-469e-81c4-6c20e598471f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.218281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-de8d83c7-781f-4f8c-9eeb-d1b5e11db534 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:15.219565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-de8d83c7-781f-4f8c-9eeb-d1b5e11db534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:15.230913 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-634d8511-74f0-469e-81c4-6c20e598471f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:15.232322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-634d8511-74f0-469e-81c4-6c20e598471f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:15.284341 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 771/1555] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:15.285575 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e733ec-cb25-4b45-8a2e-98cd77be4ca0 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.285858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e733ec-cb25-4b45-8a2e-98cd77be4ca0 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.286130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e733ec-cb25-4b45-8a2e-98cd77be4ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.299119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 785/1556] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:15.300465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417812a2-c865-46d2-ae8a-68d51e9b8d4b None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.300794 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417812a2-c865-46d2-ae8a-68d51e9b8d4b None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.301066 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417812a2-c865-46d2-ae8a-68d51e9b8d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.303762 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-71e733ec-cb25-4b45-8a2e-98cd77be4ca0 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:15.304994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-71e733ec-cb25-4b45-8a2e-98cd77be4ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:15.313400 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 772/1557] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:15.314225 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e733ec-cb25-4b45-8a2e-98cd77be4ca0 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:15.318431 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-417812a2-c865-46d2-ae8a-68d51e9b8d4b None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:15.319662 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-417812a2-c865-46d2-ae8a-68d51e9b8d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:15.324140 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e733ec-cb25-4b45-8a2e-98cd77be4ca0 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:15.328045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 786/1558] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:15.329280 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6b36a-4c01-4baf-bb86-0977f731c9f0 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.329559 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6b36a-4c01-4baf-bb86-0977f731c9f0 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.329829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6b36a-4c01-4baf-bb86-0977f731c9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.332109 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbace462-a7d0-47d8-98b8-4049ebd5ff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:15.332956 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbace462-a7d0-47d8-98b8-4049ebd5ff37 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.333203 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbace462-a7d0-47d8-98b8-4049ebd5ff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.333518 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbace462-a7d0-47d8-98b8-4049ebd5ff37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.334400 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbace462-a7d0-47d8-98b8-4049ebd5ff37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:15.336294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbace462-a7d0-47d8-98b8-4049ebd5ff37 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:15.348469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-8fb6b36a-4c01-4baf-bb86-0977f731c9f0 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:15.348695 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 773/1559] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:15.349707 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-8fb6b36a-4c01-4baf-bb86-0977f731c9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:15.349919 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400fe80-208d-4b03-8eae-52391755b67e None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.350210 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400fe80-208d-4b03-8eae-52391755b67e None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.350543 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400fe80-208d-4b03-8eae-52391755b67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.358303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 787/1560] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:15.359517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb51e6-d6fe-4084-b408-1e122eac5259 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.359796 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb51e6-d6fe-4084-b408-1e122eac5259 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.360492 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb51e6-d6fe-4084-b408-1e122eac5259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.369829 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-e400fe80-208d-4b03-8eae-52391755b67e None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:15.371016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e400fe80-208d-4b03-8eae-52391755b67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:15.378103 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-cceb51e6-d6fe-4084-b408-1e122eac5259 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:15.378785 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 774/1561] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:15.379238 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-cceb51e6-d6fe-4084-b408-1e122eac5259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:15.380180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d9229-e478-496d-84d5-94ce576328c6 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.380467 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d9229-e478-496d-84d5-94ce576328c6 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.380770 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d9229-e478-496d-84d5-94ce576328c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.391201 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 788/1562] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:15.392651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0fa41-f7fd-4c6e-a981-10d68e4b3cdf None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.392940 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0fa41-f7fd-4c6e-a981-10d68e4b3cdf None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.393216 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0fa41-f7fd-4c6e-a981-10d68e4b3cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.400385 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-3b6d9229-e478-496d-84d5-94ce576328c6 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:15.401602 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-3b6d9229-e478-496d-84d5-94ce576328c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:15.409949 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 775/1563] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:15.411221 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c1194-2ed6-48cc-9807-61e020de04a9 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.411512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c1194-2ed6-48cc-9807-61e020de04a9 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.411630 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-3cc0fa41-f7fd-4c6e-a981-10d68e4b3cdf None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:15.411823 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c1194-2ed6-48cc-9807-61e020de04a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.412965 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-3cc0fa41-f7fd-4c6e-a981-10d68e4b3cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:15.420839 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 789/1564] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:15.421623 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0fa41-f7fd-4c6e-a981-10d68e4b3cdf None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:15.429469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-a39c1194-2ed6-48cc-9807-61e020de04a9 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:15.430595 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0fa41-f7fd-4c6e-a981-10d68e4b3cdf None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:15.430718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-a39c1194-2ed6-48cc-9807-61e020de04a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:15.435048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0730fe-757f-4f6e-befb-b485b47593da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:15.435678 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0730fe-757f-4f6e-befb-b485b47593da admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.435958 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0730fe-757f-4f6e-befb-b485b47593da admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.436232 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0730fe-757f-4f6e-befb-b485b47593da admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.436978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0730fe-757f-4f6e-befb-b485b47593da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:33:15.437285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0730fe-757f-4f6e-befb-b485b47593da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:15.438636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 776/1565] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:15.438879 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0730fe-757f-4f6e-befb-b485b47593da admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:15.439346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c1194-2ed6-48cc-9807-61e020de04a9 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:15.448652 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c1194-2ed6-48cc-9807-61e020de04a9 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:15.450835 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 790/1566] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:33:15.451637 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0730fe-757f-4f6e-befb-b485b47593da admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:15.453080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25c4ff-1b1b-4792-97eb-8503c6fae5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:15.453715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25c4ff-1b1b-4792-97eb-8503c6fae5fc admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.453992 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25c4ff-1b1b-4792-97eb-8503c6fae5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.454266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25c4ff-1b1b-4792-97eb-8503c6fae5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.454976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25c4ff-1b1b-4792-97eb-8503c6fae5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:15.456574 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25c4ff-1b1b-4792-97eb-8503c6fae5fc admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:15.461267 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0730fe-757f-4f6e-befb-b485b47593da admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:15.466763 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1821f97-d5cb-4d9d-97df-ced12b9e7fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:15.466964 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 777/1567] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:15.467397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1821f97-d5cb-4d9d-97df-ced12b9e7fbc admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.467679 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1821f97-d5cb-4d9d-97df-ced12b9e7fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.467801 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25c4ff-1b1b-4792-97eb-8503c6fae5fc admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:15.467977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1821f97-d5cb-4d9d-97df-ced12b9e7fbc admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.468819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1821f97-d5cb-4d9d-97df-ced12b9e7fbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:33:15.469128 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1821f97-d5cb-4d9d-97df-ced12b9e7fbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:15.470818 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1821f97-d5cb-4d9d-97df-ced12b9e7fbc admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:15.482998 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 791/1568] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:33:15.484069 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c6328-382b-4822-9b3b-5f10eefb7efa None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.484355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c6328-382b-4822-9b3b-5f10eefb7efa None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.484661 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c6328-382b-4822-9b3b-5f10eefb7efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.502018 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-af6c6328-382b-4822-9b3b-5f10eefb7efa None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:15.503187 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-af6c6328-382b-4822-9b3b-5f10eefb7efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:15.511952 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 792/1569] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:15.513294 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c6328-382b-4822-9b3b-5f10eefb7efa None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:15.521127 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25c4ff-1b1b-4792-97eb-8503c6fae5fc admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:15.522795 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c6328-382b-4822-9b3b-5f10eefb7efa None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:15.524881 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a42da-11c3-4b6d-8b6a-09a54437c979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:15.525531 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a42da-11c3-4b6d-8b6a-09a54437c979 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.525816 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a42da-11c3-4b6d-8b6a-09a54437c979 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.526093 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a42da-11c3-4b6d-8b6a-09a54437c979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.527620 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2392c-f775-4497-843d-7b83d97bcfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:15.528240 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2392c-f775-4497-843d-7b83d97bcfdf admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.528513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2392c-f775-4497-843d-7b83d97bcfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.528807 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2392c-f775-4497-843d-7b83d97bcfdf admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.529515 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2392c-f775-4497-843d-7b83d97bcfdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:33:15.529811 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2392c-f775-4497-843d-7b83d97bcfdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:15.531377 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2392c-f775-4497-843d-7b83d97bcfdf admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:15.535032 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a42da-11c3-4b6d-8b6a-09a54437c979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:15.536413 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a42da-11c3-4b6d-8b6a-09a54437c979 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:15.542390 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 793/1570] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:33:15.543150 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2392c-f775-4497-843d-7b83d97bcfdf admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:15.545895 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 778/1571] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:15.546534 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a42da-11c3-4b6d-8b6a-09a54437c979 service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:15.552372 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2392c-f775-4497-843d-7b83d97bcfdf admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:15.556168 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a42da-11c3-4b6d-8b6a-09a54437c979 service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:15.557447 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f06a4f-be6e-479b-9423-011b7703d167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:15.558087 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f06a4f-be6e-479b-9423-011b7703d167 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.558362 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f06a4f-be6e-479b-9423-011b7703d167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.558632 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f06a4f-be6e-479b-9423-011b7703d167 admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.559343 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f06a4f-be6e-479b-9423-011b7703d167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:33:15.559640 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f06a4f-be6e-479b-9423-011b7703d167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:15.560986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54015876-9002-4ca7-94b4-fbd446514499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:15.561404 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f06a4f-be6e-479b-9423-011b7703d167 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:15.561630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54015876-9002-4ca7-94b4-fbd446514499 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.561913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54015876-9002-4ca7-94b4-fbd446514499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.562192 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54015876-9002-4ca7-94b4-fbd446514499 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.562911 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54015876-9002-4ca7-94b4-fbd446514499 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:33:15.563215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54015876-9002-4ca7-94b4-fbd446514499 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:15.564818 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54015876-9002-4ca7-94b4-fbd446514499 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:15.574592 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 794/1572] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:33:15.577466 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f06a4f-be6e-479b-9423-011b7703d167 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:15.577868 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 779/1573] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:33:15.581418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54015876-9002-4ca7-94b4-fbd446514499 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:15.591805 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54015876-9002-4ca7-94b4-fbd446514499 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:15.594121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f06a4f-be6e-479b-9423-011b7703d167 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:15.596489 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c286035-bcba-4ac2-9f03-e738b19512f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:15.597695 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c286035-bcba-4ac2-9f03-e738b19512f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.598001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c286035-bcba-4ac2-9f03-e738b19512f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.598212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c286035-bcba-4ac2-9f03-e738b19512f7 admin admin] PATH_INFO: `/v3/projects/d4bd180f0f974e36a912b6c0efee6fa9/users/822fda1e71e346388a62854ba51a0560/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.599402 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1190c9-644a-4ecd-85ee-83b5890a448f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:15.600528 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1190c9-644a-4ecd-85ee-83b5890a448f admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.600528 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1190c9-644a-4ecd-85ee-83b5890a448f admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.600908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1190c9-644a-4ecd-85ee-83b5890a448f admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.601664 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1190c9-644a-4ecd-85ee-83b5890a448f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:15.603803 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1190c9-644a-4ecd-85ee-83b5890a448f admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:15.613993 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c286035-bcba-4ac2-9f03-e738b19512f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4bd180f0f974e36a912b6c0efee6fa9, user_id=822fda1e71e346388a62854ba51a0560, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:15.615391 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: WARNING py.warnings [None req-4c286035-bcba-4ac2-9f03-e738b19512f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 06 23:33:15.615391 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: warnings.warn(msg) May 06 23:33:15.615391 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: May 06 23:33:15.617396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c286035-bcba-4ac2-9f03-e738b19512f7 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:15.631563 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 795/1574] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:15 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:15.632586 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1190c9-644a-4ecd-85ee-83b5890a448f admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:15.634813 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 780/1575] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:15 2022] PUT /identity/v3/projects/d4bd180f0f974e36a912b6c0efee6fa9/users/822fda1e71e346388a62854ba51a0560/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:15.636297 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c286035-bcba-4ac2-9f03-e738b19512f7 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:15.703887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1190c9-644a-4ecd-85ee-83b5890a448f admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:15.709324 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5636f98-0c54-4150-bd27-1244ca866f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:15.709994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5636f98-0c54-4150-bd27-1244ca866f42 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.710270 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5636f98-0c54-4150-bd27-1244ca866f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.710538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5636f98-0c54-4150-bd27-1244ca866f42 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.711234 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5636f98-0c54-4150-bd27-1244ca866f42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:15.712198 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c286035-bcba-4ac2-9f03-e738b19512f7 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:15.713298 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5636f98-0c54-4150-bd27-1244ca866f42 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:15.718695 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d082e-f6ad-4cbb-8b84-c52c7b3736a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:15.719706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d082e-f6ad-4cbb-8b84-c52c7b3736a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.720217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d082e-f6ad-4cbb-8b84-c52c7b3736a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.720735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d082e-f6ad-4cbb-8b84-c52c7b3736a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.722507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d082e-f6ad-4cbb-8b84-c52c7b3736a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:33:15.722878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d082e-f6ad-4cbb-8b84-c52c7b3736a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:15.725905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d082e-f6ad-4cbb-8b84-c52c7b3736a0 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:15.741845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 781/1576] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:33:15.741845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d082e-f6ad-4cbb-8b84-c52c7b3736a0 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:15.750436 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 796/1577] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:15 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:15.751346 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5636f98-0c54-4150-bd27-1244ca866f42 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:15.763277 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d082e-f6ad-4cbb-8b84-c52c7b3736a0 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:15.827136 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b6cd4-43d8-4264-9f32-a909ca00381a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:15.827806 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b6cd4-43d8-4264-9f32-a909ca00381a admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.828084 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b6cd4-43d8-4264-9f32-a909ca00381a admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.828355 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b6cd4-43d8-4264-9f32-a909ca00381a admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.829717 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b6cd4-43d8-4264-9f32-a909ca00381a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:15.830034 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5636f98-0c54-4150-bd27-1244ca866f42 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:15.832276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b6cd4-43d8-4264-9f32-a909ca00381a admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:15.837598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520c867-22d7-400f-b0a9-97c74a103954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:15.838967 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520c867-22d7-400f-b0a9-97c74a103954 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.839499 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520c867-22d7-400f-b0a9-97c74a103954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.839979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520c867-22d7-400f-b0a9-97c74a103954 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.841046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520c867-22d7-400f-b0a9-97c74a103954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:15.844060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520c867-22d7-400f-b0a9-97c74a103954 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:15.861984 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 782/1578] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:15 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:15.864497 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b6cd4-43d8-4264-9f32-a909ca00381a admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:15.874468 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 797/1579] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:15 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:15.875432 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520c867-22d7-400f-b0a9-97c74a103954 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:15.943000 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b6cd4-43d8-4264-9f32-a909ca00381a admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:15.970045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520c867-22d7-400f-b0a9-97c74a103954 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:15.979457 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091ce74-3d37-48a9-8a08-dbf32ce2b2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:15.980427 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091ce74-3d37-48a9-8a08-dbf32ce2b2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:15.980878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091ce74-3d37-48a9-8a08-dbf32ce2b2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:15.981366 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091ce74-3d37-48a9-8a08-dbf32ce2b2c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:15.984580 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091ce74-3d37-48a9-8a08-dbf32ce2b2c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:15.985693 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: WARNING py.warnings [None req-3091ce74-3d37-48a9-8a08-dbf32ce2b2c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 06 23:33:15.985693 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: warnings.warn(msg) May 06 23:33:15.985693 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: May 06 23:33:15.987250 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091ce74-3d37-48a9-8a08-dbf32ce2b2c4 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.010845 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 798/1580] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:15 2022] POST /identity/v3/users => generated 297 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:16.013195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed4181-4465-44ad-a34c-d6b1717649fc None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.014661 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed4181-4465-44ad-a34c-d6b1717649fc None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.014965 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed4181-4465-44ad-a34c-d6b1717649fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.025378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a047c-3fa4-45df-bc46-c3c6e80be123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.026097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a047c-3fa4-45df-bc46-c3c6e80be123 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.026384 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a047c-3fa4-45df-bc46-c3c6e80be123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.026839 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a047c-3fa4-45df-bc46-c3c6e80be123 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.027589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a047c-3fa4-45df-bc46-c3c6e80be123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.029718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a047c-3fa4-45df-bc46-c3c6e80be123 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.044672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-06ed4181-4465-44ad-a34c-d6b1717649fc None None] MFA Rules not processed for user `822fda1e71e346388a62854ba51a0560`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:16.045973 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-06ed4181-4465-44ad-a34c-d6b1717649fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:16.061148 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 783/1581] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:15 2022] POST /identity/v3/projects => generated 371 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:16.062046 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a047c-3fa4-45df-bc46-c3c6e80be123 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.123137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 799/1582] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:16.123896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a047c-3fa4-45df-bc46-c3c6e80be123 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.124766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed4181-4465-44ad-a34c-d6b1717649fc None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.129537 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5b0ee-7ddd-45a0-be3e-35d364348f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.130196 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5b0ee-7ddd-45a0-be3e-35d364348f35 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.130486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5b0ee-7ddd-45a0-be3e-35d364348f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.130761 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5b0ee-7ddd-45a0-be3e-35d364348f35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.131754 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5b0ee-7ddd-45a0-be3e-35d364348f35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.133989 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5b0ee-7ddd-45a0-be3e-35d364348f35 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.139118 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed4181-4465-44ad-a34c-d6b1717649fc None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.145047 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016193a-7e34-4ad3-be2b-bd9a0e3a7cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.145812 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016193a-7e34-4ad3-be2b-bd9a0e3a7cae admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.146128 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016193a-7e34-4ad3-be2b-bd9a0e3a7cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.146475 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016193a-7e34-4ad3-be2b-bd9a0e3a7cae admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.147176 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016193a-7e34-4ad3-be2b-bd9a0e3a7cae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.149373 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016193a-7e34-4ad3-be2b-bd9a0e3a7cae admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.161633 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 784/1583] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:16 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:16.162669 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5b0ee-7ddd-45a0-be3e-35d364348f35 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.174860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 800/1584] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:16 2022] POST /identity/v3/users => generated 290 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:16.175934 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016193a-7e34-4ad3-be2b-bd9a0e3a7cae admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.186344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016193a-7e34-4ad3-be2b-bd9a0e3a7cae admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.248609 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5b0ee-7ddd-45a0-be3e-35d364348f35 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.253382 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c3ea3-b83e-4b76-a4eb-b8411fc8a06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.254062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c3ea3-b83e-4b76-a4eb-b8411fc8a06f admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.254374 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c3ea3-b83e-4b76-a4eb-b8411fc8a06f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.254649 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c3ea3-b83e-4b76-a4eb-b8411fc8a06f admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.255340 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c3ea3-b83e-4b76-a4eb-b8411fc8a06f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.257362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c3ea3-b83e-4b76-a4eb-b8411fc8a06f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.267830 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90290f4-5cc1-4f54-8a9a-f854a8fd04b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.268591 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90290f4-5cc1-4f54-8a9a-f854a8fd04b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.268930 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90290f4-5cc1-4f54-8a9a-f854a8fd04b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.269385 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90290f4-5cc1-4f54-8a9a-f854a8fd04b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.270163 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90290f4-5cc1-4f54-8a9a-f854a8fd04b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.272305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90290f4-5cc1-4f54-8a9a-f854a8fd04b9 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.279674 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 785/1585] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:16 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:16.280507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c3ea3-b83e-4b76-a4eb-b8411fc8a06f admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.291321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c3ea3-b83e-4b76-a4eb-b8411fc8a06f admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.296340 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df787cc-39c0-4cec-882e-a2cf2f9e49e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.297184 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df787cc-39c0-4cec-882e-a2cf2f9e49e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.297468 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df787cc-39c0-4cec-882e-a2cf2f9e49e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.297749 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df787cc-39c0-4cec-882e-a2cf2f9e49e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.298532 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df787cc-39c0-4cec-882e-a2cf2f9e49e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.302585 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 801/1586] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:16 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:16.302726 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df787cc-39c0-4cec-882e-a2cf2f9e49e1 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.302837 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90290f4-5cc1-4f54-8a9a-f854a8fd04b9 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.310658 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 786/1587] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:16.311641 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f1e44-946a-4b9e-b7a6-550b2370cebd None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.312978 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f1e44-946a-4b9e-b7a6-550b2370cebd None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.312978 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f1e44-946a-4b9e-b7a6-550b2370cebd None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.316096 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90290f4-5cc1-4f54-8a9a-f854a8fd04b9 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.316674 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 787/1588] 10.222.0.60 () {54 vars in 961 bytes} [Fri May 6 23:33:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:33:16.318561 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f1e44-946a-4b9e-b7a6-550b2370cebd None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.321788 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670f4c4-4aa6-4ac3-a294-89527e7a3a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.322916 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670f4c4-4aa6-4ac3-a294-89527e7a3a01 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.323407 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670f4c4-4aa6-4ac3-a294-89527e7a3a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.323896 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670f4c4-4aa6-4ac3-a294-89527e7a3a01 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.324889 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670f4c4-4aa6-4ac3-a294-89527e7a3a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.326827 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670f4c4-4aa6-4ac3-a294-89527e7a3a01 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.335232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f1e44-946a-4b9e-b7a6-550b2370cebd None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.342721 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e453f36-46c0-47d2-8d36-e875099b7a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.343396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e453f36-46c0-47d2-8d36-e875099b7a2d admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.343724 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e453f36-46c0-47d2-8d36-e875099b7a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.343930 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e453f36-46c0-47d2-8d36-e875099b7a2d admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.344645 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e453f36-46c0-47d2-8d36-e875099b7a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.347096 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e453f36-46c0-47d2-8d36-e875099b7a2d admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.351348 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 802/1589] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:16 2022] POST /identity/v3/users => generated 286 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:16.356377 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670f4c4-4aa6-4ac3-a294-89527e7a3a01 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.368467 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670f4c4-4aa6-4ac3-a294-89527e7a3a01 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.373499 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 788/1590] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:16 2022] POST /identity/v3/users => generated 289 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:16.373499 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d55914-d9a5-4fed-a58d-249aa0816e54 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.373499 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d55914-d9a5-4fed-a58d-249aa0816e54 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.373499 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d55914-d9a5-4fed-a58d-249aa0816e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.373906 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948248a1-7ead-40a7-a939-e448478d1de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.374636 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948248a1-7ead-40a7-a939-e448478d1de3 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.374983 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948248a1-7ead-40a7-a939-e448478d1de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.375264 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948248a1-7ead-40a7-a939-e448478d1de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.376025 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948248a1-7ead-40a7-a939-e448478d1de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.377781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948248a1-7ead-40a7-a939-e448478d1de3 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.391754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 803/1591] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:16.391754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948248a1-7ead-40a7-a939-e448478d1de3 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.403135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948248a1-7ead-40a7-a939-e448478d1de3 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.403302 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-63d55914-d9a5-4fed-a58d-249aa0816e54 None None] MFA Rules not processed for user `3d0061102b0048b7a509812bb447caf9`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:16.404390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-63d55914-d9a5-4fed-a58d-249aa0816e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:16.407864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591269bc-1284-402f-a25b-7d6df6d8c985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.408776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591269bc-1284-402f-a25b-7d6df6d8c985 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.409057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591269bc-1284-402f-a25b-7d6df6d8c985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.409338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591269bc-1284-402f-a25b-7d6df6d8c985 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.410096 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591269bc-1284-402f-a25b-7d6df6d8c985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.411955 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591269bc-1284-402f-a25b-7d6df6d8c985 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.423762 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 804/1592] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:16.424437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591269bc-1284-402f-a25b-7d6df6d8c985 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.435001 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591269bc-1284-402f-a25b-7d6df6d8c985 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.439698 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7849f8-a623-4c09-87d2-1db83ccc42a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.440360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7849f8-a623-4c09-87d2-1db83ccc42a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.440672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7849f8-a623-4c09-87d2-1db83ccc42a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.440950 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7849f8-a623-4c09-87d2-1db83ccc42a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.441681 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7849f8-a623-4c09-87d2-1db83ccc42a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.443320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7849f8-a623-4c09-87d2-1db83ccc42a1 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.457421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 805/1593] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:16.458757 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7849f8-a623-4c09-87d2-1db83ccc42a1 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.468649 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7849f8-a623-4c09-87d2-1db83ccc42a1 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.473408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c53922-ee72-4586-af9e-d237f581f1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.474051 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c53922-ee72-4586-af9e-d237f581f1fa admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.474322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c53922-ee72-4586-af9e-d237f581f1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.474591 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c53922-ee72-4586-af9e-d237f581f1fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.475302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c53922-ee72-4586-af9e-d237f581f1fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.476947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c53922-ee72-4586-af9e-d237f581f1fa admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.477071 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 789/1594] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:16.478387 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0f91f-ea8e-4bb3-a7ae-17b17bfea986 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.478672 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0f91f-ea8e-4bb3-a7ae-17b17bfea986 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.478964 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0f91f-ea8e-4bb3-a7ae-17b17bfea986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.487495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 806/1595] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:16.488456 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c53922-ee72-4586-af9e-d237f581f1fa admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.497654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-55d0f91f-ea8e-4bb3-a7ae-17b17bfea986 None None] MFA Rules not processed for user `9b74631c6e1547d991753a65c41bc7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:16.498024 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c53922-ee72-4586-af9e-d237f581f1fa admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.499109 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-55d0f91f-ea8e-4bb3-a7ae-17b17bfea986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:16.502557 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87950a37-83ff-4ba2-930f-fa82fcea4979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.503183 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87950a37-83ff-4ba2-930f-fa82fcea4979 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.503456 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87950a37-83ff-4ba2-930f-fa82fcea4979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.503724 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87950a37-83ff-4ba2-930f-fa82fcea4979 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.504434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87950a37-83ff-4ba2-930f-fa82fcea4979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.506044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87950a37-83ff-4ba2-930f-fa82fcea4979 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.516280 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 807/1596] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:16.516950 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87950a37-83ff-4ba2-930f-fa82fcea4979 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.526619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87950a37-83ff-4ba2-930f-fa82fcea4979 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.531181 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3063bf-729d-4963-8c92-7bd3819f7c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.531805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3063bf-729d-4963-8c92-7bd3819f7c8b admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.532083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3063bf-729d-4963-8c92-7bd3819f7c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.532353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3063bf-729d-4963-8c92-7bd3819f7c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.533117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3063bf-729d-4963-8c92-7bd3819f7c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.534682 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3063bf-729d-4963-8c92-7bd3819f7c8b admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.544134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 808/1597] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:16.545009 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3063bf-729d-4963-8c92-7bd3819f7c8b admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.554522 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3063bf-729d-4963-8c92-7bd3819f7c8b admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.559591 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2615a-4e07-4cb1-979c-a96593fe8288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.560204 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2615a-4e07-4cb1-979c-a96593fe8288 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.560481 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2615a-4e07-4cb1-979c-a96593fe8288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.560780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2615a-4e07-4cb1-979c-a96593fe8288 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.561512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2615a-4e07-4cb1-979c-a96593fe8288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.563082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2615a-4e07-4cb1-979c-a96593fe8288 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.564414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 790/1598] 10.222.0.60 () {58 vars in 1058 bytes} [Fri May 6 23:33:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:16.565283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0f91f-ea8e-4bb3-a7ae-17b17bfea986 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.573919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 809/1599] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:16.574707 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2615a-4e07-4cb1-979c-a96593fe8288 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.575593 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0f91f-ea8e-4bb3-a7ae-17b17bfea986 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.580232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79a674-4066-43f4-bd56-b3ea5bd5abbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.580926 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79a674-4066-43f4-bd56-b3ea5bd5abbc admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.581231 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79a674-4066-43f4-bd56-b3ea5bd5abbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.581507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79a674-4066-43f4-bd56-b3ea5bd5abbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.582257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79a674-4066-43f4-bd56-b3ea5bd5abbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.583853 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79a674-4066-43f4-bd56-b3ea5bd5abbc admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.584014 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2615a-4e07-4cb1-979c-a96593fe8288 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.588499 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37897d97-84fa-4075-996f-e4b8f74a9414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.589148 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37897d97-84fa-4075-996f-e4b8f74a9414 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.589422 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37897d97-84fa-4075-996f-e4b8f74a9414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.589692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37897d97-84fa-4075-996f-e4b8f74a9414 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.590399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37897d97-84fa-4075-996f-e4b8f74a9414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.591952 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37897d97-84fa-4075-996f-e4b8f74a9414 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.594128 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 791/1600] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:16.598320 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79a674-4066-43f4-bd56-b3ea5bd5abbc admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.604801 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 810/1601] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:16.604801 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37897d97-84fa-4075-996f-e4b8f74a9414 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.608073 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79a674-4066-43f4-bd56-b3ea5bd5abbc admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.612685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37897d97-84fa-4075-996f-e4b8f74a9414 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.612805 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55332aab-9e4d-42c6-896e-60e644ac23e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.613451 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55332aab-9e4d-42c6-896e-60e644ac23e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.613738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55332aab-9e4d-42c6-896e-60e644ac23e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.614016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55332aab-9e4d-42c6-896e-60e644ac23e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.614697 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55332aab-9e4d-42c6-896e-60e644ac23e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.616672 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55332aab-9e4d-42c6-896e-60e644ac23e5 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.617441 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58367c9-1153-42e9-9b8a-9477b98dd76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.618801 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58367c9-1153-42e9-9b8a-9477b98dd76f admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.619080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58367c9-1153-42e9-9b8a-9477b98dd76f admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.619347 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58367c9-1153-42e9-9b8a-9477b98dd76f admin admin] PATH_INFO: `/v3/projects/0a63c8271d644833bc46ae96dc3aa954/users/70b7101dccda45d78d379ec512eea44f/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.634162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58367c9-1153-42e9-9b8a-9477b98dd76f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a63c8271d644833bc46ae96dc3aa954, user_id=70b7101dccda45d78d379ec512eea44f, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.637090 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58367c9-1153-42e9-9b8a-9477b98dd76f admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.643973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 792/1602] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:16 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:16.645033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55332aab-9e4d-42c6-896e-60e644ac23e5 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.651055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 811/1603] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:16 2022] PUT /identity/v3/projects/0a63c8271d644833bc46ae96dc3aa954/users/70b7101dccda45d78d379ec512eea44f/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:16.651854 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58367c9-1153-42e9-9b8a-9477b98dd76f admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.706700 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55332aab-9e4d-42c6-896e-60e644ac23e5 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.711327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2888f-e331-4fb2-b3c5-0a86099d5063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.712047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2888f-e331-4fb2-b3c5-0a86099d5063 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.712210 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58367c9-1153-42e9-9b8a-9477b98dd76f admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.712311 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2888f-e331-4fb2-b3c5-0a86099d5063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.712615 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2888f-e331-4fb2-b3c5-0a86099d5063 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.713334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2888f-e331-4fb2-b3c5-0a86099d5063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.714933 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2888f-e331-4fb2-b3c5-0a86099d5063 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.716878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc29e6-ed41-4e95-8f2e-4bde231adc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.717532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc29e6-ed41-4e95-8f2e-4bde231adc6e admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.717815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc29e6-ed41-4e95-8f2e-4bde231adc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.718093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc29e6-ed41-4e95-8f2e-4bde231adc6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.718821 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc29e6-ed41-4e95-8f2e-4bde231adc6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.720421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc29e6-ed41-4e95-8f2e-4bde231adc6e admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.724794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 793/1604] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:16.725670 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2888f-e331-4fb2-b3c5-0a86099d5063 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.731314 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 812/1605] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:16.732412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc29e6-ed41-4e95-8f2e-4bde231adc6e admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.741909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc29e6-ed41-4e95-8f2e-4bde231adc6e admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.747229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49372049-cb75-4f78-afd1-f5ff8c96df16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.748102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49372049-cb75-4f78-afd1-f5ff8c96df16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.748386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49372049-cb75-4f78-afd1-f5ff8c96df16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.748916 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49372049-cb75-4f78-afd1-f5ff8c96df16 admin admin] PATH_INFO: `/v3/projects/c2eeb9017821482580e5f489157f77b3/users/257a68514f964cca8c38194ce6c9a5ea/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.764227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49372049-cb75-4f78-afd1-f5ff8c96df16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2eeb9017821482580e5f489157f77b3, user_id=257a68514f964cca8c38194ce6c9a5ea, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.767299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49372049-cb75-4f78-afd1-f5ff8c96df16 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.779864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 813/1606] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:16 2022] PUT /identity/v3/projects/c2eeb9017821482580e5f489157f77b3/users/257a68514f964cca8c38194ce6c9a5ea/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:16.780797 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49372049-cb75-4f78-afd1-f5ff8c96df16 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.795793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2888f-e331-4fb2-b3c5-0a86099d5063 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.843434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49372049-cb75-4f78-afd1-f5ff8c96df16 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.848600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f513ec-8008-4957-9127-c42664e5076f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.849480 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f513ec-8008-4957-9127-c42664e5076f admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.849762 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f513ec-8008-4957-9127-c42664e5076f admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.850034 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f513ec-8008-4957-9127-c42664e5076f admin admin] PATH_INFO: `/v3/projects/d822816898904cd89c9565cad32a3000/users/dd4e3bdb8957489b95d48c6f9bd91ca3/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.857301 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb772b-d471-40be-950a-998b92595d08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.857945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb772b-d471-40be-950a-998b92595d08 service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.858224 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb772b-d471-40be-950a-998b92595d08 service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.858492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb772b-d471-40be-950a-998b92595d08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.865353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f513ec-8008-4957-9127-c42664e5076f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d822816898904cd89c9565cad32a3000, user_id=dd4e3bdb8957489b95d48c6f9bd91ca3, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.868118 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f513ec-8008-4957-9127-c42664e5076f admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.881914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 814/1607] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:16 2022] PUT /identity/v3/projects/d822816898904cd89c9565cad32a3000/users/dd4e3bdb8957489b95d48c6f9bd91ca3/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:16.882757 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f513ec-8008-4957-9127-c42664e5076f admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.913027 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb772b-d471-40be-950a-998b92595d08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.914653 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb772b-d471-40be-950a-998b92595d08 service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.923969 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 794/1608] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:16.924882 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb772b-d471-40be-950a-998b92595d08 service nova] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.935528 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb772b-d471-40be-950a-998b92595d08 service nova] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.940783 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d65d3b-4896-4ef6-a900-7c6325b7c7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.941439 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65d3b-4896-4ef6-a900-7c6325b7c7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.941635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f513ec-8008-4957-9127-c42664e5076f admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:16.941759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65d3b-4896-4ef6-a900-7c6325b7c7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.941983 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65d3b-4896-4ef6-a900-7c6325b7c7f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.942662 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d65d3b-4896-4ef6-a900-7c6325b7c7f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.944618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d65d3b-4896-4ef6-a900-7c6325b7c7f1 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.947471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977819de-ad50-4d4f-bd6d-0ec1934630fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:16.948412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977819de-ad50-4d4f-bd6d-0ec1934630fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.948810 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977819de-ad50-4d4f-bd6d-0ec1934630fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.949148 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977819de-ad50-4d4f-bd6d-0ec1934630fd admin admin] PATH_INFO: `/v3/projects/1db8614122ac4e068e093b3ee4dc9c0a/users/d9fff6faa4cd424fb86378738e54d6fd/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.964842 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977819de-ad50-4d4f-bd6d-0ec1934630fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db8614122ac4e068e093b3ee4dc9c0a, user_id=d9fff6faa4cd424fb86378738e54d6fd, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:16.968463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 795/1609] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:16 2022] POST /identity/v3/users => generated 309 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:16.968463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8274d5-d410-4c3f-9d74-9bcf99e15a8f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:16.968463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8274d5-d410-4c3f-9d74-9bcf99e15a8f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:16.968463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8274d5-d410-4c3f-9d74-9bcf99e15a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:16.968838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977819de-ad50-4d4f-bd6d-0ec1934630fd admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:16.985867 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 815/1610] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:16 2022] PUT /identity/v3/projects/1db8614122ac4e068e093b3ee4dc9c0a/users/d9fff6faa4cd424fb86378738e54d6fd/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:16.985867 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977819de-ad50-4d4f-bd6d-0ec1934630fd admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:16.987286 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-3c8274d5-d410-4c3f-9d74-9bcf99e15a8f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:16.988586 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-3c8274d5-d410-4c3f-9d74-9bcf99e15a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:17.046265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 796/1611] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:17.047343 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8274d5-d410-4c3f-9d74-9bcf99e15a8f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:17.057260 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8274d5-d410-4c3f-9d74-9bcf99e15a8f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:17.062027 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ce0c1-0f97-4e0f-a992-625d1b501b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:17.062674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977819de-ad50-4d4f-bd6d-0ec1934630fd admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:17.063052 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ce0c1-0f97-4e0f-a992-625d1b501b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.063405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ce0c1-0f97-4e0f-a992-625d1b501b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.063743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ce0c1-0f97-4e0f-a992-625d1b501b3c admin admin] PATH_INFO: `/v3/projects/4b17157ada2144d18f2332c894a2f5e4/users/f8f765f9b7104604b1ea1ec482932814/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.067434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81391dab-3392-472d-ad3b-54ab94f035e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:17.068221 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81391dab-3392-472d-ad3b-54ab94f035e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.068501 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81391dab-3392-472d-ad3b-54ab94f035e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.068816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81391dab-3392-472d-ad3b-54ab94f035e8 admin admin] PATH_INFO: `/v3/projects/0148c59efa8049158df9c604abe3c038/users/ab03024c5ad2431d96565970b4c12161/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.078589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ce0c1-0f97-4e0f-a992-625d1b501b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b17157ada2144d18f2332c894a2f5e4, user_id=f8f765f9b7104604b1ea1ec482932814, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:17.081364 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ce0c1-0f97-4e0f-a992-625d1b501b3c admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:17.083383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81391dab-3392-472d-ad3b-54ab94f035e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0148c59efa8049158df9c604abe3c038, user_id=ab03024c5ad2431d96565970b4c12161, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:17.086473 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81391dab-3392-472d-ad3b-54ab94f035e8 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:17.095042 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 797/1612] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:17 2022] PUT /identity/v3/projects/4b17157ada2144d18f2332c894a2f5e4/users/f8f765f9b7104604b1ea1ec482932814/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:17.096189 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b7db8-b835-4558-b730-6e748232dc92 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.096476 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b7db8-b835-4558-b730-6e748232dc92 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.097022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b7db8-b835-4558-b730-6e748232dc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.108599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 816/1613] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:16 2022] PUT /identity/v3/projects/0148c59efa8049158df9c604abe3c038/users/ab03024c5ad2431d96565970b4c12161/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:17.108599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eb7cb-41b1-4c36-9eaf-af9e7cc9a430 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.108599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eb7cb-41b1-4c36-9eaf-af9e7cc9a430 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.108599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eb7cb-41b1-4c36-9eaf-af9e7cc9a430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.123195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-0d3b7db8-b835-4558-b730-6e748232dc92 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:17.124483 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-0d3b7db8-b835-4558-b730-6e748232dc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:17.125589 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-b92eb7cb-41b1-4c36-9eaf-af9e7cc9a430 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:17.127010 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b92eb7cb-41b1-4c36-9eaf-af9e7cc9a430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:17.186903 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 798/1614] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:17.190060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 817/1615] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:17.190060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92eb7cb-41b1-4c36-9eaf-af9e7cc9a430 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:17.190261 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9484def-6ba3-4a5b-969a-b4fcb148037a None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.190261 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9484def-6ba3-4a5b-969a-b4fcb148037a None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.190469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9484def-6ba3-4a5b-969a-b4fcb148037a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.201712 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92eb7cb-41b1-4c36-9eaf-af9e7cc9a430 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:17.206466 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff470744-1aad-4dca-bdc4-2dfec7d5f811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:17.207122 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff470744-1aad-4dca-bdc4-2dfec7d5f811 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.207397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff470744-1aad-4dca-bdc4-2dfec7d5f811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.207664 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff470744-1aad-4dca-bdc4-2dfec7d5f811 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.208392 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff470744-1aad-4dca-bdc4-2dfec7d5f811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:17.210010 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff470744-1aad-4dca-bdc4-2dfec7d5f811 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:17.215203 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-e9484def-6ba3-4a5b-969a-b4fcb148037a None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:17.216467 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e9484def-6ba3-4a5b-969a-b4fcb148037a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:17.223390 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 818/1616] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:17.223390 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff470744-1aad-4dca-bdc4-2dfec7d5f811 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:17.227943 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 799/1617] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:17.229220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34f4b6-3a39-4928-a3d2-2217988def3f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.229508 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34f4b6-3a39-4928-a3d2-2217988def3f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.229783 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34f4b6-3a39-4928-a3d2-2217988def3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.248247 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-bd34f4b6-3a39-4928-a3d2-2217988def3f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:17.249469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-bd34f4b6-3a39-4928-a3d2-2217988def3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:17.257069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 800/1618] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:17.261909 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d2bbc-caa8-4a64-89f5-777215da2fa7 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.262202 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d2bbc-caa8-4a64-89f5-777215da2fa7 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.262480 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d2bbc-caa8-4a64-89f5-777215da2fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.288894 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-4a7d2bbc-caa8-4a64-89f5-777215da2fa7 None None] MFA Rules not processed for user `ab03024c5ad2431d96565970b4c12161`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:17.290301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff470744-1aad-4dca-bdc4-2dfec7d5f811 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:17.290465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-4a7d2bbc-caa8-4a64-89f5-777215da2fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:17.293975 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b6091-87e1-427b-bef4-3ee4348cee37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:17.294660 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b6091-87e1-427b-bef4-3ee4348cee37 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.295032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b6091-87e1-427b-bef4-3ee4348cee37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.295635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b6091-87e1-427b-bef4-3ee4348cee37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.304323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b6091-87e1-427b-bef4-3ee4348cee37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:17.306465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b6091-87e1-427b-bef4-3ee4348cee37 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:17.316198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 819/1619] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:17.317046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b6091-87e1-427b-bef4-3ee4348cee37 service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:17.318343 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c85b6091-87e1-427b-bef4-3ee4348cee37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:17.329365 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b6091-87e1-427b-bef4-3ee4348cee37 service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:17.333594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d0015-9a6d-491c-b331-b50830270c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:17.334269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d0015-9a6d-491c-b331-b50830270c68 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.334514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d0015-9a6d-491c-b331-b50830270c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.334790 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d0015-9a6d-491c-b331-b50830270c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.347306 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d0015-9a6d-491c-b331-b50830270c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:17.349412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d0015-9a6d-491c-b331-b50830270c68 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:17.360438 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 820/1620] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:17.361359 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d0015-9a6d-491c-b331-b50830270c68 service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:17.372361 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d0015-9a6d-491c-b331-b50830270c68 service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:17.383447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 801/1621] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:17.383447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d2bbc-caa8-4a64-89f5-777215da2fa7 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:17.386776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2fddd-b9bd-4ff0-a5c1-73a5132ab39b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:17.387437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2fddd-b9bd-4ff0-a5c1-73a5132ab39b service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.387721 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2fddd-b9bd-4ff0-a5c1-73a5132ab39b service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.387994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2fddd-b9bd-4ff0-a5c1-73a5132ab39b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.409065 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2fddd-b9bd-4ff0-a5c1-73a5132ab39b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:17.410016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d2bbc-caa8-4a64-89f5-777215da2fa7 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:17.411196 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2fddd-b9bd-4ff0-a5c1-73a5132ab39b service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:17.422124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a0743-9c0f-46c5-a560-ffba3b02765f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:17.423224 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a0743-9c0f-46c5-a560-ffba3b02765f admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.423689 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 821/1622] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:17.424199 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a0743-9c0f-46c5-a560-ffba3b02765f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.425187 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2fddd-b9bd-4ff0-a5c1-73a5132ab39b service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:17.426187 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a0743-9c0f-46c5-a560-ffba3b02765f admin admin] PATH_INFO: `/v3/projects/0eaf08d808dd49dab5a8842266db82d5/users/be0bebd7a2b440c0953fbd216cbc8702/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.436574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2fddd-b9bd-4ff0-a5c1-73a5132ab39b service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:17.441868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb0c2d-a1ad-42d2-88c2-1843a1ffe56e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:17.443013 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb0c2d-a1ad-42d2-88c2-1843a1ffe56e service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.443417 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb0c2d-a1ad-42d2-88c2-1843a1ffe56e service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.443816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb0c2d-a1ad-42d2-88c2-1843a1ffe56e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.450396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a0743-9c0f-46c5-a560-ffba3b02765f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaf08d808dd49dab5a8842266db82d5, user_id=be0bebd7a2b440c0953fbd216cbc8702, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:17.454008 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a0743-9c0f-46c5-a560-ffba3b02765f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:17.461785 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb0c2d-a1ad-42d2-88c2-1843a1ffe56e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:17.461785 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb0c2d-a1ad-42d2-88c2-1843a1ffe56e service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:17.476388 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 802/1624] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:17 2022] PUT /identity/v3/projects/0eaf08d808dd49dab5a8842266db82d5/users/be0bebd7a2b440c0953fbd216cbc8702/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:17.476645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 822/1624] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:17.476744 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a0743-9c0f-46c5-a560-ffba3b02765f admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:17.476829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb0c2d-a1ad-42d2-88c2-1843a1ffe56e service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:17.487283 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb0c2d-a1ad-42d2-88c2-1843a1ffe56e service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:17.560425 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a0743-9c0f-46c5-a560-ffba3b02765f admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:17.561279 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd7d2d-28fa-40c6-ad44-62ce460da3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:17.562318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd7d2d-28fa-40c6-ad44-62ce460da3bd admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.562679 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd7d2d-28fa-40c6-ad44-62ce460da3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.563022 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd7d2d-28fa-40c6-ad44-62ce460da3bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.563821 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd7d2d-28fa-40c6-ad44-62ce460da3bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:17.565906 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce33fd6-8c8e-4972-91ab-295dcd24a9c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:17.566455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd7d2d-28fa-40c6-ad44-62ce460da3bd admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:17.566955 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce33fd6-8c8e-4972-91ab-295dcd24a9c6 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.567334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce33fd6-8c8e-4972-91ab-295dcd24a9c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.567724 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce33fd6-8c8e-4972-91ab-295dcd24a9c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.581758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce33fd6-8c8e-4972-91ab-295dcd24a9c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:17.583607 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce33fd6-8c8e-4972-91ab-295dcd24a9c6 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:17.601688 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 803/1625] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:17.604232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88af002-db77-418a-9f73-8d366e73881b None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.604681 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88af002-db77-418a-9f73-8d366e73881b None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.605028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88af002-db77-418a-9f73-8d366e73881b None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.605754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 823/1626] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:17 2022] POST /identity/v3/projects => generated 369 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:17.606897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd7d2d-28fa-40c6-ad44-62ce460da3bd admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:17.608934 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 804/1627] 10.222.0.60 () {54 vars in 961 bytes} [Fri May 6 23:33:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:33:17.609800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88af002-db77-418a-9f73-8d366e73881b None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:17.691793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd7d2d-28fa-40c6-ad44-62ce460da3bd admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:17.702403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c361a-5ed6-4ba4-9ed1-6a3be740e83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:17.703832 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c361a-5ed6-4ba4-9ed1-6a3be740e83c admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.704089 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c361a-5ed6-4ba4-9ed1-6a3be740e83c admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.704362 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c361a-5ed6-4ba4-9ed1-6a3be740e83c admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.705187 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c361a-5ed6-4ba4-9ed1-6a3be740e83c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:17.707043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c361a-5ed6-4ba4-9ed1-6a3be740e83c admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:17.708090 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88af002-db77-418a-9f73-8d366e73881b None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:17.714931 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa71b6a-1669-42c2-b83e-c1c04b694cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:17.715873 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa71b6a-1669-42c2-b83e-c1c04b694cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.716162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa71b6a-1669-42c2-b83e-c1c04b694cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.716436 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa71b6a-1669-42c2-b83e-c1c04b694cf7 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.717327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa71b6a-1669-42c2-b83e-c1c04b694cf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:17.719718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa71b6a-1669-42c2-b83e-c1c04b694cf7 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:17.722020 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 824/1628] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:17.723569 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5859c0-032e-493d-ad8e-3c4202aed4c3 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.723922 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5859c0-032e-493d-ad8e-3c4202aed4c3 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.724155 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5859c0-032e-493d-ad8e-3c4202aed4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.751923 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-dd5859c0-032e-493d-ad8e-3c4202aed4c3 None None] MFA Rules not processed for user `9b74631c6e1547d991753a65c41bc7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:17.753513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-dd5859c0-032e-493d-ad8e-3c4202aed4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:17.767555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 805/1629] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:17 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:17.768470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa71b6a-1669-42c2-b83e-c1c04b694cf7 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:17.796211 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa71b6a-1669-42c2-b83e-c1c04b694cf7 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:17.802395 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073234e7-3d2a-445f-a78b-9609434a09b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:17.803300 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073234e7-3d2a-445f-a78b-9609434a09b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.803583 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073234e7-3d2a-445f-a78b-9609434a09b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.804041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073234e7-3d2a-445f-a78b-9609434a09b3 admin admin] PATH_INFO: `/v3/projects/0eaf08d808dd49dab5a8842266db82d5/users/be0bebd7a2b440c0953fbd216cbc8702/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.807112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073234e7-3d2a-445f-a78b-9609434a09b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaf08d808dd49dab5a8842266db82d5, user_id=be0bebd7a2b440c0953fbd216cbc8702, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:17.811018 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073234e7-3d2a-445f-a78b-9609434a09b3 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:17.833160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 806/1630] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:17 2022] PUT /identity/v3/projects/0eaf08d808dd49dab5a8842266db82d5/users/be0bebd7a2b440c0953fbd216cbc8702/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:17.834534 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073234e7-3d2a-445f-a78b-9609434a09b3 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:17.922661 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073234e7-3d2a-445f-a78b-9609434a09b3 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:17.928295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882e59b-1bf8-40b9-92c2-ae16e2cbe454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:17.929925 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882e59b-1bf8-40b9-92c2-ae16e2cbe454 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.931148 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882e59b-1bf8-40b9-92c2-ae16e2cbe454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.931508 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882e59b-1bf8-40b9-92c2-ae16e2cbe454 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.931694 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 825/1631] 10.222.0.60 () {58 vars in 1058 bytes} [Fri May 6 23:33:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:17.932262 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882e59b-1bf8-40b9-92c2-ae16e2cbe454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:17.934181 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882e59b-1bf8-40b9-92c2-ae16e2cbe454 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:17.935610 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ec955-c90e-46a8-a42c-91792e865a65 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.936611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ec955-c90e-46a8-a42c-91792e865a65 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.937355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ec955-c90e-46a8-a42c-91792e865a65 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.948121 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 807/1632] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:17.950436 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 826/1633] 10.222.0.60 () {54 vars in 912 bytes} [Fri May 6 23:33:17 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:33:17.953416 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ec955-c90e-46a8-a42c-91792e865a65 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:17.953682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdf83e-1dfc-4dfe-8c0f-e68634d949b3 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:17.954505 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdf83e-1dfc-4dfe-8c0f-e68634d949b3 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:17.954773 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdf83e-1dfc-4dfe-8c0f-e68634d949b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:17.981302 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-0afdf83e-1dfc-4dfe-8c0f-e68634d949b3 None None] MFA Rules not processed for user `9b74631c6e1547d991753a65c41bc7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:17.982633 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-0afdf83e-1dfc-4dfe-8c0f-e68634d949b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:17.986872 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ec955-c90e-46a8-a42c-91792e865a65 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:18.008334 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e90a26-619a-43b2-855c-13e74a0f18ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:18.009590 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e90a26-619a-43b2-855c-13e74a0f18ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:18.009865 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e90a26-619a-43b2-855c-13e74a0f18ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:18.010135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e90a26-619a-43b2-855c-13e74a0f18ba admin admin] PATH_INFO: `/v3/projects/b0b984e3fc6841f2bba7541a8047b786/users/906709da9b524834bffe9727e2d46520/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:18.037079 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e90a26-619a-43b2-855c-13e74a0f18ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b984e3fc6841f2bba7541a8047b786, user_id=906709da9b524834bffe9727e2d46520, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:18.041979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e90a26-619a-43b2-855c-13e74a0f18ba admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:18.067149 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 808/1634] 10.222.0.60 () {58 vars in 1009 bytes} [Fri May 6 23:33:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:18.074257 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 827/1635] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:17 2022] PUT /identity/v3/projects/b0b984e3fc6841f2bba7541a8047b786/users/906709da9b524834bffe9727e2d46520/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:18.075565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdf83e-1dfc-4dfe-8c0f-e68634d949b3 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:18.089547 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e90a26-619a-43b2-855c-13e74a0f18ba admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:18.111638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdf83e-1dfc-4dfe-8c0f-e68634d949b3 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:18.198382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e90a26-619a-43b2-855c-13e74a0f18ba admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:18.204467 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd1194-2b58-4f82-99a9-0d91002e7df5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:18.206832 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd1194-2b58-4f82-99a9-0d91002e7df5 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:18.207455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd1194-2b58-4f82-99a9-0d91002e7df5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:18.207738 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd1194-2b58-4f82-99a9-0d91002e7df5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:18.223357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aae754-dc6a-45c6-a152-bc8534ade30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:18.224042 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aae754-dc6a-45c6-a152-bc8534ade30f admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:18.224961 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aae754-dc6a-45c6-a152-bc8534ade30f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:18.225443 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aae754-dc6a-45c6-a152-bc8534ade30f admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:18.226190 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aae754-dc6a-45c6-a152-bc8534ade30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:18.228480 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aae754-dc6a-45c6-a152-bc8534ade30f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:18.241069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 809/1636] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:33:18.246319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aae754-dc6a-45c6-a152-bc8534ade30f admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:18.257500 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aae754-dc6a-45c6-a152-bc8534ade30f admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:18.263384 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb8db8-5004-4bd6-97f0-81d3e5ec87db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:18.264529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb8db8-5004-4bd6-97f0-81d3e5ec87db admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:18.264914 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb8db8-5004-4bd6-97f0-81d3e5ec87db admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:18.265416 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb8db8-5004-4bd6-97f0-81d3e5ec87db admin admin] PATH_INFO: `/v3/projects/b0b984e3fc6841f2bba7541a8047b786/users/906709da9b524834bffe9727e2d46520/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:18.269628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb8db8-5004-4bd6-97f0-81d3e5ec87db admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b984e3fc6841f2bba7541a8047b786, user_id=906709da9b524834bffe9727e2d46520, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:18.273063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb8db8-5004-4bd6-97f0-81d3e5ec87db admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:18.296659 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 810/1637] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:18 2022] PUT /identity/v3/projects/b0b984e3fc6841f2bba7541a8047b786/users/906709da9b524834bffe9727e2d46520/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:18.301272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1363ee5-7a55-4e46-9f07-4fcbf6f7de19 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:18.301559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1363ee5-7a55-4e46-9f07-4fcbf6f7de19 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:18.302500 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1363ee5-7a55-4e46-9f07-4fcbf6f7de19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:18.313909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd1194-2b58-4f82-99a9-0d91002e7df5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:18.315533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd1194-2b58-4f82-99a9-0d91002e7df5 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:18.334915 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 828/1638] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:18.346052 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-a1363ee5-7a55-4e46-9f07-4fcbf6f7de19 None None] MFA Rules not processed for user `906709da9b524834bffe9727e2d46520`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:18.348284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-a1363ee5-7a55-4e46-9f07-4fcbf6f7de19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:18.506151 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 811/1639] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:18 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:18.519501 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd1194-2b58-4f82-99a9-0d91002e7df5 service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:18.531850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd1194-2b58-4f82-99a9-0d91002e7df5 service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:18.583729 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4a66d-68f0-46dd-9207-531a285e194a None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:18.584444 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4a66d-68f0-46dd-9207-531a285e194a None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:18.584444 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4a66d-68f0-46dd-9207-531a285e194a None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:18.587598 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 812/1640] 10.222.0.60 () {54 vars in 912 bytes} [Fri May 6 23:33:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:33:18.608394 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62546c3-daa8-4a5b-9c5a-2751916618e3 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:18.608619 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62546c3-daa8-4a5b-9c5a-2751916618e3 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:18.609021 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62546c3-daa8-4a5b-9c5a-2751916618e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:18.644867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-f62546c3-daa8-4a5b-9c5a-2751916618e3 None None] MFA Rules not processed for user `9b74631c6e1547d991753a65c41bc7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:18.646271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f62546c3-daa8-4a5b-9c5a-2751916618e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:18.704851 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d56149-4ba4-402a-9ff5-fba97990f265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:18.705624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d56149-4ba4-402a-9ff5-fba97990f265 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:18.705973 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d56149-4ba4-402a-9ff5-fba97990f265 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:18.706316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d56149-4ba4-402a-9ff5-fba97990f265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:18.732226 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d56149-4ba4-402a-9ff5-fba97990f265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:18.733877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d56149-4ba4-402a-9ff5-fba97990f265 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:18.750514 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 813/1641] 10.222.0.60 () {58 vars in 1009 bytes} [Fri May 6 23:33:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:33:18.775356 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 829/1642] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:18 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:18.788424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62546c3-daa8-4a5b-9c5a-2751916618e3 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:18.804028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62546c3-daa8-4a5b-9c5a-2751916618e3 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:18.831652 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db6c18-51ce-469f-9b60-718ea3abbbd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:18.833711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db6c18-51ce-469f-9b60-718ea3abbbd8 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:18.835035 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db6c18-51ce-469f-9b60-718ea3abbbd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:18.837057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db6c18-51ce-469f-9b60-718ea3abbbd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:18.860295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db6c18-51ce-469f-9b60-718ea3abbbd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:18.862358 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db6c18-51ce-469f-9b60-718ea3abbbd8 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:18.880270 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 814/1643] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:19.047745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d56149-4ba4-402a-9ff5-fba97990f265 service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:19.156066 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d56149-4ba4-402a-9ff5-fba97990f265 service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:19.162599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb1844-2725-4f67-978e-88fe9f635d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:19.163638 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb1844-2725-4f67-978e-88fe9f635d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:19.163951 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb1844-2725-4f67-978e-88fe9f635d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:19.164326 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb1844-2725-4f67-978e-88fe9f635d2c admin admin] PATH_INFO: `/v3/users/822fda1e71e346388a62854ba51a0560` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:19.166155 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb1844-2725-4f67-978e-88fe9f635d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=822fda1e71e346388a62854ba51a0560)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:19.168388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb1844-2725-4f67-978e-88fe9f635d2c admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:19.261937 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-47eb1844-2725-4f67-978e-88fe9f635d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '822fda1e71e346388a62854ba51a0560'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:19.278150 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-47eb1844-2725-4f67-978e-88fe9f635d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '822fda1e71e346388a62854ba51a0560'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:19.280908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-47eb1844-2725-4f67-978e-88fe9f635d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '822fda1e71e346388a62854ba51a0560'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:19.306360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-47eb1844-2725-4f67-978e-88fe9f635d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '822fda1e71e346388a62854ba51a0560'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:19.307067 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-47eb1844-2725-4f67-978e-88fe9f635d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '822fda1e71e346388a62854ba51a0560'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:19.346442 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 830/1644] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:33:19 2022] DELETE /identity/v3/users/822fda1e71e346388a62854ba51a0560 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:19.351017 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff25121-cf73-477a-92fe-ccef32068ab1 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:19.351322 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff25121-cf73-477a-92fe-ccef32068ab1 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:19.351583 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff25121-cf73-477a-92fe-ccef32068ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:19.394429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-2ff25121-cf73-477a-92fe-ccef32068ab1 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:19.397159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-2ff25121-cf73-477a-92fe-ccef32068ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:19.491626 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb1844-2725-4f67-978e-88fe9f635d2c admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:19.493894 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-47eb1844-2725-4f67-978e-88fe9f635d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:19.516585 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 815/1645] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:19.545818 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff25121-cf73-477a-92fe-ccef32068ab1 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:19.547919 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-2ff25121-cf73-477a-92fe-ccef32068ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:19.638547 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb1844-2725-4f67-978e-88fe9f635d2c admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:19.652238 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209087b9-6982-4655-8a8c-a673ed98eb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:19.653434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209087b9-6982-4655-8a8c-a673ed98eb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:19.653587 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209087b9-6982-4655-8a8c-a673ed98eb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:19.656074 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209087b9-6982-4655-8a8c-a673ed98eb92 admin admin] PATH_INFO: `/v3/users/ab03024c5ad2431d96565970b4c12161` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:19.657546 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209087b9-6982-4655-8a8c-a673ed98eb92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab03024c5ad2431d96565970b4c12161)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:19.663516 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209087b9-6982-4655-8a8c-a673ed98eb92 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:19.694157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff25121-cf73-477a-92fe-ccef32068ab1 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:19.706794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b124d26-80c6-46d8-b503-7a0ec99c5a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:19.708750 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b124d26-80c6-46d8-b503-7a0ec99c5a81 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:19.709648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b124d26-80c6-46d8-b503-7a0ec99c5a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:19.709902 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b124d26-80c6-46d8-b503-7a0ec99c5a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:19.736645 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b124d26-80c6-46d8-b503-7a0ec99c5a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:19.745161 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b124d26-80c6-46d8-b503-7a0ec99c5a81 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:19.770804 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-209087b9-6982-4655-8a8c-a673ed98eb92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab03024c5ad2431d96565970b4c12161'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:19.774006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 816/1646] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:33:19.780884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-209087b9-6982-4655-8a8c-a673ed98eb92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab03024c5ad2431d96565970b4c12161'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:19.781917 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-209087b9-6982-4655-8a8c-a673ed98eb92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab03024c5ad2431d96565970b4c12161'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:19.793908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-209087b9-6982-4655-8a8c-a673ed98eb92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab03024c5ad2431d96565970b4c12161'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:19.795053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-209087b9-6982-4655-8a8c-a673ed98eb92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab03024c5ad2431d96565970b4c12161'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:19.823733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 831/1647] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:33:19 2022] DELETE /identity/v3/users/ab03024c5ad2431d96565970b4c12161 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:33:19.826780 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9a802-8473-47af-b8cf-1ef251e7009f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:19.827150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9a802-8473-47af-b8cf-1ef251e7009f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:19.827500 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9a802-8473-47af-b8cf-1ef251e7009f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:19.860759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-a9c9a802-8473-47af-b8cf-1ef251e7009f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:19.862292 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-a9c9a802-8473-47af-b8cf-1ef251e7009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:19.949254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 817/1648] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:19.973938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209087b9-6982-4655-8a8c-a673ed98eb92 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:19.975591 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-209087b9-6982-4655-8a8c-a673ed98eb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:20.048480 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209087b9-6982-4655-8a8c-a673ed98eb92 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:20.052791 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be4b05-82c6-4d45-8227-b1208bc04a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:20.053451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be4b05-82c6-4d45-8227-b1208bc04a2f service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:20.054171 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be4b05-82c6-4d45-8227-b1208bc04a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:20.054364 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be4b05-82c6-4d45-8227-b1208bc04a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:20.067871 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be4b05-82c6-4d45-8227-b1208bc04a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:20.069694 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be4b05-82c6-4d45-8227-b1208bc04a2f service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:20.086698 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 832/1649] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:20.227174 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce10f89-e321-493a-9c1d-3ce9822f47bc None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:20.227822 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce10f89-e321-493a-9c1d-3ce9822f47bc None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:20.228107 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce10f89-e321-493a-9c1d-3ce9822f47bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:20.272185 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-5ce10f89-e321-493a-9c1d-3ce9822f47bc None None] MFA Rules not processed for user `257a68514f964cca8c38194ce6c9a5ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:20.280000 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-5ce10f89-e321-493a-9c1d-3ce9822f47bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:20.409452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 818/1650] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:20.421840 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8c882-8de6-40c1-87a2-650048453a1f None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:20.422125 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8c882-8de6-40c1-87a2-650048453a1f None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:20.422407 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8c882-8de6-40c1-87a2-650048453a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:20.441872 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-15f8c882-8de6-40c1-87a2-650048453a1f None None] MFA Rules not processed for user `257a68514f964cca8c38194ce6c9a5ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:20.443515 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-15f8c882-8de6-40c1-87a2-650048453a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:20.462562 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 833/1651] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:20.463977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce10f89-e321-493a-9c1d-3ce9822f47bc None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:20.467085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-5ce10f89-e321-493a-9c1d-3ce9822f47bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:20.626111 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce10f89-e321-493a-9c1d-3ce9822f47bc None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:20.635635 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218bdf7-6f98-4d20-b035-8fc11e22193f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:20.636523 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218bdf7-6f98-4d20-b035-8fc11e22193f service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:20.637008 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218bdf7-6f98-4d20-b035-8fc11e22193f service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:20.637439 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218bdf7-6f98-4d20-b035-8fc11e22193f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:20.650779 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218bdf7-6f98-4d20-b035-8fc11e22193f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:20.652747 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218bdf7-6f98-4d20-b035-8fc11e22193f service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:20.667192 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 819/1652] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:33:20.693961 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401d86b-9ff7-4e1c-bbcf-27caac6b9d1a None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:20.694516 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401d86b-9ff7-4e1c-bbcf-27caac6b9d1a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:20.695112 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401d86b-9ff7-4e1c-bbcf-27caac6b9d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:20.750913 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-b401d86b-9ff7-4e1c-bbcf-27caac6b9d1a None None] MFA Rules not processed for user `be0bebd7a2b440c0953fbd216cbc8702`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:20.752691 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b401d86b-9ff7-4e1c-bbcf-27caac6b9d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:20.859486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 834/1653] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:20 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:21.526182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218bdf7-6f98-4d20-b035-8fc11e22193f service nova] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:21.528859 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f218bdf7-6f98-4d20-b035-8fc11e22193f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:21.568865 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218bdf7-6f98-4d20-b035-8fc11e22193f service nova] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:21.576237 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb7a01-6bab-4069-b3a2-00ebab501bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:21.580635 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb7a01-6bab-4069-b3a2-00ebab501bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:21.580635 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb7a01-6bab-4069-b3a2-00ebab501bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:21.580635 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb7a01-6bab-4069-b3a2-00ebab501bd1 admin admin] PATH_INFO: `/v3/projects/0148c59efa8049158df9c604abe3c038` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:21.580635 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb7a01-6bab-4069-b3a2-00ebab501bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0148c59efa8049158df9c604abe3c038)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:21.581385 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb7a01-6bab-4069-b3a2-00ebab501bd1 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:21.645006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2dfb7a01-6bab-4069-b3a2-00ebab501bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0148c59efa8049158df9c604abe3c038', 'request_id': 'req-2dfb7a01-6bab-4069-b3a2-00ebab501bd1'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:21.651934 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2dfb7a01-6bab-4069-b3a2-00ebab501bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0148c59efa8049158df9c604abe3c038', 'request_id': 'req-2dfb7a01-6bab-4069-b3a2-00ebab501bd1'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:21.658409 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2dfb7a01-6bab-4069-b3a2-00ebab501bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0148c59efa8049158df9c604abe3c038', 'request_id': 'req-2dfb7a01-6bab-4069-b3a2-00ebab501bd1'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:21.673838 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2dfb7a01-6bab-4069-b3a2-00ebab501bd1 admin admin] The token cache is being invalidate because project 0148c59efa8049158df9c604abe3c038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:33:21.674533 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2dfb7a01-6bab-4069-b3a2-00ebab501bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:21.683342 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2dfb7a01-6bab-4069-b3a2-00ebab501bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:21.683342 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 820/1654] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:33:21 2022] DELETE /identity/v3/projects/0148c59efa8049158df9c604abe3c038 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:21.683756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401d86b-9ff7-4e1c-bbcf-27caac6b9d1a None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:21.684845 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b401d86b-9ff7-4e1c-bbcf-27caac6b9d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:21.685298 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb7a01-6bab-4069-b3a2-00ebab501bd1 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:21.686946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-2dfb7a01-6bab-4069-b3a2-00ebab501bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:21.699586 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401d86b-9ff7-4e1c-bbcf-27caac6b9d1a None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:21.784051 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be02d4-4208-45d1-b11c-8c337d52c4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:21.785249 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be02d4-4208-45d1-b11c-8c337d52c4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:21.785535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be02d4-4208-45d1-b11c-8c337d52c4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:21.785813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be02d4-4208-45d1-b11c-8c337d52c4f9 admin admin] PATH_INFO: `/v3/projects/d4bd180f0f974e36a912b6c0efee6fa9` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:21.787045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be02d4-4208-45d1-b11c-8c337d52c4f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4bd180f0f974e36a912b6c0efee6fa9)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:21.788079 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: WARNING py.warnings [None req-80be02d4-4208-45d1-b11c-8c337d52c4f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 06 23:33:21.788079 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: warnings.warn(msg) May 06 23:33:21.788079 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: May 06 23:33:21.789063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb7a01-6bab-4069-b3a2-00ebab501bd1 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:21.789489 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be02d4-4208-45d1-b11c-8c337d52c4f9 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:21.794872 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf0bf1-2196-46a7-ad5a-128e9842cca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:21.796122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf0bf1-2196-46a7-ad5a-128e9842cca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:21.796776 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf0bf1-2196-46a7-ad5a-128e9842cca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:21.797264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf0bf1-2196-46a7-ad5a-128e9842cca6 admin admin] PATH_INFO: `/v3/users/906709da9b524834bffe9727e2d46520` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:21.799245 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf0bf1-2196-46a7-ad5a-128e9842cca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=906709da9b524834bffe9727e2d46520)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:21.800511 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: WARNING py.warnings [None req-cdaf0bf1-2196-46a7-ad5a-128e9842cca6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 06 23:33:21.800511 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: warnings.warn(msg) May 06 23:33:21.800511 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: May 06 23:33:21.802240 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf0bf1-2196-46a7-ad5a-128e9842cca6 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:21.869588 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-80be02d4-4208-45d1-b11c-8c337d52c4f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4bd180f0f974e36a912b6c0efee6fa9', 'request_id': 'req-80be02d4-4208-45d1-b11c-8c337d52c4f9'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:21.888946 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-80be02d4-4208-45d1-b11c-8c337d52c4f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4bd180f0f974e36a912b6c0efee6fa9', 'request_id': 'req-80be02d4-4208-45d1-b11c-8c337d52c4f9'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:21.899275 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-80be02d4-4208-45d1-b11c-8c337d52c4f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4bd180f0f974e36a912b6c0efee6fa9', 'request_id': 'req-80be02d4-4208-45d1-b11c-8c337d52c4f9'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:21.920079 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cdaf0bf1-2196-46a7-ad5a-128e9842cca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '906709da9b524834bffe9727e2d46520'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:21.921039 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-80be02d4-4208-45d1-b11c-8c337d52c4f9 admin admin] The token cache is being invalidate because project d4bd180f0f974e36a912b6c0efee6fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:33:21.921824 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-80be02d4-4208-45d1-b11c-8c337d52c4f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:21.922706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-80be02d4-4208-45d1-b11c-8c337d52c4f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:21.930055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 835/1655] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:33:21 2022] DELETE /identity/v3/projects/d4bd180f0f974e36a912b6c0efee6fa9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:33:21.932822 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf4339-9610-408c-ad50-bb33d7e22275 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:21.933704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf4339-9610-408c-ad50-bb33d7e22275 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:21.934242 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf4339-9610-408c-ad50-bb33d7e22275 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:21.936377 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 836/1656] 10.222.0.60 () {54 vars in 912 bytes} [Fri May 6 23:33:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:33:21.938387 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01a724-c199-4ed8-a1f7-670171a1eacc None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:21.938877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01a724-c199-4ed8-a1f7-670171a1eacc None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:21.939345 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01a724-c199-4ed8-a1f7-670171a1eacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:21.986380 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cdaf0bf1-2196-46a7-ad5a-128e9842cca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '906709da9b524834bffe9727e2d46520'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:21.992007 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-2f01a724-c199-4ed8-a1f7-670171a1eacc None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:21.993343 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-2f01a724-c199-4ed8-a1f7-670171a1eacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:22.011664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cdaf0bf1-2196-46a7-ad5a-128e9842cca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '906709da9b524834bffe9727e2d46520'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:22.012314 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cdaf0bf1-2196-46a7-ad5a-128e9842cca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '906709da9b524834bffe9727e2d46520'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:22.013142 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cdaf0bf1-2196-46a7-ad5a-128e9842cca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '906709da9b524834bffe9727e2d46520'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:22.109007 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 821/1657] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:33:21 2022] DELETE /identity/v3/users/906709da9b524834bffe9727e2d46520 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:22.109007 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a180be-df0c-4d23-b2bf-5c8c63907d4a None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:22.109007 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a180be-df0c-4d23-b2bf-5c8c63907d4a None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:22.109007 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a180be-df0c-4d23-b2bf-5c8c63907d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:22.129459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 837/1658] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:22.131143 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c224f-b22d-4709-bdb6-e17e1dd80f7b None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:22.131437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c224f-b22d-4709-bdb6-e17e1dd80f7b None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:22.131713 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c224f-b22d-4709-bdb6-e17e1dd80f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:22.170739 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-651c224f-b22d-4709-bdb6-e17e1dd80f7b None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:22.181016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-651c224f-b22d-4709-bdb6-e17e1dd80f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:22.207417 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-30a180be-df0c-4d23-b2bf-5c8c63907d4a None None] MFA Rules not processed for user `046352b8553c4f23b6dda151f6f7ce00`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:22.209479 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-30a180be-df0c-4d23-b2bf-5c8c63907d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:22.344438 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 822/1659] 10.222.0.60 () {58 vars in 1009 bytes} [Fri May 6 23:33:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:22.348514 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a180be-df0c-4d23-b2bf-5c8c63907d4a None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:22.349532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 838/1660] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:22.372827 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a180be-df0c-4d23-b2bf-5c8c63907d4a None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:22.385529 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c224f-b22d-4709-bdb6-e17e1dd80f7b None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:22.385979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bb681-dcdb-4fd3-b1f4-ed075facb230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:22.386672 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bb681-dcdb-4fd3-b1f4-ed075facb230 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:22.386957 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bb681-dcdb-4fd3-b1f4-ed075facb230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:22.387235 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bb681-dcdb-4fd3-b1f4-ed075facb230 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:22.387733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-651c224f-b22d-4709-bdb6-e17e1dd80f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:22.388028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708bb681-dcdb-4fd3-b1f4-ed075facb230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:33:22.388345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708bb681-dcdb-4fd3-b1f4-ed075facb230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:22.390980 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708bb681-dcdb-4fd3-b1f4-ed075facb230 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:22.419535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c224f-b22d-4709-bdb6-e17e1dd80f7b None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:22.424413 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 823/1661] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:33:22.427452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bb681-dcdb-4fd3-b1f4-ed075facb230 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:22.428369 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cacc0f-dcd4-43c3-b6f9-474ba6fac1eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:22.429991 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cacc0f-dcd4-43c3-b6f9-474ba6fac1eb service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:22.431068 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cacc0f-dcd4-43c3-b6f9-474ba6fac1eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:22.431456 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cacc0f-dcd4-43c3-b6f9-474ba6fac1eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:22.449884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cacc0f-dcd4-43c3-b6f9-474ba6fac1eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:22.452257 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cacc0f-dcd4-43c3-b6f9-474ba6fac1eb service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:22.452651 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bb681-dcdb-4fd3-b1f4-ed075facb230 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:22.466204 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6c57f-28a7-4d77-ba42-4ea3908b496e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:22.466940 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6c57f-28a7-4d77-ba42-4ea3908b496e admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:22.467182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6c57f-28a7-4d77-ba42-4ea3908b496e admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:22.467460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6c57f-28a7-4d77-ba42-4ea3908b496e admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:22.468217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6c57f-28a7-4d77-ba42-4ea3908b496e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:22.470203 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6c57f-28a7-4d77-ba42-4ea3908b496e admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:22.479235 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 839/1662] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:33:22.525292 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 824/1663] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:22 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:22.530790 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cacc0f-dcd4-43c3-b6f9-474ba6fac1eb service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:22.549742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cacc0f-dcd4-43c3-b6f9-474ba6fac1eb service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:22.657950 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a1f28-e1d8-4895-867a-a480776100c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:22.658807 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a1f28-e1d8-4895-867a-a480776100c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:22.659098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a1f28-e1d8-4895-867a-a480776100c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:22.659482 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a1f28-e1d8-4895-867a-a480776100c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:22.660224 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a1f28-e1d8-4895-867a-a480776100c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:22.664139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a1f28-e1d8-4895-867a-a480776100c6 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:22.717893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 840/1664] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:22 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:22.721595 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6c57f-28a7-4d77-ba42-4ea3908b496e admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:22.767998 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6c57f-28a7-4d77-ba42-4ea3908b496e admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:22.792221 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e1d36-82dc-4572-8026-086e1ba7dbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:22.793267 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e1d36-82dc-4572-8026-086e1ba7dbfb admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:22.793725 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e1d36-82dc-4572-8026-086e1ba7dbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:22.794155 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e1d36-82dc-4572-8026-086e1ba7dbfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:22.795122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e1d36-82dc-4572-8026-086e1ba7dbfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:22.803742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e1d36-82dc-4572-8026-086e1ba7dbfb admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:22.828468 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a1f28-e1d8-4895-867a-a480776100c6 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:22.844579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 825/1665] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:33:22.847736 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a1f28-e1d8-4895-867a-a480776100c6 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:22.858044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615dde4-0567-4e44-b5aa-e85a02e5fa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:22.859030 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615dde4-0567-4e44-b5aa-e85a02e5fa51 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:22.869461 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615dde4-0567-4e44-b5aa-e85a02e5fa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:22.870074 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615dde4-0567-4e44-b5aa-e85a02e5fa51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:22.872321 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615dde4-0567-4e44-b5aa-e85a02e5fa51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:22.877724 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615dde4-0567-4e44-b5aa-e85a02e5fa51 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:22.893593 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 841/1666] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:22.899496 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e1d36-82dc-4572-8026-086e1ba7dbfb admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:22.912198 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e1d36-82dc-4572-8026-086e1ba7dbfb admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:22.919867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31d9b3-a39f-4f2c-b546-9c18c941906a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:22.920815 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31d9b3-a39f-4f2c-b546-9c18c941906a admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:22.921103 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31d9b3-a39f-4f2c-b546-9c18c941906a admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:22.921934 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31d9b3-a39f-4f2c-b546-9c18c941906a admin admin] PATH_INFO: `/v3/projects/98f163a1f9c14cd8a6e5cd5c95911ed0/users/ca0693b7f0fe432bbbd5b0137d262901/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:22.945326 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31d9b3-a39f-4f2c-b546-9c18c941906a admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f163a1f9c14cd8a6e5cd5c95911ed0, user_id=ca0693b7f0fe432bbbd5b0137d262901, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:22.950915 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31d9b3-a39f-4f2c-b546-9c18c941906a admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:22.985165 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 826/1667] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:22 2022] PUT /identity/v3/projects/98f163a1f9c14cd8a6e5cd5c95911ed0/users/ca0693b7f0fe432bbbd5b0137d262901/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:22.998480 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61bb6e-6202-42f5-b7df-89a075b0ec59 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:22.998913 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61bb6e-6202-42f5-b7df-89a075b0ec59 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:22.999295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61bb6e-6202-42f5-b7df-89a075b0ec59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:23.036160 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-2b61bb6e-6202-42f5-b7df-89a075b0ec59 None None] MFA Rules not processed for user `ca0693b7f0fe432bbbd5b0137d262901`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:23.037658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-2b61bb6e-6202-42f5-b7df-89a075b0ec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:23.177870 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 842/1668] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:23.178039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31d9b3-a39f-4f2c-b546-9c18c941906a admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:23.307906 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31d9b3-a39f-4f2c-b546-9c18c941906a admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:23.313649 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7a409-ea01-48df-9f04-f17543ae4005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:23.314644 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7a409-ea01-48df-9f04-f17543ae4005 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:23.314937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7a409-ea01-48df-9f04-f17543ae4005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:23.315468 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7a409-ea01-48df-9f04-f17543ae4005 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:23.316201 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7a409-ea01-48df-9f04-f17543ae4005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:23.318625 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7a409-ea01-48df-9f04-f17543ae4005 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:23.361446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 827/1669] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:23 2022] POST /identity/v3/projects => generated 381 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:33:23.365409 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61bb6e-6202-42f5-b7df-89a075b0ec59 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:23.389085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61bb6e-6202-42f5-b7df-89a075b0ec59 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:23.581412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f48e9-3684-4f74-ac20-e020d69934e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:23.582630 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f48e9-3684-4f74-ac20-e020d69934e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:23.583030 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f48e9-3684-4f74-ac20-e020d69934e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:23.583437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f48e9-3684-4f74-ac20-e020d69934e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:23.584274 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f48e9-3684-4f74-ac20-e020d69934e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:23.589151 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f48e9-3684-4f74-ac20-e020d69934e8 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:23.633880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 843/1670] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:23 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:23.638336 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7a409-ea01-48df-9f04-f17543ae4005 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:23.659448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7a409-ea01-48df-9f04-f17543ae4005 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:23.668438 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5285777-41e6-420d-820b-2f7bc97179bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:23.669180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5285777-41e6-420d-820b-2f7bc97179bd admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:23.670027 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5285777-41e6-420d-820b-2f7bc97179bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:23.670311 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5285777-41e6-420d-820b-2f7bc97179bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:23.671285 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5285777-41e6-420d-820b-2f7bc97179bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:23.673130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5285777-41e6-420d-820b-2f7bc97179bd admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:23.704565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 828/1671] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:23.708834 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f48e9-3684-4f74-ac20-e020d69934e8 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:23.722748 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f48e9-3684-4f74-ac20-e020d69934e8 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:23.728313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df571522-6fdc-4df3-8aad-1f8f9b75c5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:23.729248 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df571522-6fdc-4df3-8aad-1f8f9b75c5cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:23.729544 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df571522-6fdc-4df3-8aad-1f8f9b75c5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:23.729806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df571522-6fdc-4df3-8aad-1f8f9b75c5cf admin admin] PATH_INFO: `/v3/projects/d0cc9c8cd5ea47e58e86c0fd4d59e8a4/users/41b06b3845984bf1928a32ce937793d7/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:23.748666 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df571522-6fdc-4df3-8aad-1f8f9b75c5cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0cc9c8cd5ea47e58e86c0fd4d59e8a4, user_id=41b06b3845984bf1928a32ce937793d7, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:23.751443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df571522-6fdc-4df3-8aad-1f8f9b75c5cf admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:23.773258 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 844/1672] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:23 2022] PUT /identity/v3/projects/d0cc9c8cd5ea47e58e86c0fd4d59e8a4/users/41b06b3845984bf1928a32ce937793d7/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:23.775017 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5285777-41e6-420d-820b-2f7bc97179bd admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:23.787540 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5285777-41e6-420d-820b-2f7bc97179bd admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:23.879762 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7567cd-e89f-48fd-8f03-e796b88e1456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:23.880623 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7567cd-e89f-48fd-8f03-e796b88e1456 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:23.880839 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7567cd-e89f-48fd-8f03-e796b88e1456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:23.881122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7567cd-e89f-48fd-8f03-e796b88e1456 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:23.881930 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7567cd-e89f-48fd-8f03-e796b88e1456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:23.884506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7567cd-e89f-48fd-8f03-e796b88e1456 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:23.914386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df571522-6fdc-4df3-8aad-1f8f9b75c5cf admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:23.928091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df571522-6fdc-4df3-8aad-1f8f9b75c5cf admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:23.928870 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 829/1673] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:23.937086 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2286a9a-46e7-481f-bb48-bd503df9de1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:23.939319 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2286a9a-46e7-481f-bb48-bd503df9de1f admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:23.939604 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2286a9a-46e7-481f-bb48-bd503df9de1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:23.939889 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2286a9a-46e7-481f-bb48-bd503df9de1f admin admin] PATH_INFO: `/v3/projects/d0cc9c8cd5ea47e58e86c0fd4d59e8a4/users/41b06b3845984bf1928a32ce937793d7/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:23.943009 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2286a9a-46e7-481f-bb48-bd503df9de1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0cc9c8cd5ea47e58e86c0fd4d59e8a4, user_id=41b06b3845984bf1928a32ce937793d7, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:23.958272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2286a9a-46e7-481f-bb48-bd503df9de1f admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:23.992476 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba470b-563f-4e2f-a831-130544753f9d None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:23.993368 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba470b-563f-4e2f-a831-130544753f9d None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:23.993659 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba470b-563f-4e2f-a831-130544753f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:23.995747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 845/1674] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:23 2022] PUT /identity/v3/projects/d0cc9c8cd5ea47e58e86c0fd4d59e8a4/users/41b06b3845984bf1928a32ce937793d7/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:24.038628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-bfba470b-563f-4e2f-a831-130544753f9d None None] MFA Rules not processed for user `41b06b3845984bf1928a32ce937793d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:24.041454 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-bfba470b-563f-4e2f-a831-130544753f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:24.175002 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 830/1675] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:24.193806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2286a9a-46e7-481f-bb48-bd503df9de1f admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:24.196932 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b2286a9a-46e7-481f-bb48-bd503df9de1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:24.210553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba470b-563f-4e2f-a831-130544753f9d None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:24.217103 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-bfba470b-563f-4e2f-a831-130544753f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:24.394007 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2286a9a-46e7-481f-bb48-bd503df9de1f admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:24.400356 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f96ab-ee4d-425d-adc1-79474819f1a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:24.401069 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f96ab-ee4d-425d-adc1-79474819f1a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:24.401347 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f96ab-ee4d-425d-adc1-79474819f1a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:24.401625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f96ab-ee4d-425d-adc1-79474819f1a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:24.415331 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f96ab-ee4d-425d-adc1-79474819f1a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:24.422544 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f96ab-ee4d-425d-adc1-79474819f1a1 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:24.440596 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 846/1676] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:24.475811 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba470b-563f-4e2f-a831-130544753f9d None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:24.530897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f3f09-83b3-4317-9bcc-2441bf914b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:24.532354 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f3f09-83b3-4317-9bcc-2441bf914b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:24.532354 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f3f09-83b3-4317-9bcc-2441bf914b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:24.532354 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f3f09-83b3-4317-9bcc-2441bf914b3e admin admin] PATH_INFO: `/v3/projects/b0b984e3fc6841f2bba7541a8047b786` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:24.545562 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f3f09-83b3-4317-9bcc-2441bf914b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0b984e3fc6841f2bba7541a8047b786)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:24.567734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f3f09-83b3-4317-9bcc-2441bf914b3e admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:24.684159 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705df21b-9edd-4b2e-9bcc-ad0ce99aaddd None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:24.684858 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705df21b-9edd-4b2e-9bcc-ad0ce99aaddd None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:24.684858 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705df21b-9edd-4b2e-9bcc-ad0ce99aaddd None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:24.686953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 847/1677] 10.222.0.60 () {54 vars in 960 bytes} [Fri May 6 23:33:24 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:33:24.698094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06505593-3b3f-478f-81ea-04ad6b192a3a None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:24.698415 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06505593-3b3f-478f-81ea-04ad6b192a3a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:24.698748 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06505593-3b3f-478f-81ea-04ad6b192a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:24.740702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-06505593-3b3f-478f-81ea-04ad6b192a3a None None] MFA Rules not processed for user `fb1f7704fb5644688b8764bb1ce15734`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:24.743205 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-06505593-3b3f-478f-81ea-04ad6b192a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:24.761128 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-fe7f3f09-83b3-4317-9bcc-2441bf914b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0b984e3fc6841f2bba7541a8047b786', 'request_id': 'req-fe7f3f09-83b3-4317-9bcc-2441bf914b3e'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:24.778011 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-fe7f3f09-83b3-4317-9bcc-2441bf914b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0b984e3fc6841f2bba7541a8047b786', 'request_id': 'req-fe7f3f09-83b3-4317-9bcc-2441bf914b3e'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:24.787465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-fe7f3f09-83b3-4317-9bcc-2441bf914b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0b984e3fc6841f2bba7541a8047b786', 'request_id': 'req-fe7f3f09-83b3-4317-9bcc-2441bf914b3e'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:24.820165 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-fe7f3f09-83b3-4317-9bcc-2441bf914b3e admin admin] The token cache is being invalidate because project b0b984e3fc6841f2bba7541a8047b786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:33:24.820566 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-fe7f3f09-83b3-4317-9bcc-2441bf914b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:24.821719 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-fe7f3f09-83b3-4317-9bcc-2441bf914b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:24.827372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 831/1678] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:33:24 2022] DELETE /identity/v3/projects/b0b984e3fc6841f2bba7541a8047b786 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:24.829120 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d518d-5ee6-403d-891a-18c62c153de2 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:24.829416 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d518d-5ee6-403d-891a-18c62c153de2 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:24.829697 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d518d-5ee6-403d-891a-18c62c153de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:24.854606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-383d518d-5ee6-403d-891a-18c62c153de2 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:24.856001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-383d518d-5ee6-403d-891a-18c62c153de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:24.891930 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 848/1679] 10.222.0.60 () {58 vars in 1057 bytes} [Fri May 6 23:33:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:33:24.900524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06505593-3b3f-478f-81ea-04ad6b192a3a None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:24.912063 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06505593-3b3f-478f-81ea-04ad6b192a3a None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:24.933246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0d461-ed71-4bda-a0b8-f4d804301af3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1f7704fb5644688b8764bb1ce15734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:24.934834 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0d461-ed71-4bda-a0b8-f4d804301af3 service placement] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:24.935411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0d461-ed71-4bda-a0b8-f4d804301af3 service placement] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:24.935828 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0d461-ed71-4bda-a0b8-f4d804301af3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:24.937700 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 832/1680] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:24.946716 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e07c1a-5241-4fa0-a8d1-48ede4ee474c None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:24.947109 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e07c1a-5241-4fa0-a8d1-48ede4ee474c None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:24.947395 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e07c1a-5241-4fa0-a8d1-48ede4ee474c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:24.949289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-95b0d461-ed71-4bda-a0b8-f4d804301af3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:24.970461 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0d461-ed71-4bda-a0b8-f4d804301af3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:24.970686 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-a0e07c1a-5241-4fa0-a8d1-48ede4ee474c None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:24.972169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-a0e07c1a-5241-4fa0-a8d1-48ede4ee474c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:24.974044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0d461-ed71-4bda-a0b8-f4d804301af3 service placement] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:25.004981 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 833/1681] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:25.007693 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e07c1a-5241-4fa0-a8d1-48ede4ee474c None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:25.016173 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 849/1682] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:33:25.021830 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e07c1a-5241-4fa0-a8d1-48ede4ee474c None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:25.028890 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6533a7-ef46-4000-9845-27d9ad3b7851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:25.029800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6533a7-ef46-4000-9845-27d9ad3b7851 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:25.030218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6533a7-ef46-4000-9845-27d9ad3b7851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:25.030739 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6533a7-ef46-4000-9845-27d9ad3b7851 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:25.031588 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6533a7-ef46-4000-9845-27d9ad3b7851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:33:25.032277 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6533a7-ef46-4000-9845-27d9ad3b7851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:25.034170 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6533a7-ef46-4000-9845-27d9ad3b7851 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:25.057711 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0d461-ed71-4bda-a0b8-f4d804301af3 service placement] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:25.059050 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 834/1683] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:33:25.082685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0d461-ed71-4bda-a0b8-f4d804301af3 service placement] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:25.100758 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28525590-4273-4081-ad58-d3148aa7d82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:25.101442 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28525590-4273-4081-ad58-d3148aa7d82c admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:25.101720 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28525590-4273-4081-ad58-d3148aa7d82c admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:25.103408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28525590-4273-4081-ad58-d3148aa7d82c admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:25.104153 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28525590-4273-4081-ad58-d3148aa7d82c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:25.115810 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28525590-4273-4081-ad58-d3148aa7d82c admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:25.189441 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 850/1684] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:25 2022] POST /identity/v3/projects => generated 365 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:33:25.193126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6533a7-ef46-4000-9845-27d9ad3b7851 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:25.208658 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6533a7-ef46-4000-9845-27d9ad3b7851 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:25.317323 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff7754-a10e-4314-b47d-eb051faabb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:25.318172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff7754-a10e-4314-b47d-eb051faabb1f admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:25.319174 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff7754-a10e-4314-b47d-eb051faabb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:25.319590 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff7754-a10e-4314-b47d-eb051faabb1f admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:25.320407 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff7754-a10e-4314-b47d-eb051faabb1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:25.322982 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff7754-a10e-4314-b47d-eb051faabb1f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:25.369061 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 835/1685] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:25 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:25.373839 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28525590-4273-4081-ad58-d3148aa7d82c admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:25.393566 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28525590-4273-4081-ad58-d3148aa7d82c admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:25.403219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117ec35-c59b-4913-850f-9508afe0f0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:25.404015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117ec35-c59b-4913-850f-9508afe0f0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:25.411606 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117ec35-c59b-4913-850f-9508afe0f0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:25.412074 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117ec35-c59b-4913-850f-9508afe0f0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:25.413006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117ec35-c59b-4913-850f-9508afe0f0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:25.415324 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117ec35-c59b-4913-850f-9508afe0f0b8 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:25.441455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 851/1686] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:25.445117 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff7754-a10e-4314-b47d-eb051faabb1f admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:25.464644 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff7754-a10e-4314-b47d-eb051faabb1f admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:25.470744 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e2dfb-b597-4cf4-a233-e983ed719492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:25.476813 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e2dfb-b597-4cf4-a233-e983ed719492 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:25.483009 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e2dfb-b597-4cf4-a233-e983ed719492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:25.483280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e2dfb-b597-4cf4-a233-e983ed719492 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:25.484239 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e2dfb-b597-4cf4-a233-e983ed719492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:25.492730 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e2dfb-b597-4cf4-a233-e983ed719492 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:25.529080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 836/1687] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:25.533963 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117ec35-c59b-4913-850f-9508afe0f0b8 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:25.549535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117ec35-c59b-4913-850f-9508afe0f0b8 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:25.565652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65e058-7ab8-4cc2-ba52-1f6bdcc3ae09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:25.567819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65e058-7ab8-4cc2-ba52-1f6bdcc3ae09 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:25.568236 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65e058-7ab8-4cc2-ba52-1f6bdcc3ae09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:25.569093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65e058-7ab8-4cc2-ba52-1f6bdcc3ae09 admin admin] PATH_INFO: `/v3/projects/f3ca5941316f447092d6e87bfd154640/users/545ec228a8ed40da8c9e7f8268b13c22/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:25.601752 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65e058-7ab8-4cc2-ba52-1f6bdcc3ae09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ca5941316f447092d6e87bfd154640, user_id=545ec228a8ed40da8c9e7f8268b13c22, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:25.606323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65e058-7ab8-4cc2-ba52-1f6bdcc3ae09 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:25.656346 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 852/1688] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:25 2022] PUT /identity/v3/projects/f3ca5941316f447092d6e87bfd154640/users/545ec228a8ed40da8c9e7f8268b13c22/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:25.658768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852cbe4-cf4c-4f05-8463-00816124fdf4 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:25.661136 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852cbe4-cf4c-4f05-8463-00816124fdf4 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:25.661611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852cbe4-cf4c-4f05-8463-00816124fdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:25.741564 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-b852cbe4-cf4c-4f05-8463-00816124fdf4 None None] MFA Rules not processed for user `545ec228a8ed40da8c9e7f8268b13c22`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:25.743027 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-b852cbe4-cf4c-4f05-8463-00816124fdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:25.944745 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 837/1689] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:25.949013 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65e058-7ab8-4cc2-ba52-1f6bdcc3ae09 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:26.086460 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65e058-7ab8-4cc2-ba52-1f6bdcc3ae09 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:26.105235 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022513bf-deb5-4689-844d-4bab8f9b913c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:26.106861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022513bf-deb5-4689-844d-4bab8f9b913c admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:26.108318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022513bf-deb5-4689-844d-4bab8f9b913c admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:26.109039 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022513bf-deb5-4689-844d-4bab8f9b913c admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:26.110241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022513bf-deb5-4689-844d-4bab8f9b913c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:26.114937 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022513bf-deb5-4689-844d-4bab8f9b913c admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:26.201039 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 853/1690] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:25 2022] POST /identity/v3/projects => generated 365 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:26.204893 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852cbe4-cf4c-4f05-8463-00816124fdf4 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:26.208150 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022513bf-deb5-4689-844d-4bab8f9b913c admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:26.215393 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-022513bf-deb5-4689-844d-4bab8f9b913c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:26.230372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852cbe4-cf4c-4f05-8463-00816124fdf4 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:26.413071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022513bf-deb5-4689-844d-4bab8f9b913c admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:26.424463 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a328a-223e-4338-86f9-fbf93819cb96 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b06b3845984bf1928a32ce937793d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0cc9c8cd5ea47e58e86c0fd4d59e8a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:26.425273 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a328a-223e-4338-86f9-fbf93819cb96 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:26.425565 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a328a-223e-4338-86f9-fbf93819cb96 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:26.426657 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a328a-223e-4338-86f9-fbf93819cb96 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:26.426657 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a328a-223e-4338-86f9-fbf93819cb96 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:33:26.426895 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a328a-223e-4338-86f9-fbf93819cb96 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:26.441302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a328a-223e-4338-86f9-fbf93819cb96 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:26.465213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a49e1-8785-4c78-83c8-1aca4aaacdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:26.466675 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a49e1-8785-4c78-83c8-1aca4aaacdb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:26.467309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a49e1-8785-4c78-83c8-1aca4aaacdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:26.467309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a49e1-8785-4c78-83c8-1aca4aaacdb1 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:26.467840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a49e1-8785-4c78-83c8-1aca4aaacdb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:26.470039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a49e1-8785-4c78-83c8-1aca4aaacdb1 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:26.484695 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 854/1691] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:33:26.488420 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a328a-223e-4338-86f9-fbf93819cb96 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:26.505916 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 838/1692] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:26 2022] POST /identity/v3/users => generated 289 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:33:26.510102 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a49e1-8785-4c78-83c8-1aca4aaacdb1 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:26.523278 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a328a-223e-4338-86f9-fbf93819cb96 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:26.530931 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a49e1-8785-4c78-83c8-1aca4aaacdb1 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:26.544991 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94493ef-c866-4cd6-b5ee-e17683c094a2 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b06b3845984bf1928a32ce937793d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0cc9c8cd5ea47e58e86c0fd4d59e8a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:26.545678 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94493ef-c866-4cd6-b5ee-e17683c094a2 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:26.545968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94493ef-c866-4cd6-b5ee-e17683c094a2 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:26.546253 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94493ef-c866-4cd6-b5ee-e17683c094a2 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:26.546970 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94493ef-c866-4cd6-b5ee-e17683c094a2 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:26.547888 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84752bba-6761-4cff-9cc4-ab4005f37f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:26.548812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84752bba-6761-4cff-9cc4-ab4005f37f38 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:26.548924 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94493ef-c866-4cd6-b5ee-e17683c094a2 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:26.549420 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84752bba-6761-4cff-9cc4-ab4005f37f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:26.549884 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84752bba-6761-4cff-9cc4-ab4005f37f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:26.550804 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84752bba-6761-4cff-9cc4-ab4005f37f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:26.554657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84752bba-6761-4cff-9cc4-ab4005f37f38 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:26.582550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 839/1693] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:26.586886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84752bba-6761-4cff-9cc4-ab4005f37f38 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:26.606813 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84752bba-6761-4cff-9cc4-ab4005f37f38 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:26.627349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a02af2-ab35-4440-a41b-a3987d6014bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:26.630559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a02af2-ab35-4440-a41b-a3987d6014bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:26.632904 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a02af2-ab35-4440-a41b-a3987d6014bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:26.633925 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a02af2-ab35-4440-a41b-a3987d6014bb admin admin] PATH_INFO: `/v3/projects/2d138594bb5d4334aa1fc67e587d3ee5/users/e25140cff7f948cf88884bb25a1891c7/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:26.645027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 855/1694] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:26 2022] POST /identity/v3/projects => generated 355 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:26.653970 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94493ef-c866-4cd6-b5ee-e17683c094a2 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:26.688632 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a02af2-ab35-4440-a41b-a3987d6014bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d138594bb5d4334aa1fc67e587d3ee5, user_id=e25140cff7f948cf88884bb25a1891c7, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:26.695267 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a02af2-ab35-4440-a41b-a3987d6014bb admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:26.721675 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 840/1695] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:26 2022] PUT /identity/v3/projects/2d138594bb5d4334aa1fc67e587d3ee5/users/e25140cff7f948cf88884bb25a1891c7/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:26.726461 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a02af2-ab35-4440-a41b-a3987d6014bb admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:26.887492 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94493ef-c866-4cd6-b5ee-e17683c094a2 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:26.921202 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a02af2-ab35-4440-a41b-a3987d6014bb admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:26.935636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53fdb6-02cc-490a-a570-81b2fc3bb598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:26.936921 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53fdb6-02cc-490a-a570-81b2fc3bb598 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:26.937402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53fdb6-02cc-490a-a570-81b2fc3bb598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:26.937867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53fdb6-02cc-490a-a570-81b2fc3bb598 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:26.940220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53fdb6-02cc-490a-a570-81b2fc3bb598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:26.944080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53fdb6-02cc-490a-a570-81b2fc3bb598 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:26.970477 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 841/1696] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:33:26.974560 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53fdb6-02cc-490a-a570-81b2fc3bb598 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:26.996007 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53fdb6-02cc-490a-a570-81b2fc3bb598 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:27.010815 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa14b46-4c3a-41e5-96ae-e616fe525f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:27.011784 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa14b46-4c3a-41e5-96ae-e616fe525f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:27.012060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa14b46-4c3a-41e5-96ae-e616fe525f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:27.013494 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa14b46-4c3a-41e5-96ae-e616fe525f05 admin admin] PATH_INFO: `/v3/projects/2d138594bb5d4334aa1fc67e587d3ee5/users/e25140cff7f948cf88884bb25a1891c7/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:27.017886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa14b46-4c3a-41e5-96ae-e616fe525f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d138594bb5d4334aa1fc67e587d3ee5, user_id=e25140cff7f948cf88884bb25a1891c7, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:27.027908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa14b46-4c3a-41e5-96ae-e616fe525f05 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:27.047038 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224aa67-82df-455d-8820-801da075c0e5 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b06b3845984bf1928a32ce937793d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0cc9c8cd5ea47e58e86c0fd4d59e8a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:27.047767 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224aa67-82df-455d-8820-801da075c0e5 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:27.048252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224aa67-82df-455d-8820-801da075c0e5 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:27.048555 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224aa67-82df-455d-8820-801da075c0e5 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:27.049311 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224aa67-82df-455d-8820-801da075c0e5 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:33:27.050613 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224aa67-82df-455d-8820-801da075c0e5 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:27.051930 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224aa67-82df-455d-8820-801da075c0e5 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:27.054471 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 842/1697] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:26 2022] PUT /identity/v3/projects/2d138594bb5d4334aa1fc67e587d3ee5/users/e25140cff7f948cf88884bb25a1891c7/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:27.068361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13996d-4a5a-450a-9ced-99db45a53729 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:27.068755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13996d-4a5a-450a-9ced-99db45a53729 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:27.068957 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13996d-4a5a-450a-9ced-99db45a53729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:27.095240 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 856/1698] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:33:27.122965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-9b13996d-4a5a-450a-9ced-99db45a53729 None None] MFA Rules not processed for user `e25140cff7f948cf88884bb25a1891c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:27.124660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9b13996d-4a5a-450a-9ced-99db45a53729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:27.165345 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224aa67-82df-455d-8820-801da075c0e5 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:27.185647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224aa67-82df-455d-8820-801da075c0e5 tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:27.286738 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71ccc9-f253-445e-aea1-e24674a3cd3b tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b06b3845984bf1928a32ce937793d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0cc9c8cd5ea47e58e86c0fd4d59e8a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:27.287619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71ccc9-f253-445e-aea1-e24674a3cd3b tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:27.287904 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71ccc9-f253-445e-aea1-e24674a3cd3b tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:27.288178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71ccc9-f253-445e-aea1-e24674a3cd3b tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] PATH_INFO: `/v3/projects/a4843e4a595e41abaeefd8cb842a8a6c` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:27.290012 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71ccc9-f253-445e-aea1-e24674a3cd3b tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a4843e4a595e41abaeefd8cb842a8a6c)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:27.291964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71ccc9-f253-445e-aea1-e24674a3cd3b tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:27.338682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 843/1699] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:27.357805 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13996d-4a5a-450a-9ced-99db45a53729 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:27.359309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9b13996d-4a5a-450a-9ced-99db45a53729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:27.377149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-0e71ccc9-f253-445e-aea1-e24674a3cd3b tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4843e4a595e41abaeefd8cb842a8a6c', 'request_id': 'req-0e71ccc9-f253-445e-aea1-e24674a3cd3b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:27.391953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-0e71ccc9-f253-445e-aea1-e24674a3cd3b tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4843e4a595e41abaeefd8cb842a8a6c', 'request_id': 'req-0e71ccc9-f253-445e-aea1-e24674a3cd3b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:27.404869 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-0e71ccc9-f253-445e-aea1-e24674a3cd3b tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4843e4a595e41abaeefd8cb842a8a6c', 'request_id': 'req-0e71ccc9-f253-445e-aea1-e24674a3cd3b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:27.433692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-0e71ccc9-f253-445e-aea1-e24674a3cd3b tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] The token cache is being invalidate because project a4843e4a595e41abaeefd8cb842a8a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:33:27.434209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-0e71ccc9-f253-445e-aea1-e24674a3cd3b tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:27.435151 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-0e71ccc9-f253-445e-aea1-e24674a3cd3b tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:27.442443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 857/1700] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:33:27 2022] DELETE /identity/v3/projects/a4843e4a595e41abaeefd8cb842a8a6c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:33:27.486579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13996d-4a5a-450a-9ced-99db45a53729 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:27.650091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f66bd-df7e-49fe-8d82-57f88084fdd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:27.650855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f66bd-df7e-49fe-8d82-57f88084fdd2 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:27.651244 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f66bd-df7e-49fe-8d82-57f88084fdd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:27.651625 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f66bd-df7e-49fe-8d82-57f88084fdd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:27.653967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-472f66bd-df7e-49fe-8d82-57f88084fdd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:27.766777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f66bd-df7e-49fe-8d82-57f88084fdd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:27.771956 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f66bd-df7e-49fe-8d82-57f88084fdd2 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:27.804710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 844/1701] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:33:27.896481 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71ccc9-f253-445e-aea1-e24674a3cd3b tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:27.899024 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-0e71ccc9-f253-445e-aea1-e24674a3cd3b tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:27.923314 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f66bd-df7e-49fe-8d82-57f88084fdd2 service cinder] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:27.925038 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-472f66bd-df7e-49fe-8d82-57f88084fdd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:27.938516 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f66bd-df7e-49fe-8d82-57f88084fdd2 service cinder] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:27.956553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555c978-e91f-4f4f-ac89-4d7846466e08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:27.957571 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555c978-e91f-4f4f-ac89-4d7846466e08 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:27.959034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555c978-e91f-4f4f-ac89-4d7846466e08 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:27.960285 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555c978-e91f-4f4f-ac89-4d7846466e08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:27.967073 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c555c978-e91f-4f4f-ac89-4d7846466e08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:28.041347 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71ccc9-f253-445e-aea1-e24674a3cd3b tempest-VolumeQuotaClassesTest-1801114692 tempest-VolumeQuotaClassesTest-1801114692-project-admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:28.057796 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66f99a-2cfa-45a4-a545-38efd7fb20c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:28.058700 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66f99a-2cfa-45a4-a545-38efd7fb20c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:28.058987 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66f99a-2cfa-45a4-a545-38efd7fb20c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:28.059282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66f99a-2cfa-45a4-a545-38efd7fb20c6 admin admin] PATH_INFO: `/v3/users/ca0693b7f0fe432bbbd5b0137d262901` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:28.061293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66f99a-2cfa-45a4-a545-38efd7fb20c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca0693b7f0fe432bbbd5b0137d262901)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:28.063272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66f99a-2cfa-45a4-a545-38efd7fb20c6 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:28.144786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555c978-e91f-4f4f-ac89-4d7846466e08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:28.164685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dd66f99a-2cfa-45a4-a545-38efd7fb20c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca0693b7f0fe432bbbd5b0137d262901'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:28.167182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555c978-e91f-4f4f-ac89-4d7846466e08 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:28.173881 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dd66f99a-2cfa-45a4-a545-38efd7fb20c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca0693b7f0fe432bbbd5b0137d262901'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:28.175017 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dd66f99a-2cfa-45a4-a545-38efd7fb20c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca0693b7f0fe432bbbd5b0137d262901'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:28.187467 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dd66f99a-2cfa-45a4-a545-38efd7fb20c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca0693b7f0fe432bbbd5b0137d262901'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:28.188518 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dd66f99a-2cfa-45a4-a545-38efd7fb20c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca0693b7f0fe432bbbd5b0137d262901'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:28.218323 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 845/1702] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:27 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:33:28.229284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 858/1703] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:33:27 2022] DELETE /identity/v3/users/ca0693b7f0fe432bbbd5b0137d262901 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:28.230850 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7810f-11c2-44c6-b34b-7355b443543f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:28.231347 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7810f-11c2-44c6-b34b-7355b443543f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:28.231955 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7810f-11c2-44c6-b34b-7355b443543f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:28.286621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-57f7810f-11c2-44c6-b34b-7355b443543f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:28.292791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-57f7810f-11c2-44c6-b34b-7355b443543f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:28.460117 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 846/1704] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:33:28.516909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66f99a-2cfa-45a4-a545-38efd7fb20c6 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:28.519200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-dd66f99a-2cfa-45a4-a545-38efd7fb20c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:28.586968 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7810f-11c2-44c6-b34b-7355b443543f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:28.593021 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-57f7810f-11c2-44c6-b34b-7355b443543f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:28.615973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7810f-11c2-44c6-b34b-7355b443543f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:28.627685 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0591e93-b8c2-40a1-a2be-89080b80188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:28.629326 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0591e93-b8c2-40a1-a2be-89080b80188c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:28.629537 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0591e93-b8c2-40a1-a2be-89080b80188c admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:28.629769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0591e93-b8c2-40a1-a2be-89080b80188c admin admin] PATH_INFO: `/v3/users/3d0061102b0048b7a509812bb447caf9` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:28.632072 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0591e93-b8c2-40a1-a2be-89080b80188c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d0061102b0048b7a509812bb447caf9)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:28.638494 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0591e93-b8c2-40a1-a2be-89080b80188c admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:28.707174 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66f99a-2cfa-45a4-a545-38efd7fb20c6 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:28.716157 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2751b-be3f-454b-aef9-83b8fdd7835d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:28.716891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2751b-be3f-454b-aef9-83b8fdd7835d service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:28.717301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2751b-be3f-454b-aef9-83b8fdd7835d service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:28.718737 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2751b-be3f-454b-aef9-83b8fdd7835d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:28.745241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2751b-be3f-454b-aef9-83b8fdd7835d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:28.746345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-e0591e93-b8c2-40a1-a2be-89080b80188c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d0061102b0048b7a509812bb447caf9'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:28.748921 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2751b-be3f-454b-aef9-83b8fdd7835d service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:28.764114 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-e0591e93-b8c2-40a1-a2be-89080b80188c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d0061102b0048b7a509812bb447caf9'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:28.779527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 859/1705] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:28.781091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9942f22-3813-41e9-a25a-e3a7a35407f3 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:28.781434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9942f22-3813-41e9-a25a-e3a7a35407f3 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:28.781722 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9942f22-3813-41e9-a25a-e3a7a35407f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:28.786152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-e0591e93-b8c2-40a1-a2be-89080b80188c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d0061102b0048b7a509812bb447caf9'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:28.787156 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-e0591e93-b8c2-40a1-a2be-89080b80188c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d0061102b0048b7a509812bb447caf9'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:28.788501 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-e0591e93-b8c2-40a1-a2be-89080b80188c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d0061102b0048b7a509812bb447caf9'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:28.811087 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-a9942f22-3813-41e9-a25a-e3a7a35407f3 None None] MFA Rules not processed for user `d211582f9fc34b0e815e27db081c50c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:28.812521 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-a9942f22-3813-41e9-a25a-e3a7a35407f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:28.850106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 847/1706] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:33:28 2022] DELETE /identity/v3/users/3d0061102b0048b7a509812bb447caf9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:28.935335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 860/1707] 10.222.0.60 () {58 vars in 1009 bytes} [Fri May 6 23:33:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:29.130187 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0591e93-b8c2-40a1-a2be-89080b80188c admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:29.131773 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e0591e93-b8c2-40a1-a2be-89080b80188c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:29.296781 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0591e93-b8c2-40a1-a2be-89080b80188c admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:29.310455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cde7b-f5cd-4bde-9c6e-b16cc1abf922 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b3ec57aee94b87889d578e114fa0db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:29.311310 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cde7b-f5cd-4bde-9c6e-b16cc1abf922 service swift] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:29.311426 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cde7b-f5cd-4bde-9c6e-b16cc1abf922 service swift] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:29.311806 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cde7b-f5cd-4bde-9c6e-b16cc1abf922 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:29.485637 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cde7b-f5cd-4bde-9c6e-b16cc1abf922 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:29.487653 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cde7b-f5cd-4bde-9c6e-b16cc1abf922 service swift] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:29.502543 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 848/1708] 10.222.0.60 () {60 vars in 1384 bytes} [Fri May 6 23:33:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 06 23:33:29.603595 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9942f22-3813-41e9-a25a-e3a7a35407f3 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:29.608577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-a9942f22-3813-41e9-a25a-e3a7a35407f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:29.658897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9942f22-3813-41e9-a25a-e3a7a35407f3 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:29.886652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09dc81-7268-4344-b1fa-3236265f72f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:29.891351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09dc81-7268-4344-b1fa-3236265f72f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:29.893457 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09dc81-7268-4344-b1fa-3236265f72f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:29.896559 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09dc81-7268-4344-b1fa-3236265f72f3 admin admin] PATH_INFO: `/v3/projects/c0de4aa69b36411d9a1790e4b6ad5add` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:29.900002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09dc81-7268-4344-b1fa-3236265f72f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0de4aa69b36411d9a1790e4b6ad5add)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:29.908454 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09dc81-7268-4344-b1fa-3236265f72f3 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:30.098352 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-1a09dc81-7268-4344-b1fa-3236265f72f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0de4aa69b36411d9a1790e4b6ad5add', 'request_id': 'req-1a09dc81-7268-4344-b1fa-3236265f72f3'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:30.125818 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-1a09dc81-7268-4344-b1fa-3236265f72f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0de4aa69b36411d9a1790e4b6ad5add', 'request_id': 'req-1a09dc81-7268-4344-b1fa-3236265f72f3'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:30.157174 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-1a09dc81-7268-4344-b1fa-3236265f72f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0de4aa69b36411d9a1790e4b6ad5add', 'request_id': 'req-1a09dc81-7268-4344-b1fa-3236265f72f3'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:30.206014 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-1a09dc81-7268-4344-b1fa-3236265f72f3 admin admin] The token cache is being invalidate because project c0de4aa69b36411d9a1790e4b6ad5add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:33:30.206312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-1a09dc81-7268-4344-b1fa-3236265f72f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:30.207034 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-1a09dc81-7268-4344-b1fa-3236265f72f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:30.208738 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 861/1709] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:33:29 2022] DELETE /identity/v3/projects/c0de4aa69b36411d9a1790e4b6ad5add => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:30.213035 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cde7b-f5cd-4bde-9c6e-b16cc1abf922 service swift] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:30.224514 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cde7b-f5cd-4bde-9c6e-b16cc1abf922 service swift] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:30.423471 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68e3ec-cee7-421a-b9ba-1b616dc9507f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:30.424359 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68e3ec-cee7-421a-b9ba-1b616dc9507f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:30.424792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68e3ec-cee7-421a-b9ba-1b616dc9507f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:30.425076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68e3ec-cee7-421a-b9ba-1b616dc9507f admin admin] PATH_INFO: `/v3/users/be0bebd7a2b440c0953fbd216cbc8702` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:30.426574 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68e3ec-cee7-421a-b9ba-1b616dc9507f admin admin] RBAC: Authorizing `identity:delete_user(user_id=be0bebd7a2b440c0953fbd216cbc8702)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:30.428716 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68e3ec-cee7-421a-b9ba-1b616dc9507f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:30.579816 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-eb68e3ec-cee7-421a-b9ba-1b616dc9507f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be0bebd7a2b440c0953fbd216cbc8702'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:30.636664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-eb68e3ec-cee7-421a-b9ba-1b616dc9507f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be0bebd7a2b440c0953fbd216cbc8702'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:30.668006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-eb68e3ec-cee7-421a-b9ba-1b616dc9507f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be0bebd7a2b440c0953fbd216cbc8702'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:30.669828 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-eb68e3ec-cee7-421a-b9ba-1b616dc9507f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be0bebd7a2b440c0953fbd216cbc8702'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:30.675345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-eb68e3ec-cee7-421a-b9ba-1b616dc9507f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be0bebd7a2b440c0953fbd216cbc8702'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:30.790638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 849/1710] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:33:30 2022] DELETE /identity/v3/users/be0bebd7a2b440c0953fbd216cbc8702 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:33.208838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09dc81-7268-4344-b1fa-3236265f72f3 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:33.213885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-1a09dc81-7268-4344-b1fa-3236265f72f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:33.239519 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09dc81-7268-4344-b1fa-3236265f72f3 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:33.382134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a67fdc-c0af-4102-a049-3070e0f3390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:33.384164 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a67fdc-c0af-4102-a049-3070e0f3390e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:33.384675 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a67fdc-c0af-4102-a049-3070e0f3390e admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:33.385235 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a67fdc-c0af-4102-a049-3070e0f3390e admin admin] PATH_INFO: `/v3/projects/0eaf08d808dd49dab5a8842266db82d5` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:33.386812 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a67fdc-c0af-4102-a049-3070e0f3390e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eaf08d808dd49dab5a8842266db82d5)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:33.392422 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a67fdc-c0af-4102-a049-3070e0f3390e admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:33.545813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-83a67fdc-c0af-4102-a049-3070e0f3390e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eaf08d808dd49dab5a8842266db82d5', 'request_id': 'req-83a67fdc-c0af-4102-a049-3070e0f3390e'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:33.560829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-83a67fdc-c0af-4102-a049-3070e0f3390e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eaf08d808dd49dab5a8842266db82d5', 'request_id': 'req-83a67fdc-c0af-4102-a049-3070e0f3390e'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:33.581753 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-83a67fdc-c0af-4102-a049-3070e0f3390e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eaf08d808dd49dab5a8842266db82d5', 'request_id': 'req-83a67fdc-c0af-4102-a049-3070e0f3390e'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:33.618739 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-83a67fdc-c0af-4102-a049-3070e0f3390e admin admin] The token cache is being invalidate because project 0eaf08d808dd49dab5a8842266db82d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:33:33.621181 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-83a67fdc-c0af-4102-a049-3070e0f3390e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:33.623966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-83a67fdc-c0af-4102-a049-3070e0f3390e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:33.640058 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 862/1711] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:33:33 2022] DELETE /identity/v3/projects/0eaf08d808dd49dab5a8842266db82d5 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:33.641910 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cc5b0-544f-4a94-9a78-3d94de628fad None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:33.642392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cc5b0-544f-4a94-9a78-3d94de628fad None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:33.642482 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cc5b0-544f-4a94-9a78-3d94de628fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:33.730323 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-f06cc5b0-544f-4a94-9a78-3d94de628fad None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:33.731789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f06cc5b0-544f-4a94-9a78-3d94de628fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:33.982956 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 850/1712] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:33.984811 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c4db7-41bc-46dc-acc8-f895ff5bc05b None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:33.985100 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c4db7-41bc-46dc-acc8-f895ff5bc05b None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:33.985477 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c4db7-41bc-46dc-acc8-f895ff5bc05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:34.065863 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-6e2c4db7-41bc-46dc-acc8-f895ff5bc05b None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:34.067382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-6e2c4db7-41bc-46dc-acc8-f895ff5bc05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:34.117645 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cc5b0-544f-4a94-9a78-3d94de628fad None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:34.124488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 863/1713] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:34.132481 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cc5b0-544f-4a94-9a78-3d94de628fad None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:34.145988 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c40331-6be4-4d63-998a-7046f925ae9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:34.146785 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c40331-6be4-4d63-998a-7046f925ae9d admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:34.147167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c40331-6be4-4d63-998a-7046f925ae9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:34.147528 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c40331-6be4-4d63-998a-7046f925ae9d admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:34.149104 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c40331-6be4-4d63-998a-7046f925ae9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:33:34.149462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c40331-6be4-4d63-998a-7046f925ae9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:34.151118 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c40331-6be4-4d63-998a-7046f925ae9d admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:34.192719 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 851/1714] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:33:34.194324 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c4db7-41bc-46dc-acc8-f895ff5bc05b None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:34.214657 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c4db7-41bc-46dc-acc8-f895ff5bc05b None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:34.235916 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ecc29-47ba-44e3-ac15-6f8d161e2012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:34.236630 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ecc29-47ba-44e3-ac15-6f8d161e2012 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:34.236912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ecc29-47ba-44e3-ac15-6f8d161e2012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:34.237186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ecc29-47ba-44e3-ac15-6f8d161e2012 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:34.238553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ecc29-47ba-44e3-ac15-6f8d161e2012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:34.240862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ecc29-47ba-44e3-ac15-6f8d161e2012 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:34.351232 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 864/1715] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:34 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:34.355815 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c40331-6be4-4d63-998a-7046f925ae9d admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:34.371012 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c40331-6be4-4d63-998a-7046f925ae9d admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:34.610056 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c48527-84c2-458f-a1e0-1a65a2494bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:34.610710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c48527-84c2-458f-a1e0-1a65a2494bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:34.610829 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c48527-84c2-458f-a1e0-1a65a2494bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:34.611446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c48527-84c2-458f-a1e0-1a65a2494bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:34.623312 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c48527-84c2-458f-a1e0-1a65a2494bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:34.625471 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c48527-84c2-458f-a1e0-1a65a2494bc7 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:34.698473 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 852/1716] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:34 2022] POST /identity/v3/users => generated 291 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:34.702879 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ecc29-47ba-44e3-ac15-6f8d161e2012 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:34.721152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ecc29-47ba-44e3-ac15-6f8d161e2012 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:34.752627 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5929b0-acbd-491d-af22-5875ee578691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:34.753323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5929b0-acbd-491d-af22-5875ee578691 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:34.753615 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5929b0-acbd-491d-af22-5875ee578691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:34.753870 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5929b0-acbd-491d-af22-5875ee578691 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:34.756020 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5929b0-acbd-491d-af22-5875ee578691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:34.762744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5929b0-acbd-491d-af22-5875ee578691 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:34.783204 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c48527-84c2-458f-a1e0-1a65a2494bc7 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:34.786775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-70c48527-84c2-458f-a1e0-1a65a2494bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:34.847722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c48527-84c2-458f-a1e0-1a65a2494bc7 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:34.856633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 865/1717] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:34.857693 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5929b0-acbd-491d-af22-5875ee578691 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:34.883438 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ea468-395b-4ffa-931c-9d6040fd19ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:34.884685 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ea468-395b-4ffa-931c-9d6040fd19ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:34.889196 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ea468-395b-4ffa-931c-9d6040fd19ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:34.890994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ea468-395b-4ffa-931c-9d6040fd19ce admin admin] PATH_INFO: `/v3/projects/98f163a1f9c14cd8a6e5cd5c95911ed0` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:34.899810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ea468-395b-4ffa-931c-9d6040fd19ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=98f163a1f9c14cd8a6e5cd5c95911ed0)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:34.908924 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5929b0-acbd-491d-af22-5875ee578691 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:34.909568 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ea468-395b-4ffa-931c-9d6040fd19ce admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:34.928847 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a5ae5-7130-4e06-a814-73b0647cf4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:34.929709 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a5ae5-7130-4e06-a814-73b0647cf4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:34.930441 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a5ae5-7130-4e06-a814-73b0647cf4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:34.930953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a5ae5-7130-4e06-a814-73b0647cf4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:34.935436 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a5ae5-7130-4e06-a814-73b0647cf4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:34.950910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a5ae5-7130-4e06-a814-73b0647cf4b3 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:35.017134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 866/1718] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:35.019294 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db5cf5-5f16-4752-abf5-9649ed09cc23 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:35.023049 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db5cf5-5f16-4752-abf5-9649ed09cc23 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:35.025158 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db5cf5-5f16-4752-abf5-9649ed09cc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:35.132246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-c2db5cf5-5f16-4752-abf5-9649ed09cc23 None None] MFA Rules not processed for user `dd4e3bdb8957489b95d48c6f9bd91ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:35.134008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c2db5cf5-5f16-4752-abf5-9649ed09cc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:35.341709 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 867/1719] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:35.342647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db5cf5-5f16-4752-abf5-9649ed09cc23 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:35.367926 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db5cf5-5f16-4752-abf5-9649ed09cc23 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:35.391741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144777a-b641-48ce-b49e-7ef1fe5a035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:35.392788 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144777a-b641-48ce-b49e-7ef1fe5a035b admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:35.393081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144777a-b641-48ce-b49e-7ef1fe5a035b admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:35.393335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144777a-b641-48ce-b49e-7ef1fe5a035b admin admin] PATH_INFO: `/v3/projects/b27108060fff400ab8187e8df7b1a206/users/d443d36f4c514b1ab161fd440e01db69/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:35.442813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144777a-b641-48ce-b49e-7ef1fe5a035b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27108060fff400ab8187e8df7b1a206, user_id=d443d36f4c514b1ab161fd440e01db69, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:35.446377 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144777a-b641-48ce-b49e-7ef1fe5a035b admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:35.473414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a25ea468-395b-4ffa-931c-9d6040fd19ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98f163a1f9c14cd8a6e5cd5c95911ed0', 'request_id': 'req-a25ea468-395b-4ffa-931c-9d6040fd19ce'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:35.491010 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a25ea468-395b-4ffa-931c-9d6040fd19ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98f163a1f9c14cd8a6e5cd5c95911ed0', 'request_id': 'req-a25ea468-395b-4ffa-931c-9d6040fd19ce'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:35.503337 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 868/1720] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:35 2022] PUT /identity/v3/projects/b27108060fff400ab8187e8df7b1a206/users/d443d36f4c514b1ab161fd440e01db69/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:35.504238 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144777a-b641-48ce-b49e-7ef1fe5a035b admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:35.516873 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-2144777a-b641-48ce-b49e-7ef1fe5a035b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:35.522580 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a25ea468-395b-4ffa-931c-9d6040fd19ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98f163a1f9c14cd8a6e5cd5c95911ed0', 'request_id': 'req-a25ea468-395b-4ffa-931c-9d6040fd19ce'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:35.553459 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a25ea468-395b-4ffa-931c-9d6040fd19ce admin admin] The token cache is being invalidate because project 98f163a1f9c14cd8a6e5cd5c95911ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:33:35.553732 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a25ea468-395b-4ffa-931c-9d6040fd19ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:35.559277 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a25ea468-395b-4ffa-931c-9d6040fd19ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:35.566288 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 853/1721] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:33:34 2022] DELETE /identity/v3/projects/98f163a1f9c14cd8a6e5cd5c95911ed0 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:33:35.566288 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406535f4-02eb-4770-b6b8-629e18d7cf42 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:35.566288 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406535f4-02eb-4770-b6b8-629e18d7cf42 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:35.566288 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406535f4-02eb-4770-b6b8-629e18d7cf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:35.650010 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-406535f4-02eb-4770-b6b8-629e18d7cf42 None None] MFA Rules not processed for user `d443d36f4c514b1ab161fd440e01db69`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:35.651609 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-406535f4-02eb-4770-b6b8-629e18d7cf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:35.694818 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144777a-b641-48ce-b49e-7ef1fe5a035b admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:35.704467 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea3312-fc49-4eba-b21a-cc15957358bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:35.705474 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea3312-fc49-4eba-b21a-cc15957358bf service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:35.706955 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea3312-fc49-4eba-b21a-cc15957358bf service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:35.707392 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea3312-fc49-4eba-b21a-cc15957358bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:35.709519 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-05ea3312-fc49-4eba-b21a-cc15957358bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:35.813815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea3312-fc49-4eba-b21a-cc15957358bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:35.816144 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea3312-fc49-4eba-b21a-cc15957358bf service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:35.829807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 854/1722] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:35.831464 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406535f4-02eb-4770-b6b8-629e18d7cf42 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:35.833051 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-406535f4-02eb-4770-b6b8-629e18d7cf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:35.851974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 869/1723] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:35.853096 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea3312-fc49-4eba-b21a-cc15957358bf service nova] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:35.854643 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-05ea3312-fc49-4eba-b21a-cc15957358bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:35.941848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea3312-fc49-4eba-b21a-cc15957358bf service nova] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:35.948462 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723119e1-faa0-4b4e-82cb-cd188f9350b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:35.949918 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723119e1-faa0-4b4e-82cb-cd188f9350b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:35.950168 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723119e1-faa0-4b4e-82cb-cd188f9350b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:35.950539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723119e1-faa0-4b4e-82cb-cd188f9350b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:35.951626 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723119e1-faa0-4b4e-82cb-cd188f9350b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:35.953885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723119e1-faa0-4b4e-82cb-cd188f9350b4 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:35.987400 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406535f4-02eb-4770-b6b8-629e18d7cf42 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:35.993281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5be1f3-a5de-4c26-aeae-e2248685a5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:35.994358 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5be1f3-a5de-4c26-aeae-e2248685a5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:35.994951 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5be1f3-a5de-4c26-aeae-e2248685a5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:35.995446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5be1f3-a5de-4c26-aeae-e2248685a5fd admin admin] PATH_INFO: `/v3/users/41b06b3845984bf1928a32ce937793d7` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:35.998014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5be1f3-a5de-4c26-aeae-e2248685a5fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b06b3845984bf1928a32ce937793d7)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:36.001727 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 870/1724] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:35 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:36.002405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5be1f3-a5de-4c26-aeae-e2248685a5fd admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:36.005269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723119e1-faa0-4b4e-82cb-cd188f9350b4 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:36.126281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2e5be1f3-a5de-4c26-aeae-e2248685a5fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b06b3845984bf1928a32ce937793d7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:36.135528 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2e5be1f3-a5de-4c26-aeae-e2248685a5fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b06b3845984bf1928a32ce937793d7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:36.146363 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2e5be1f3-a5de-4c26-aeae-e2248685a5fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b06b3845984bf1928a32ce937793d7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:36.147814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2e5be1f3-a5de-4c26-aeae-e2248685a5fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b06b3845984bf1928a32ce937793d7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:36.149673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2e5be1f3-a5de-4c26-aeae-e2248685a5fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b06b3845984bf1928a32ce937793d7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:36.176714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 855/1725] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:33:35 2022] DELETE /identity/v3/users/41b06b3845984bf1928a32ce937793d7 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:36.190435 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723119e1-faa0-4b4e-82cb-cd188f9350b4 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:36.369013 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495eb143-466f-46b1-a9b8-d34e0363678e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:36.369713 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eb143-466f-46b1-a9b8-d34e0363678e admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:36.370438 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eb143-466f-46b1-a9b8-d34e0363678e admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:36.370746 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eb143-466f-46b1-a9b8-d34e0363678e admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:36.371802 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495eb143-466f-46b1-a9b8-d34e0363678e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:36.376936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495eb143-466f-46b1-a9b8-d34e0363678e admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:36.421117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 871/1726] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:36 2022] POST /identity/v3/users => generated 297 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:36.429255 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5be1f3-a5de-4c26-aeae-e2248685a5fd admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:36.431332 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-2e5be1f3-a5de-4c26-aeae-e2248685a5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:36.447421 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5be1f3-a5de-4c26-aeae-e2248685a5fd admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:36.453131 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fefb3-8b97-48bd-acf0-95329d47866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:36.454222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fefb3-8b97-48bd-acf0-95329d47866b admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:36.454700 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fefb3-8b97-48bd-acf0-95329d47866b admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:36.455150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fefb3-8b97-48bd-acf0-95329d47866b admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:36.456122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fefb3-8b97-48bd-acf0-95329d47866b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:36.457975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fefb3-8b97-48bd-acf0-95329d47866b admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:36.514198 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 856/1727] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:36.518542 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495eb143-466f-46b1-a9b8-d34e0363678e admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:36.536885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495eb143-466f-46b1-a9b8-d34e0363678e admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:36.553483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5445e6-ecf5-4e8d-ae9b-329b733cd442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:36.554568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5445e6-ecf5-4e8d-ae9b-329b733cd442 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:36.555825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5445e6-ecf5-4e8d-ae9b-329b733cd442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:36.556669 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5445e6-ecf5-4e8d-ae9b-329b733cd442 admin admin] PATH_INFO: `/v3/projects/4ee2d589384d4287902b4676aee28433/users/f2cdf960dc9d40baa771f2aceae1071c/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:36.590417 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5445e6-ecf5-4e8d-ae9b-329b733cd442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee2d589384d4287902b4676aee28433, user_id=f2cdf960dc9d40baa771f2aceae1071c, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:36.598133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5445e6-ecf5-4e8d-ae9b-329b733cd442 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:36.629262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 872/1728] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:36 2022] PUT /identity/v3/projects/4ee2d589384d4287902b4676aee28433/users/f2cdf960dc9d40baa771f2aceae1071c/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:36.633655 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fefb3-8b97-48bd-acf0-95329d47866b admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:36.655557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fefb3-8b97-48bd-acf0-95329d47866b admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:36.851869 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdcb99-d550-4404-8491-40da418b6e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:36.852594 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdcb99-d550-4404-8491-40da418b6e15 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:36.852856 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdcb99-d550-4404-8491-40da418b6e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:36.853126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdcb99-d550-4404-8491-40da418b6e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:36.853894 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecdcb99-d550-4404-8491-40da418b6e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:36.855494 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecdcb99-d550-4404-8491-40da418b6e15 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:36.886015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 857/1729] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:36.887634 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5445e6-ecf5-4e8d-ae9b-329b733cd442 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:36.900627 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5445e6-ecf5-4e8d-ae9b-329b733cd442 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:36.918202 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405efb6-a346-417d-acb9-2ba3d74eef07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:36.920017 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405efb6-a346-417d-acb9-2ba3d74eef07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:36.920671 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405efb6-a346-417d-acb9-2ba3d74eef07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:36.921773 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405efb6-a346-417d-acb9-2ba3d74eef07 admin admin] PATH_INFO: `/v3/projects/4ee2d589384d4287902b4676aee28433/users/f2cdf960dc9d40baa771f2aceae1071c/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:36.926107 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405efb6-a346-417d-acb9-2ba3d74eef07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee2d589384d4287902b4676aee28433, user_id=f2cdf960dc9d40baa771f2aceae1071c, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:36.931979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405efb6-a346-417d-acb9-2ba3d74eef07 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:36.949533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 873/1730] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:36 2022] PUT /identity/v3/projects/4ee2d589384d4287902b4676aee28433/users/f2cdf960dc9d40baa771f2aceae1071c/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:33:36.962610 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf866659-564c-4d08-9179-9a8cdce59391 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:36.962829 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf866659-564c-4d08-9179-9a8cdce59391 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:36.963447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf866659-564c-4d08-9179-9a8cdce59391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:37.073618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-cf866659-564c-4d08-9179-9a8cdce59391 None None] MFA Rules not processed for user `f2cdf960dc9d40baa771f2aceae1071c`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:37.077020 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-cf866659-564c-4d08-9179-9a8cdce59391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:37.233036 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 858/1731] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:37.243856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405efb6-a346-417d-acb9-2ba3d74eef07 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:37.246111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-4405efb6-a346-417d-acb9-2ba3d74eef07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:37.364477 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405efb6-a346-417d-acb9-2ba3d74eef07 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:37.372608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30679f5-12ba-461b-bcef-856453b61811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:37.374640 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30679f5-12ba-461b-bcef-856453b61811 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:37.375127 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30679f5-12ba-461b-bcef-856453b61811 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:37.375598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30679f5-12ba-461b-bcef-856453b61811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:37.387151 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30679f5-12ba-461b-bcef-856453b61811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:37.389455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30679f5-12ba-461b-bcef-856453b61811 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:37.404131 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 874/1732] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:37.512021 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf866659-564c-4d08-9179-9a8cdce59391 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:37.513723 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-cf866659-564c-4d08-9179-9a8cdce59391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:37.656031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf866659-564c-4d08-9179-9a8cdce59391 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:37.669288 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6075bda-11f9-4f0d-baba-3315bbb982e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:37.671120 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6075bda-11f9-4f0d-baba-3315bbb982e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:37.673154 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6075bda-11f9-4f0d-baba-3315bbb982e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:37.674056 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6075bda-11f9-4f0d-baba-3315bbb982e2 admin admin] PATH_INFO: `/v3/projects/d0cc9c8cd5ea47e58e86c0fd4d59e8a4` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:37.690418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6075bda-11f9-4f0d-baba-3315bbb982e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0cc9c8cd5ea47e58e86c0fd4d59e8a4)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:37.699853 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6075bda-11f9-4f0d-baba-3315bbb982e2 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:37.831065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d6075bda-11f9-4f0d-baba-3315bbb982e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0cc9c8cd5ea47e58e86c0fd4d59e8a4', 'request_id': 'req-d6075bda-11f9-4f0d-baba-3315bbb982e2'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:37.846061 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d6075bda-11f9-4f0d-baba-3315bbb982e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0cc9c8cd5ea47e58e86c0fd4d59e8a4', 'request_id': 'req-d6075bda-11f9-4f0d-baba-3315bbb982e2'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:37.853258 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d6075bda-11f9-4f0d-baba-3315bbb982e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0cc9c8cd5ea47e58e86c0fd4d59e8a4', 'request_id': 'req-d6075bda-11f9-4f0d-baba-3315bbb982e2'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:37.889161 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d6075bda-11f9-4f0d-baba-3315bbb982e2 admin admin] The token cache is being invalidate because project d0cc9c8cd5ea47e58e86c0fd4d59e8a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:33:37.889736 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d6075bda-11f9-4f0d-baba-3315bbb982e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:37.891997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d6075bda-11f9-4f0d-baba-3315bbb982e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:37.895586 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 859/1733] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:33:37 2022] DELETE /identity/v3/projects/d0cc9c8cd5ea47e58e86c0fd4d59e8a4 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:37.900282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cbeb4-93fe-47d6-bc74-1490be83becb None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:37.900607 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cbeb4-93fe-47d6-bc74-1490be83becb None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:37.900892 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cbeb4-93fe-47d6-bc74-1490be83becb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:37.954184 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-8c1cbeb4-93fe-47d6-bc74-1490be83becb None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:37.957108 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-8c1cbeb4-93fe-47d6-bc74-1490be83becb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:38.234881 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 875/1734] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:33:38.239571 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab92dcf-5b29-4362-80ba-0a0a0d42fd05 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:38.239860 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab92dcf-5b29-4362-80ba-0a0a0d42fd05 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:38.240140 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab92dcf-5b29-4362-80ba-0a0a0d42fd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:38.271941 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e54719-2a9d-493f-97a5-ba4794d799e7 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:38.272265 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e54719-2a9d-493f-97a5-ba4794d799e7 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:38.272516 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e54719-2a9d-493f-97a5-ba4794d799e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:38.321770 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-1ab92dcf-5b29-4362-80ba-0a0a0d42fd05 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:38.323018 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-1ab92dcf-5b29-4362-80ba-0a0a0d42fd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:38.379006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-c3e54719-2a9d-493f-97a5-ba4794d799e7 None None] MFA Rules not processed for user `046352b8553c4f23b6dda151f6f7ce00`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:38.389620 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c3e54719-2a9d-493f-97a5-ba4794d799e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:38.390095 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 860/1735] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:38.391220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab92dcf-5b29-4362-80ba-0a0a0d42fd05 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:38.400406 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-1ab92dcf-5b29-4362-80ba-0a0a0d42fd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:38.450620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab92dcf-5b29-4362-80ba-0a0a0d42fd05 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:38.500133 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc9074-65c1-4042-bdaa-126f7f2ac9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:38.502044 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc9074-65c1-4042-bdaa-126f7f2ac9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:38.502044 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc9074-65c1-4042-bdaa-126f7f2ac9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:38.502044 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc9074-65c1-4042-bdaa-126f7f2ac9ab admin admin] PATH_INFO: `/v3/users/d443d36f4c514b1ab161fd440e01db69` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:38.510461 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc9074-65c1-4042-bdaa-126f7f2ac9ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=d443d36f4c514b1ab161fd440e01db69)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:38.522950 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc9074-65c1-4042-bdaa-126f7f2ac9ab admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:38.707694 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 876/1736] 10.222.0.59 () {58 vars in 1015 bytes} [Fri May 6 23:33:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:38.708805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e54719-2a9d-493f-97a5-ba4794d799e7 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:38.729219 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-09dc9074-65c1-4042-bdaa-126f7f2ac9ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd443d36f4c514b1ab161fd440e01db69'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:38.754622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-09dc9074-65c1-4042-bdaa-126f7f2ac9ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd443d36f4c514b1ab161fd440e01db69'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:38.771404 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e54719-2a9d-493f-97a5-ba4794d799e7 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:38.772628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-09dc9074-65c1-4042-bdaa-126f7f2ac9ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd443d36f4c514b1ab161fd440e01db69'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:38.773755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-09dc9074-65c1-4042-bdaa-126f7f2ac9ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd443d36f4c514b1ab161fd440e01db69'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:38.775468 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-09dc9074-65c1-4042-bdaa-126f7f2ac9ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd443d36f4c514b1ab161fd440e01db69'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:38.809293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62647ad7-34f4-412c-95b3-cbc50a4d5c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:38.809975 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62647ad7-34f4-412c-95b3-cbc50a4d5c50 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:38.810254 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62647ad7-34f4-412c-95b3-cbc50a4d5c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:38.810528 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62647ad7-34f4-412c-95b3-cbc50a4d5c50 admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:38.811264 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62647ad7-34f4-412c-95b3-cbc50a4d5c50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:33:38.811567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62647ad7-34f4-412c-95b3-cbc50a4d5c50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:38.821152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62647ad7-34f4-412c-95b3-cbc50a4d5c50 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:38.839238 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 861/1737] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:33:38 2022] DELETE /identity/v3/users/d443d36f4c514b1ab161fd440e01db69 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:38.846888 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a6a50-0671-4908-b0a0-70bb70b7f072 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:38.848041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a6a50-0671-4908-b0a0-70bb70b7f072 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:38.848474 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a6a50-0671-4908-b0a0-70bb70b7f072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:38.891933 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-661a6a50-0671-4908-b0a0-70bb70b7f072 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:38.894735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-661a6a50-0671-4908-b0a0-70bb70b7f072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:38.902491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 877/1738] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:33:38.903489 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62647ad7-34f4-412c-95b3-cbc50a4d5c50 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:38.911420 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-62647ad7-34f4-412c-95b3-cbc50a4d5c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:38.948654 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62647ad7-34f4-412c-95b3-cbc50a4d5c50 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:39.090995 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 862/1739] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:33:39.109653 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a6a50-0671-4908-b0a0-70bb70b7f072 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:39.111104 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-661a6a50-0671-4908-b0a0-70bb70b7f072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:39.122003 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f20ca-88ca-41a7-8437-8072c8856cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:39.123522 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f20ca-88ca-41a7-8437-8072c8856cbb admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:39.124010 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f20ca-88ca-41a7-8437-8072c8856cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:39.124511 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f20ca-88ca-41a7-8437-8072c8856cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:39.125445 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f20ca-88ca-41a7-8437-8072c8856cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:39.129225 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f20ca-88ca-41a7-8437-8072c8856cbb admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:39.189028 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 878/1740] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:38 2022] POST /identity/v3/projects => generated 387 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:39.193571 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f20ca-88ca-41a7-8437-8072c8856cbb admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:39.324453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f20ca-88ca-41a7-8437-8072c8856cbb admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:39.342303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a11251-8d54-432d-aa51-785cd0bf6f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:39.344295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a11251-8d54-432d-aa51-785cd0bf6f39 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:39.347975 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a11251-8d54-432d-aa51-785cd0bf6f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:39.348588 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a11251-8d54-432d-aa51-785cd0bf6f39 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:39.350177 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a11251-8d54-432d-aa51-785cd0bf6f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:39.355039 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a11251-8d54-432d-aa51-785cd0bf6f39 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:39.365521 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a6a50-0671-4908-b0a0-70bb70b7f072 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:39.394638 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 879/1741] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:39 2022] POST /identity/v3/users => generated 294 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:33:39.400071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a11251-8d54-432d-aa51-785cd0bf6f39 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:39.540883 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bd6ed-f1d2-47c1-802f-6dcf1d2711ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:39.541871 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bd6ed-f1d2-47c1-802f-6dcf1d2711ec service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:39.542030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bd6ed-f1d2-47c1-802f-6dcf1d2711ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:39.542308 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bd6ed-f1d2-47c1-802f-6dcf1d2711ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:39.555604 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-4e2bd6ed-f1d2-47c1-802f-6dcf1d2711ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:39.575441 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a11251-8d54-432d-aa51-785cd0bf6f39 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:39.586589 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc174b-cf71-403f-973d-0d644901eb66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:39.591798 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc174b-cf71-403f-973d-0d644901eb66 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:39.592208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc174b-cf71-403f-973d-0d644901eb66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:39.592616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc174b-cf71-403f-973d-0d644901eb66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:39.618050 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc174b-cf71-403f-973d-0d644901eb66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:39.621062 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc174b-cf71-403f-973d-0d644901eb66 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:39.626330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2bd6ed-f1d2-47c1-802f-6dcf1d2711ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:39.628043 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2bd6ed-f1d2-47c1-802f-6dcf1d2711ec service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:39.661509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 880/1742] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:39.664150 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc174b-cf71-403f-973d-0d644901eb66 service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:39.676354 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 863/1743] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:39.688139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc174b-cf71-403f-973d-0d644901eb66 service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:39.713367 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b47ae-8fa0-497a-949b-233911c6fc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:39.719015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b47ae-8fa0-497a-949b-233911c6fc58 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:39.721725 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b47ae-8fa0-497a-949b-233911c6fc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:39.722995 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b47ae-8fa0-497a-949b-233911c6fc58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:39.725008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b47ae-8fa0-497a-949b-233911c6fc58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:39.730282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b47ae-8fa0-497a-949b-233911c6fc58 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:39.763806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 881/1744] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:39.768120 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bd6ed-f1d2-47c1-802f-6dcf1d2711ec service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:39.793706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bd6ed-f1d2-47c1-802f-6dcf1d2711ec service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:39.821848 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2899878-eea1-43cb-989f-f5a67f70b095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:39.822637 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2899878-eea1-43cb-989f-f5a67f70b095 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:39.822940 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2899878-eea1-43cb-989f-f5a67f70b095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:39.830271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2899878-eea1-43cb-989f-f5a67f70b095 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:39.831271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2899878-eea1-43cb-989f-f5a67f70b095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:39.833065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2899878-eea1-43cb-989f-f5a67f70b095 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:39.900413 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b47ae-8fa0-497a-949b-233911c6fc58 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:39.915550 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b47ae-8fa0-497a-949b-233911c6fc58 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:39.930306 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 864/1745] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:39.944417 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5d798-52db-470c-a912-cd479467fb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:39.946993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5d798-52db-470c-a912-cd479467fb3a admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:39.947282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5d798-52db-470c-a912-cd479467fb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:39.947564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5d798-52db-470c-a912-cd479467fb3a admin admin] PATH_INFO: `/v3/projects/56a9aa890dae4ed3afcbb0f9ad326105/users/51553fcbfeeb4b1abb4c7ed978ceb92d/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:40.016901 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5d798-52db-470c-a912-cd479467fb3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=56a9aa890dae4ed3afcbb0f9ad326105, user_id=51553fcbfeeb4b1abb4c7ed978ceb92d, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:40.019867 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5d798-52db-470c-a912-cd479467fb3a admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:40.090829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 882/1746] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:39 2022] PUT /identity/v3/projects/56a9aa890dae4ed3afcbb0f9ad326105/users/51553fcbfeeb4b1abb4c7ed978ceb92d/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:33:40.102599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b4584-ee86-41e4-b87e-b65abe2707cb None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:40.102879 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b4584-ee86-41e4-b87e-b65abe2707cb None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:40.103433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b4584-ee86-41e4-b87e-b65abe2707cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:40.185711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-768b4584-ee86-41e4-b87e-b65abe2707cb None None] MFA Rules not processed for user `51553fcbfeeb4b1abb4c7ed978ceb92d`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:40.186964 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-768b4584-ee86-41e4-b87e-b65abe2707cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:40.423905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 865/1747] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:40.430782 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5d798-52db-470c-a912-cd479467fb3a admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:40.668929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5d798-52db-470c-a912-cd479467fb3a admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:40.684904 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f45d3-5a87-4dcd-9b5e-8401efe29f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:40.686064 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f45d3-5a87-4dcd-9b5e-8401efe29f2e admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:40.686833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f45d3-5a87-4dcd-9b5e-8401efe29f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:40.687584 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f45d3-5a87-4dcd-9b5e-8401efe29f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:40.690525 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f45d3-5a87-4dcd-9b5e-8401efe29f2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:40.694840 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f45d3-5a87-4dcd-9b5e-8401efe29f2e admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:40.780217 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 883/1748] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:40 2022] POST /identity/v3/projects => generated 387 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:40.781538 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b4584-ee86-41e4-b87e-b65abe2707cb None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:40.799316 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b4584-ee86-41e4-b87e-b65abe2707cb None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:40.983602 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a69173-83a3-4511-974d-396a286daa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:40.985159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a69173-83a3-4511-974d-396a286daa5e admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:40.985690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a69173-83a3-4511-974d-396a286daa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:40.986269 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a69173-83a3-4511-974d-396a286daa5e admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:40.987211 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a69173-83a3-4511-974d-396a286daa5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:40.994688 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a69173-83a3-4511-974d-396a286daa5e admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:41.037285 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 866/1749] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:40 2022] POST /identity/v3/users => generated 294 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:41.042054 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f45d3-5a87-4dcd-9b5e-8401efe29f2e admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:41.059018 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f45d3-5a87-4dcd-9b5e-8401efe29f2e admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:41.072336 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c02ef5-e312-4f06-aee2-00393d102641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:41.073480 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c02ef5-e312-4f06-aee2-00393d102641 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:41.073772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c02ef5-e312-4f06-aee2-00393d102641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:41.074105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c02ef5-e312-4f06-aee2-00393d102641 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:41.077281 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c02ef5-e312-4f06-aee2-00393d102641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:41.088885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c02ef5-e312-4f06-aee2-00393d102641 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:41.126352 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a69173-83a3-4511-974d-396a286daa5e admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:41.126701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 884/1750] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:41.143426 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a69173-83a3-4511-974d-396a286daa5e admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:41.158056 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b243f-52ee-45d3-b633-d37722210e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:41.159019 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b243f-52ee-45d3-b633-d37722210e5b admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:41.159497 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b243f-52ee-45d3-b633-d37722210e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:41.159788 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b243f-52ee-45d3-b633-d37722210e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:41.160577 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b243f-52ee-45d3-b633-d37722210e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:41.162622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b243f-52ee-45d3-b633-d37722210e5b admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:41.206087 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 867/1751] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:33:41.210682 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c02ef5-e312-4f06-aee2-00393d102641 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:41.224760 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c02ef5-e312-4f06-aee2-00393d102641 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:41.236672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22bbe0-b251-4a57-a706-5348b93b0f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:41.238176 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22bbe0-b251-4a57-a706-5348b93b0f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:41.238545 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22bbe0-b251-4a57-a706-5348b93b0f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:41.238826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22bbe0-b251-4a57-a706-5348b93b0f64 admin admin] PATH_INFO: `/v3/projects/776ff1c0661049198057d9734a9f43d0/users/b6ae4f117bcc450984de4aa91b1fa372/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:41.286156 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22bbe0-b251-4a57-a706-5348b93b0f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=776ff1c0661049198057d9734a9f43d0, user_id=b6ae4f117bcc450984de4aa91b1fa372, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:41.290972 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22bbe0-b251-4a57-a706-5348b93b0f64 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:41.315771 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 885/1752] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:41 2022] PUT /identity/v3/projects/776ff1c0661049198057d9734a9f43d0/users/b6ae4f117bcc450984de4aa91b1fa372/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:41.326738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363b76a-5420-473e-87f5-3b9152f36991 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:41.327930 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363b76a-5420-473e-87f5-3b9152f36991 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:41.328427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363b76a-5420-473e-87f5-3b9152f36991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:41.381652 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-f363b76a-5420-473e-87f5-3b9152f36991 None None] MFA Rules not processed for user `b6ae4f117bcc450984de4aa91b1fa372`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:41.383671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f363b76a-5420-473e-87f5-3b9152f36991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:41.565967 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d1cf1-5a65-4135-8d40-f85b3f11ae15 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:41.566509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d1cf1-5a65-4135-8d40-f85b3f11ae15 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:41.566581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d1cf1-5a65-4135-8d40-f85b3f11ae15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:41.623291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-e19d1cf1-5a65-4135-8d40-f85b3f11ae15 None None] MFA Rules not processed for user `70b7101dccda45d78d379ec512eea44f`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:41.627413 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 868/1753] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:41.633548 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363b76a-5420-473e-87f5-3b9152f36991 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:41.634650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-e19d1cf1-5a65-4135-8d40-f85b3f11ae15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:41.835586 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363b76a-5420-473e-87f5-3b9152f36991 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:41.843071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 886/1754] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:41.853401 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5abb77-ac6a-4d57-b456-c09ad3130b9c None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:41.853703 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5abb77-ac6a-4d57-b456-c09ad3130b9c None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:41.853989 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5abb77-ac6a-4d57-b456-c09ad3130b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:41.859542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e298a-a35a-4b5a-bff6-5d19e0014627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:41.860597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e298a-a35a-4b5a-bff6-5d19e0014627 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:41.861080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e298a-a35a-4b5a-bff6-5d19e0014627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:41.861549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e298a-a35a-4b5a-bff6-5d19e0014627 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:41.862444 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e298a-a35a-4b5a-bff6-5d19e0014627 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:41.864688 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e298a-a35a-4b5a-bff6-5d19e0014627 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:41.933442 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-9c5abb77-ac6a-4d57-b456-c09ad3130b9c None None] MFA Rules not processed for user `70b7101dccda45d78d379ec512eea44f`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:41.935559 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-9c5abb77-ac6a-4d57-b456-c09ad3130b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:41.938708 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 869/1755] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:41 2022] POST /identity/v3/projects => generated 385 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:41.942276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e298a-a35a-4b5a-bff6-5d19e0014627 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:42.154085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 887/1756] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:33:42.154765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5abb77-ac6a-4d57-b456-c09ad3130b9c None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:42.156816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-9c5abb77-ac6a-4d57-b456-c09ad3130b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:42.172844 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e298a-a35a-4b5a-bff6-5d19e0014627 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:42.196463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426da76-54e8-4261-89cc-2cd97d45ab15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:42.197992 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426da76-54e8-4261-89cc-2cd97d45ab15 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:42.198363 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426da76-54e8-4261-89cc-2cd97d45ab15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:42.208319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426da76-54e8-4261-89cc-2cd97d45ab15 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:42.208319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426da76-54e8-4261-89cc-2cd97d45ab15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:42.216112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426da76-54e8-4261-89cc-2cd97d45ab15 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:42.285530 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 870/1757] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:41 2022] POST /identity/v3/users => generated 299 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:33:42.286037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5abb77-ac6a-4d57-b456-c09ad3130b9c None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:42.294829 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b090c95-7326-4d17-bc55-13b7a5396236 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:42.296175 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b090c95-7326-4d17-bc55-13b7a5396236 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:42.297819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b090c95-7326-4d17-bc55-13b7a5396236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:42.301934 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74058c86-cf7c-478a-ac43-53968fe87046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:42.302778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74058c86-cf7c-478a-ac43-53968fe87046 service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:42.303189 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74058c86-cf7c-478a-ac43-53968fe87046 service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:42.303559 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74058c86-cf7c-478a-ac43-53968fe87046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:42.337192 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74058c86-cf7c-478a-ac43-53968fe87046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:42.345339 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74058c86-cf7c-478a-ac43-53968fe87046 service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:42.373015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 888/1758] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:42.390865 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74058c86-cf7c-478a-ac43-53968fe87046 service nova] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:42.437983 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-9b090c95-7326-4d17-bc55-13b7a5396236 None None] MFA Rules not processed for user `d9fff6faa4cd424fb86378738e54d6fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:42.439465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9b090c95-7326-4d17-bc55-13b7a5396236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:42.458297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74058c86-cf7c-478a-ac43-53968fe87046 service nova] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:42.496920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040a5bd-9e60-46ec-b632-94eb6c25d585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:42.498042 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040a5bd-9e60-46ec-b632-94eb6c25d585 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:42.498561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040a5bd-9e60-46ec-b632-94eb6c25d585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:42.499131 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040a5bd-9e60-46ec-b632-94eb6c25d585 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:42.500164 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040a5bd-9e60-46ec-b632-94eb6c25d585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:42.503754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040a5bd-9e60-46ec-b632-94eb6c25d585 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:42.555299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 889/1759] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:42.560016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66989861-f625-4967-96f8-3af0a68d4777 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:42.560594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66989861-f625-4967-96f8-3af0a68d4777 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:42.562475 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66989861-f625-4967-96f8-3af0a68d4777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:42.613831 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-66989861-f625-4967-96f8-3af0a68d4777 None None] MFA Rules not processed for user `dd4e3bdb8957489b95d48c6f9bd91ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:42.619396 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-66989861-f625-4967-96f8-3af0a68d4777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:42.703221 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 871/1760] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:42.703221 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b090c95-7326-4d17-bc55-13b7a5396236 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:42.737481 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b090c95-7326-4d17-bc55-13b7a5396236 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:42.751709 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348cc6b-608f-4dc5-b9ca-069b6627d4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:42.752653 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348cc6b-608f-4dc5-b9ca-069b6627d4d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:42.752955 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348cc6b-608f-4dc5-b9ca-069b6627d4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:42.753213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348cc6b-608f-4dc5-b9ca-069b6627d4d6 admin admin] PATH_INFO: `/v3/projects/d2ad1cc6f28847ef853e0fa0db225a14/users/c90b80a8464942d19a8a1bd2b5657934/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:42.811377 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348cc6b-608f-4dc5-b9ca-069b6627d4d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ad1cc6f28847ef853e0fa0db225a14, user_id=c90b80a8464942d19a8a1bd2b5657934, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:42.814922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348cc6b-608f-4dc5-b9ca-069b6627d4d6 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:42.850454 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 872/1761] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:42 2022] PUT /identity/v3/projects/d2ad1cc6f28847ef853e0fa0db225a14/users/c90b80a8464942d19a8a1bd2b5657934/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:42.856144 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348cc6b-608f-4dc5-b9ca-069b6627d4d6 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:42.863421 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-2348cc6b-608f-4dc5-b9ca-069b6627d4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:42.868949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 890/1762] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:42.870605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66989861-f625-4967-96f8-3af0a68d4777 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:42.875330 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-66989861-f625-4967-96f8-3af0a68d4777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:42.906025 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66989861-f625-4967-96f8-3af0a68d4777 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:43.107926 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c350e5-1caa-4877-a9bb-a9aa4dbf92dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:43.112452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c350e5-1caa-4877-a9bb-a9aa4dbf92dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:43.113039 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c350e5-1caa-4877-a9bb-a9aa4dbf92dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:43.113358 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c350e5-1caa-4877-a9bb-a9aa4dbf92dc admin admin] PATH_INFO: `/v3/projects/b27108060fff400ab8187e8df7b1a206` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:43.116825 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348cc6b-608f-4dc5-b9ca-069b6627d4d6 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:43.119606 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c350e5-1caa-4877-a9bb-a9aa4dbf92dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b27108060fff400ab8187e8df7b1a206)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:43.134885 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc610ee9-1be9-4878-87aa-cea01418c8af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:43.135356 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc610ee9-1be9-4878-87aa-cea01418c8af service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:43.137022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc610ee9-1be9-4878-87aa-cea01418c8af service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:43.137797 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc610ee9-1be9-4878-87aa-cea01418c8af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:43.147302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c350e5-1caa-4877-a9bb-a9aa4dbf92dc admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:43.322214 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-95c350e5-1caa-4877-a9bb-a9aa4dbf92dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b27108060fff400ab8187e8df7b1a206', 'request_id': 'req-95c350e5-1caa-4877-a9bb-a9aa4dbf92dc'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:43.342732 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-95c350e5-1caa-4877-a9bb-a9aa4dbf92dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b27108060fff400ab8187e8df7b1a206', 'request_id': 'req-95c350e5-1caa-4877-a9bb-a9aa4dbf92dc'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:43.346356 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc610ee9-1be9-4878-87aa-cea01418c8af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:43.351235 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc610ee9-1be9-4878-87aa-cea01418c8af service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:43.375141 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 873/1763] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:43.378068 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-95c350e5-1caa-4877-a9bb-a9aa4dbf92dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b27108060fff400ab8187e8df7b1a206', 'request_id': 'req-95c350e5-1caa-4877-a9bb-a9aa4dbf92dc'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:43.391845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc610ee9-1be9-4878-87aa-cea01418c8af service nova] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:43.422262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-95c350e5-1caa-4877-a9bb-a9aa4dbf92dc admin admin] The token cache is being invalidate because project b27108060fff400ab8187e8df7b1a206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:33:43.422575 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-95c350e5-1caa-4877-a9bb-a9aa4dbf92dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:43.431163 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-95c350e5-1caa-4877-a9bb-a9aa4dbf92dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:43.437791 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 891/1764] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:33:42 2022] DELETE /identity/v3/projects/b27108060fff400ab8187e8df7b1a206 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:43.438863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc610ee9-1be9-4878-87aa-cea01418c8af service nova] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:43.442691 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c350e5-1caa-4877-a9bb-a9aa4dbf92dc admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:43.445931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-95c350e5-1caa-4877-a9bb-a9aa4dbf92dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:43.689868 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040979d-053f-4e6f-8caa-28fb5619a1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:43.693382 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040979d-053f-4e6f-8caa-28fb5619a1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:43.695117 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040979d-053f-4e6f-8caa-28fb5619a1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:43.696832 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040979d-053f-4e6f-8caa-28fb5619a1b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:43.698933 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040979d-053f-4e6f-8caa-28fb5619a1b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:43.701614 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040979d-053f-4e6f-8caa-28fb5619a1b8 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:43.760217 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 874/1765] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:43.762360 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040979d-053f-4e6f-8caa-28fb5619a1b8 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:43.766969 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c350e5-1caa-4877-a9bb-a9aa4dbf92dc admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:43.771615 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-6040979d-053f-4e6f-8caa-28fb5619a1b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:43.792914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b3af5-5fa1-4e4e-b538-4fc4670544fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:43.794168 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b3af5-5fa1-4e4e-b538-4fc4670544fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:43.794675 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b3af5-5fa1-4e4e-b538-4fc4670544fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:43.795116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b3af5-5fa1-4e4e-b538-4fc4670544fb admin admin] PATH_INFO: `/v3/users/f2cdf960dc9d40baa771f2aceae1071c` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:43.797226 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b3af5-5fa1-4e4e-b538-4fc4670544fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2cdf960dc9d40baa771f2aceae1071c)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:43.799965 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b3af5-5fa1-4e4e-b538-4fc4670544fb admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:43.832382 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040979d-053f-4e6f-8caa-28fb5619a1b8 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:43.854295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebb942-807a-4d33-b013-a2f505955fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:43.863141 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb942-807a-4d33-b013-a2f505955fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:43.866445 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb942-807a-4d33-b013-a2f505955fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:43.868319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb942-807a-4d33-b013-a2f505955fa9 admin admin] PATH_INFO: `/v3/projects/d2ad1cc6f28847ef853e0fa0db225a14/users/c90b80a8464942d19a8a1bd2b5657934/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:43.874050 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebb942-807a-4d33-b013-a2f505955fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ad1cc6f28847ef853e0fa0db225a14, user_id=c90b80a8464942d19a8a1bd2b5657934, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:43.882493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebb942-807a-4d33-b013-a2f505955fa9 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:43.937578 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 875/1766] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:43 2022] PUT /identity/v3/projects/d2ad1cc6f28847ef853e0fa0db225a14/users/c90b80a8464942d19a8a1bd2b5657934/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:43.948720 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-a01b3af5-5fa1-4e4e-b538-4fc4670544fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2cdf960dc9d40baa771f2aceae1071c'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:43.951786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebb942-807a-4d33-b013-a2f505955fa9 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:43.957430 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-98ebb942-807a-4d33-b013-a2f505955fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:43.959594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-a01b3af5-5fa1-4e4e-b538-4fc4670544fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2cdf960dc9d40baa771f2aceae1071c'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:43.961934 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-a01b3af5-5fa1-4e4e-b538-4fc4670544fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2cdf960dc9d40baa771f2aceae1071c'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:43.991945 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-a01b3af5-5fa1-4e4e-b538-4fc4670544fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2cdf960dc9d40baa771f2aceae1071c'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:43.992736 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-a01b3af5-5fa1-4e4e-b538-4fc4670544fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2cdf960dc9d40baa771f2aceae1071c'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:44.054417 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 892/1767] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:33:43 2022] DELETE /identity/v3/users/f2cdf960dc9d40baa771f2aceae1071c => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:33:44.059384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c91e6-c938-4905-9e7e-c0448c8649e5 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:44.061296 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c91e6-c938-4905-9e7e-c0448c8649e5 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:44.061778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c91e6-c938-4905-9e7e-c0448c8649e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:44.124863 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-e98c91e6-c938-4905-9e7e-c0448c8649e5 None None] MFA Rules not processed for user `c90b80a8464942d19a8a1bd2b5657934`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:44.128706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-e98c91e6-c938-4905-9e7e-c0448c8649e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:44.235676 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebb942-807a-4d33-b013-a2f505955fa9 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:44.263435 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 893/1768] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:44.285268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c91e6-c938-4905-9e7e-c0448c8649e5 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:44.287429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-e98c91e6-c938-4905-9e7e-c0448c8649e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:44.363504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3033b-71c3-4610-88fb-ab6fcaf56397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:44.365252 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3033b-71c3-4610-88fb-ab6fcaf56397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:44.365802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3033b-71c3-4610-88fb-ab6fcaf56397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:44.366336 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3033b-71c3-4610-88fb-ab6fcaf56397 admin admin] PATH_INFO: `/v3/users/545ec228a8ed40da8c9e7f8268b13c22` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:44.373413 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3033b-71c3-4610-88fb-ab6fcaf56397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=545ec228a8ed40da8c9e7f8268b13c22)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:44.375872 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3033b-71c3-4610-88fb-ab6fcaf56397 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:44.472499 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c91e6-c938-4905-9e7e-c0448c8649e5 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:44.490195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-eae3033b-71c3-4610-88fb-ab6fcaf56397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545ec228a8ed40da8c9e7f8268b13c22'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:44.493258 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f32e8f-4cf9-4cc5-9735-d913e755afcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:44.493929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f32e8f-4cf9-4cc5-9735-d913e755afcb service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:44.494210 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f32e8f-4cf9-4cc5-9735-d913e755afcb service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:44.494676 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f32e8f-4cf9-4cc5-9735-d913e755afcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:44.518209 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-eae3033b-71c3-4610-88fb-ab6fcaf56397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545ec228a8ed40da8c9e7f8268b13c22'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:44.526756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f32e8f-4cf9-4cc5-9735-d913e755afcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:44.528243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f32e8f-4cf9-4cc5-9735-d913e755afcb service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:44.541438 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-eae3033b-71c3-4610-88fb-ab6fcaf56397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545ec228a8ed40da8c9e7f8268b13c22'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:44.542321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-eae3033b-71c3-4610-88fb-ab6fcaf56397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545ec228a8ed40da8c9e7f8268b13c22'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:44.543171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-eae3033b-71c3-4610-88fb-ab6fcaf56397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545ec228a8ed40da8c9e7f8268b13c22'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:44.564097 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 894/1769] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:44.579339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 876/1770] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:33:43 2022] DELETE /identity/v3/users/545ec228a8ed40da8c9e7f8268b13c22 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:44.581509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db124d-cf7f-4d85-be9a-7377f074ec8f None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:44.581799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db124d-cf7f-4d85-be9a-7377f074ec8f None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:44.582101 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db124d-cf7f-4d85-be9a-7377f074ec8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:44.626330 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-35db124d-cf7f-4d85-be9a-7377f074ec8f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:44.631087 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-35db124d-cf7f-4d85-be9a-7377f074ec8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:44.880624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 895/1771] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:44.967904 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3033b-71c3-4610-88fb-ab6fcaf56397 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:44.969490 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-eae3033b-71c3-4610-88fb-ab6fcaf56397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:45.074547 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4030a-aabc-4f8a-ba12-15ae246a286f None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:45.074833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4030a-aabc-4f8a-ba12-15ae246a286f None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:45.075130 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4030a-aabc-4f8a-ba12-15ae246a286f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:45.096235 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3033b-71c3-4610-88fb-ab6fcaf56397 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:45.106906 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa1128-97ab-4997-aa50-51278d9215b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:45.107882 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa1128-97ab-4997-aa50-51278d9215b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:45.108270 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa1128-97ab-4997-aa50-51278d9215b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:45.109239 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa1128-97ab-4997-aa50-51278d9215b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:45.131462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa1128-97ab-4997-aa50-51278d9215b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:45.136581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa1128-97ab-4997-aa50-51278d9215b1 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:45.159916 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-d4d4030a-aabc-4f8a-ba12-15ae246a286f None None] MFA Rules not processed for user `f8f765f9b7104604b1ea1ec482932814`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:45.161452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d4d4030a-aabc-4f8a-ba12-15ae246a286f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:45.169649 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 877/1772] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:45.354631 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 896/1773] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:45.729728 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa1128-97ab-4997-aa50-51278d9215b1 service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:45.731853 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-a9fa1128-97ab-4997-aa50-51278d9215b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:45.771655 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651075a-3269-4645-a24f-871556a85e46 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:45.772245 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651075a-3269-4645-a24f-871556a85e46 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:45.772680 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651075a-3269-4645-a24f-871556a85e46 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:45.776082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 897/1774] 10.222.0.60 () {54 vars in 921 bytes} [Fri May 6 23:33:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:33:45.798081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51b1cd-4c25-43e3-b5c5-9daa14f79b61 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:45.798726 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51b1cd-4c25-43e3-b5c5-9daa14f79b61 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:45.799215 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51b1cd-4c25-43e3-b5c5-9daa14f79b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:45.831879 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-2c51b1cd-4c25-43e3-b5c5-9daa14f79b61 None None] MFA Rules not processed for user `9b74631c6e1547d991753a65c41bc7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:45.834763 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-2c51b1cd-4c25-43e3-b5c5-9daa14f79b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:45.950762 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa1128-97ab-4997-aa50-51278d9215b1 service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:45.968305 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b1aa8-5b3a-4784-96f5-4d63aa428c0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:45.969158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b1aa8-5b3a-4784-96f5-4d63aa428c0f service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:45.969547 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b1aa8-5b3a-4784-96f5-4d63aa428c0f service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:45.969923 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b1aa8-5b3a-4784-96f5-4d63aa428c0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:45.974277 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 898/1775] 10.222.0.60 () {58 vars in 1018 bytes} [Fri May 6 23:33:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:45.975388 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-6f7b1aa8-5b3a-4784-96f5-4d63aa428c0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:46.082180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b1aa8-5b3a-4784-96f5-4d63aa428c0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:46.085190 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b1aa8-5b3a-4784-96f5-4d63aa428c0f service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:46.104374 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 878/1776] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:46.475057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73c624-5f96-428e-94e6-3e06ae44d5a9 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:46.475281 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73c624-5f96-428e-94e6-3e06ae44d5a9 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:46.478398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73c624-5f96-428e-94e6-3e06ae44d5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:46.496374 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b1aa8-5b3a-4784-96f5-4d63aa428c0f service cinder] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:46.497905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-6f7b1aa8-5b3a-4784-96f5-4d63aa428c0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:46.543498 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-7f73c624-5f96-428e-94e6-3e06ae44d5a9 None None] MFA Rules not processed for user `70b7101dccda45d78d379ec512eea44f`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:46.544824 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-7f73c624-5f96-428e-94e6-3e06ae44d5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:46.547106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b1aa8-5b3a-4784-96f5-4d63aa428c0f service cinder] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:46.560650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abf0d9-13b1-47a6-80b2-762c9d908eb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:46.561768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abf0d9-13b1-47a6-80b2-762c9d908eb8 service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:46.562163 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abf0d9-13b1-47a6-80b2-762c9d908eb8 service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:46.564246 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abf0d9-13b1-47a6-80b2-762c9d908eb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:46.607781 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abf0d9-13b1-47a6-80b2-762c9d908eb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:46.615010 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abf0d9-13b1-47a6-80b2-762c9d908eb8 service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:46.693137 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 879/1777] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:33:46.702607 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abf0d9-13b1-47a6-80b2-762c9d908eb8 service nova] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:46.716939 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e7abf0d9-13b1-47a6-80b2-762c9d908eb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:46.802047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abf0d9-13b1-47a6-80b2-762c9d908eb8 service nova] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:46.824817 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68be4f-fafa-4ea6-bb6d-76972bbaa0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:46.825822 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68be4f-fafa-4ea6-bb6d-76972bbaa0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:46.826114 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68be4f-fafa-4ea6-bb6d-76972bbaa0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:46.826388 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68be4f-fafa-4ea6-bb6d-76972bbaa0dd admin admin] PATH_INFO: `/v3/projects/4ee2d589384d4287902b4676aee28433` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:46.828188 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68be4f-fafa-4ea6-bb6d-76972bbaa0dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee2d589384d4287902b4676aee28433)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:46.830100 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 899/1778] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:46.834009 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ada5d8-9e0d-4aa9-9bf5-eb88d4e2090b None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:46.835026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ada5d8-9e0d-4aa9-9bf5-eb88d4e2090b None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:46.837486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ada5d8-9e0d-4aa9-9bf5-eb88d4e2090b None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:46.844757 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 900/1779] 10.222.0.60 () {54 vars in 912 bytes} [Fri May 6 23:33:46 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:33:46.851189 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68be4f-fafa-4ea6-bb6d-76972bbaa0dd admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:46.854148 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41f1f6-4ae5-4c46-a210-1f292a84ef17 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:46.854448 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41f1f6-4ae5-4c46-a210-1f292a84ef17 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:46.854733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41f1f6-4ae5-4c46-a210-1f292a84ef17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:46.907812 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-ce41f1f6-4ae5-4c46-a210-1f292a84ef17 None None] MFA Rules not processed for user `046352b8553c4f23b6dda151f6f7ce00`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:46.909331 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-ce41f1f6-4ae5-4c46-a210-1f292a84ef17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:46.936553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 901/1780] 10.222.0.60 () {58 vars in 1009 bytes} [Fri May 6 23:33:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:46.968774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41f1f6-4ae5-4c46-a210-1f292a84ef17 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:46.970656 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-ce41f1f6-4ae5-4c46-a210-1f292a84ef17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:46.989130 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41f1f6-4ae5-4c46-a210-1f292a84ef17 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:46.990884 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-1d68be4f-fafa-4ea6-bb6d-76972bbaa0dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee2d589384d4287902b4676aee28433', 'request_id': 'req-1d68be4f-fafa-4ea6-bb6d-76972bbaa0dd'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:47.006436 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-1d68be4f-fafa-4ea6-bb6d-76972bbaa0dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee2d589384d4287902b4676aee28433', 'request_id': 'req-1d68be4f-fafa-4ea6-bb6d-76972bbaa0dd'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:47.023524 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-1d68be4f-fafa-4ea6-bb6d-76972bbaa0dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee2d589384d4287902b4676aee28433', 'request_id': 'req-1d68be4f-fafa-4ea6-bb6d-76972bbaa0dd'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:47.059178 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-1d68be4f-fafa-4ea6-bb6d-76972bbaa0dd admin admin] The token cache is being invalidate because project 4ee2d589384d4287902b4676aee28433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:33:47.059470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-1d68be4f-fafa-4ea6-bb6d-76972bbaa0dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:47.062975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-1d68be4f-fafa-4ea6-bb6d-76972bbaa0dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:47.065807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 880/1781] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:33:46 2022] DELETE /identity/v3/projects/4ee2d589384d4287902b4676aee28433 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:47.071448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826307a-e428-4c19-ba7c-8da9280812db None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:47.071934 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826307a-e428-4c19-ba7c-8da9280812db None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:47.072482 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826307a-e428-4c19-ba7c-8da9280812db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:47.113437 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-c826307a-e428-4c19-ba7c-8da9280812db None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:47.118000 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c826307a-e428-4c19-ba7c-8da9280812db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:47.196093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f09dd-0cc7-423a-998b-eb2681127ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:47.196866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f09dd-0cc7-423a-998b-eb2681127ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:47.197157 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f09dd-0cc7-423a-998b-eb2681127ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:47.197437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f09dd-0cc7-423a-998b-eb2681127ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:47.202984 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-226f09dd-0cc7-423a-998b-eb2681127ef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:47.224956 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f09dd-0cc7-423a-998b-eb2681127ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:47.226824 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f09dd-0cc7-423a-998b-eb2681127ef4 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:47.254682 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 902/1782] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:47.288086 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 881/1783] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:47.295541 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fbc4d-e3d6-4d2b-bd6a-0ef75e27c40e None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:47.295823 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fbc4d-e3d6-4d2b-bd6a-0ef75e27c40e None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:47.296100 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fbc4d-e3d6-4d2b-bd6a-0ef75e27c40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:47.327549 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-c19fbc4d-e3d6-4d2b-bd6a-0ef75e27c40e None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:47.328949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c19fbc4d-e3d6-4d2b-bd6a-0ef75e27c40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:47.349192 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 903/1784] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:47.353239 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826307a-e428-4c19-ba7c-8da9280812db None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:47.366174 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826307a-e428-4c19-ba7c-8da9280812db None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:47.385113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcbd51-33c6-453c-9f69-b4bef9896fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:47.385799 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcbd51-33c6-453c-9f69-b4bef9896fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:47.386082 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcbd51-33c6-453c-9f69-b4bef9896fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:47.386359 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcbd51-33c6-453c-9f69-b4bef9896fc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:47.387092 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abcbd51-33c6-453c-9f69-b4bef9896fc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:33:47.387638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abcbd51-33c6-453c-9f69-b4bef9896fc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:47.389758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abcbd51-33c6-453c-9f69-b4bef9896fc4 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:47.398668 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fbc4d-e3d6-4d2b-bd6a-0ef75e27c40e None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:47.400788 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c19fbc4d-e3d6-4d2b-bd6a-0ef75e27c40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:47.419608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 882/1785] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:33:47.424751 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcbd51-33c6-453c-9f69-b4bef9896fc4 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:47.449078 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcbd51-33c6-453c-9f69-b4bef9896fc4 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:47.462659 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f6ebb-aa6a-46dd-96ac-e7b924e8afe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:47.463534 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f6ebb-aa6a-46dd-96ac-e7b924e8afe1 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:47.463820 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f6ebb-aa6a-46dd-96ac-e7b924e8afe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:47.466023 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f6ebb-aa6a-46dd-96ac-e7b924e8afe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:47.468430 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f6ebb-aa6a-46dd-96ac-e7b924e8afe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:47.471705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f6ebb-aa6a-46dd-96ac-e7b924e8afe1 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:47.546437 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 883/1786] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:47 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:47.550865 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f6ebb-aa6a-46dd-96ac-e7b924e8afe1 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:47.584735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fbc4d-e3d6-4d2b-bd6a-0ef75e27c40e None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:47.705641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2c938-a35f-4a76-8862-595308691ebb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:47.706645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2c938-a35f-4a76-8862-595308691ebb service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:47.707192 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2c938-a35f-4a76-8862-595308691ebb service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:47.708837 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2c938-a35f-4a76-8862-595308691ebb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:47.711255 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-fba2c938-a35f-4a76-8862-595308691ebb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:47.715846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f6ebb-aa6a-46dd-96ac-e7b924e8afe1 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:47.731061 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00391f-062d-4ab6-a88a-795c4ee131ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:47.731756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00391f-062d-4ab6-a88a-795c4ee131ac admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:47.732037 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00391f-062d-4ab6-a88a-795c4ee131ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:47.732313 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00391f-062d-4ab6-a88a-795c4ee131ac admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:47.733061 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00391f-062d-4ab6-a88a-795c4ee131ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:47.735169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00391f-062d-4ab6-a88a-795c4ee131ac admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:47.738633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2c938-a35f-4a76-8862-595308691ebb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:47.744489 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2c938-a35f-4a76-8862-595308691ebb service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:47.791005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 884/1787] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:47 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:47.796940 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00391f-062d-4ab6-a88a-795c4ee131ac admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:47.804206 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-7c00391f-062d-4ab6-a88a-795c4ee131ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:47.817325 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 904/1788] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:33:47.821203 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2c938-a35f-4a76-8862-595308691ebb service nova] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:47.866005 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2c938-a35f-4a76-8862-595308691ebb service nova] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:47.867627 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00391f-062d-4ab6-a88a-795c4ee131ac admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:47.877443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201769ed-d66a-4a3c-b16a-59caa2687e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:47.878858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88593b14-e45a-437f-97ba-22e0596330e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:47.879866 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88593b14-e45a-437f-97ba-22e0596330e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:47.880089 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88593b14-e45a-437f-97ba-22e0596330e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:47.880361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88593b14-e45a-437f-97ba-22e0596330e8 admin admin] PATH_INFO: `/v3/projects/f3ca5941316f447092d6e87bfd154640` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:47.881236 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201769ed-d66a-4a3c-b16a-59caa2687e37 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:47.883050 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88593b14-e45a-437f-97ba-22e0596330e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3ca5941316f447092d6e87bfd154640)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:47.885141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201769ed-d66a-4a3c-b16a-59caa2687e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:47.885663 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201769ed-d66a-4a3c-b16a-59caa2687e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:47.886677 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201769ed-d66a-4a3c-b16a-59caa2687e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:47.892802 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201769ed-d66a-4a3c-b16a-59caa2687e37 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:47.897258 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88593b14-e45a-437f-97ba-22e0596330e8 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:47.922306 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 905/1789] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:47.923260 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201769ed-d66a-4a3c-b16a-59caa2687e37 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:47.938616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201769ed-d66a-4a3c-b16a-59caa2687e37 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:47.944333 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b314a1-9df1-4d82-a83b-570deab4c67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:47.945680 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b314a1-9df1-4d82-a83b-570deab4c67a admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:47.946154 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b314a1-9df1-4d82-a83b-570deab4c67a admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:47.946644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b314a1-9df1-4d82-a83b-570deab4c67a admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:47.948169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b314a1-9df1-4d82-a83b-570deab4c67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:47.950510 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b314a1-9df1-4d82-a83b-570deab4c67a admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:47.968995 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 906/1790] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:47.978625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b314a1-9df1-4d82-a83b-570deab4c67a admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:48.019770 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b314a1-9df1-4d82-a83b-570deab4c67a admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:48.033086 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e724b-4d66-45d9-93c7-697a1b4b676e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:48.034276 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e724b-4d66-45d9-93c7-697a1b4b676e admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:48.034564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e724b-4d66-45d9-93c7-697a1b4b676e admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:48.034845 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e724b-4d66-45d9-93c7-697a1b4b676e admin admin] PATH_INFO: `/v3/projects/391f10f34dbe4f6c881696aa4b8ad3f2/users/4c9294240b61486bbb4837cd5b16d156/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:48.083738 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e724b-4d66-45d9-93c7-697a1b4b676e admin admin] RBAC: Authorizing `identity:create_grant(project_id=391f10f34dbe4f6c881696aa4b8ad3f2, user_id=4c9294240b61486bbb4837cd5b16d156, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:48.086373 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-88593b14-e45a-437f-97ba-22e0596330e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3ca5941316f447092d6e87bfd154640', 'request_id': 'req-88593b14-e45a-437f-97ba-22e0596330e8'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:48.089194 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e724b-4d66-45d9-93c7-697a1b4b676e admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:48.100050 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-88593b14-e45a-437f-97ba-22e0596330e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3ca5941316f447092d6e87bfd154640', 'request_id': 'req-88593b14-e45a-437f-97ba-22e0596330e8'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:48.114527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 907/1791] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:47 2022] PUT /identity/v3/projects/391f10f34dbe4f6c881696aa4b8ad3f2/users/4c9294240b61486bbb4837cd5b16d156/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:48.125652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4067e4-63cc-4076-bce6-cb9cb3fa6083 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:48.126296 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4067e4-63cc-4076-bce6-cb9cb3fa6083 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:48.129476 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4067e4-63cc-4076-bce6-cb9cb3fa6083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:48.133304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-88593b14-e45a-437f-97ba-22e0596330e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3ca5941316f447092d6e87bfd154640', 'request_id': 'req-88593b14-e45a-437f-97ba-22e0596330e8'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:48.165010 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-88593b14-e45a-437f-97ba-22e0596330e8 admin admin] The token cache is being invalidate because project f3ca5941316f447092d6e87bfd154640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:33:48.165183 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-88593b14-e45a-437f-97ba-22e0596330e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:48.166853 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-88593b14-e45a-437f-97ba-22e0596330e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:48.171140 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 885/1792] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:33:47 2022] DELETE /identity/v3/projects/f3ca5941316f447092d6e87bfd154640 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:48.175460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88593b14-e45a-437f-97ba-22e0596330e8 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:48.178177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-88593b14-e45a-437f-97ba-22e0596330e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:48.211622 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-ec4067e4-63cc-4076-bce6-cb9cb3fa6083 None None] MFA Rules not processed for user `4c9294240b61486bbb4837cd5b16d156`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:48.215069 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-ec4067e4-63cc-4076-bce6-cb9cb3fa6083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:48.379301 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88593b14-e45a-437f-97ba-22e0596330e8 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:48.395987 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 908/1793] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:48.402085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4067e4-63cc-4076-bce6-cb9cb3fa6083 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:48.404336 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-ec4067e4-63cc-4076-bce6-cb9cb3fa6083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:48.533455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666348e-6b98-4f0b-bb3c-a5bd83e5a433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:48.534348 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666348e-6b98-4f0b-bb3c-a5bd83e5a433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:48.534635 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666348e-6b98-4f0b-bb3c-a5bd83e5a433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:48.534909 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666348e-6b98-4f0b-bb3c-a5bd83e5a433 admin admin] PATH_INFO: `/v3/users/e25140cff7f948cf88884bb25a1891c7` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:48.537436 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666348e-6b98-4f0b-bb3c-a5bd83e5a433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e25140cff7f948cf88884bb25a1891c7)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:48.539453 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666348e-6b98-4f0b-bb3c-a5bd83e5a433 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:48.559270 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4067e4-63cc-4076-bce6-cb9cb3fa6083 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:48.570869 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996ef53-02a0-4ba8-a0de-c8a320f0102c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:48.572773 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996ef53-02a0-4ba8-a0de-c8a320f0102c admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:48.573241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996ef53-02a0-4ba8-a0de-c8a320f0102c admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:48.574190 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996ef53-02a0-4ba8-a0de-c8a320f0102c admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:48.575159 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996ef53-02a0-4ba8-a0de-c8a320f0102c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:48.577787 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996ef53-02a0-4ba8-a0de-c8a320f0102c admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:48.632635 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6666348e-6b98-4f0b-bb3c-a5bd83e5a433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e25140cff7f948cf88884bb25a1891c7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:48.642262 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6666348e-6b98-4f0b-bb3c-a5bd83e5a433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e25140cff7f948cf88884bb25a1891c7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:48.652816 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6666348e-6b98-4f0b-bb3c-a5bd83e5a433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e25140cff7f948cf88884bb25a1891c7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:48.653599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6666348e-6b98-4f0b-bb3c-a5bd83e5a433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e25140cff7f948cf88884bb25a1891c7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:48.655121 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6666348e-6b98-4f0b-bb3c-a5bd83e5a433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e25140cff7f948cf88884bb25a1891c7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:48.663176 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 909/1794] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:48 2022] POST /identity/v3/projects => generated 383 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:48.665286 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996ef53-02a0-4ba8-a0de-c8a320f0102c admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:48.670943 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-4996ef53-02a0-4ba8-a0de-c8a320f0102c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:48.681272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 886/1795] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:33:48 2022] DELETE /identity/v3/users/e25140cff7f948cf88884bb25a1891c7 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:48.837974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996ef53-02a0-4ba8-a0de-c8a320f0102c admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:48.969624 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0f0e2-a559-453e-a999-2489c596aa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:48.970317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0f0e2-a559-453e-a999-2489c596aa61 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:48.970677 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0f0e2-a559-453e-a999-2489c596aa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:48.971004 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0f0e2-a559-453e-a999-2489c596aa61 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:48.972013 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0f0e2-a559-453e-a999-2489c596aa61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:48.974323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0f0e2-a559-453e-a999-2489c596aa61 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:49.013271 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 910/1796] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:48 2022] POST /identity/v3/users => generated 298 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:49.015727 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666348e-6b98-4f0b-bb3c-a5bd83e5a433 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:49.033447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666348e-6b98-4f0b-bb3c-a5bd83e5a433 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:49.040060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff909e-b983-4659-977e-71b7f8b255c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:49.041256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff909e-b983-4659-977e-71b7f8b255c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:49.041773 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff909e-b983-4659-977e-71b7f8b255c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:49.048335 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff909e-b983-4659-977e-71b7f8b255c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:49.049828 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff909e-b983-4659-977e-71b7f8b255c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:49.052194 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff909e-b983-4659-977e-71b7f8b255c1 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:49.075913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 887/1797] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:49.080600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0f0e2-a559-453e-a999-2489c596aa61 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:49.121681 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0f0e2-a559-453e-a999-2489c596aa61 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:49.133799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d32291-a8cc-4e19-9360-1f6857a2781d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:49.134083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d32291-a8cc-4e19-9360-1f6857a2781d admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:49.136695 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d32291-a8cc-4e19-9360-1f6857a2781d admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:49.137059 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d32291-a8cc-4e19-9360-1f6857a2781d admin admin] PATH_INFO: `/v3/projects/938f0d4575c64da1b87ea1743f15f08f/users/61e4ded9d650481f84dc339297b9ffa1/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:49.176968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d32291-a8cc-4e19-9360-1f6857a2781d admin admin] RBAC: Authorizing `identity:create_grant(project_id=938f0d4575c64da1b87ea1743f15f08f, user_id=61e4ded9d650481f84dc339297b9ffa1, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:49.184783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d32291-a8cc-4e19-9360-1f6857a2781d admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:49.232990 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 911/1798] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:49 2022] PUT /identity/v3/projects/938f0d4575c64da1b87ea1743f15f08f/users/61e4ded9d650481f84dc339297b9ffa1/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:49.234379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff909e-b983-4659-977e-71b7f8b255c1 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:49.251368 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff909e-b983-4659-977e-71b7f8b255c1 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:49.484193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cc291-395b-4c17-a19e-bf33c8442108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:49.485613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cc291-395b-4c17-a19e-bf33c8442108 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:49.487318 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cc291-395b-4c17-a19e-bf33c8442108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:49.488645 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cc291-395b-4c17-a19e-bf33c8442108 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:49.489805 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cc291-395b-4c17-a19e-bf33c8442108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:49.497342 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cc291-395b-4c17-a19e-bf33c8442108 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:49.526422 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 888/1799] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:49.530338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d32291-a8cc-4e19-9360-1f6857a2781d admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:49.556511 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d32291-a8cc-4e19-9360-1f6857a2781d admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:49.565310 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe623b3d-7015-4e18-9191-23a028ec6822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:49.566522 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe623b3d-7015-4e18-9191-23a028ec6822 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:49.568199 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe623b3d-7015-4e18-9191-23a028ec6822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:49.568660 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe623b3d-7015-4e18-9191-23a028ec6822 admin admin] PATH_INFO: `/v3/projects/938f0d4575c64da1b87ea1743f15f08f/users/61e4ded9d650481f84dc339297b9ffa1/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:49.576735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe623b3d-7015-4e18-9191-23a028ec6822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=938f0d4575c64da1b87ea1743f15f08f, user_id=61e4ded9d650481f84dc339297b9ffa1, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:49.580100 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe623b3d-7015-4e18-9191-23a028ec6822 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:49.609903 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 912/1800] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:49 2022] PUT /identity/v3/projects/938f0d4575c64da1b87ea1743f15f08f/users/61e4ded9d650481f84dc339297b9ffa1/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:49.626048 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb642d-6b5d-4a56-9612-90acdf055ccc None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:49.626441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb642d-6b5d-4a56-9612-90acdf055ccc None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:49.626814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb642d-6b5d-4a56-9612-90acdf055ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:49.719426 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-40eb642d-6b5d-4a56-9612-90acdf055ccc None None] MFA Rules not processed for user `61e4ded9d650481f84dc339297b9ffa1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:49.721737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-40eb642d-6b5d-4a56-9612-90acdf055ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:49.903563 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 889/1801] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:49.917842 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe623b3d-7015-4e18-9191-23a028ec6822 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:49.921445 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-fe623b3d-7015-4e18-9191-23a028ec6822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:50.120245 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe623b3d-7015-4e18-9191-23a028ec6822 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:50.127725 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd4abb-750a-4354-8c20-57811ec23828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:50.128394 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd4abb-750a-4354-8c20-57811ec23828 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:50.128759 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd4abb-750a-4354-8c20-57811ec23828 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:50.129040 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd4abb-750a-4354-8c20-57811ec23828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:50.137267 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-7ccd4abb-750a-4354-8c20-57811ec23828 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:50.249950 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd4abb-750a-4354-8c20-57811ec23828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:50.251485 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd4abb-750a-4354-8c20-57811ec23828 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:50.278228 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 913/1802] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:50.515993 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb642d-6b5d-4a56-9612-90acdf055ccc None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:50.517490 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-40eb642d-6b5d-4a56-9612-90acdf055ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:50.706830 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb642d-6b5d-4a56-9612-90acdf055ccc None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:50.735689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beefb93-11ed-4751-9d52-f0d939e5844b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:50.737135 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beefb93-11ed-4751-9d52-f0d939e5844b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:50.739838 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beefb93-11ed-4751-9d52-f0d939e5844b admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:50.741222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beefb93-11ed-4751-9d52-f0d939e5844b admin admin] PATH_INFO: `/v3/projects/2d138594bb5d4334aa1fc67e587d3ee5` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:50.744677 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beefb93-11ed-4751-9d52-f0d939e5844b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d138594bb5d4334aa1fc67e587d3ee5)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:50.748460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beefb93-11ed-4751-9d52-f0d939e5844b admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:50.858951 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4beefb93-11ed-4751-9d52-f0d939e5844b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d138594bb5d4334aa1fc67e587d3ee5', 'request_id': 'req-4beefb93-11ed-4751-9d52-f0d939e5844b'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:50.874361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4beefb93-11ed-4751-9d52-f0d939e5844b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d138594bb5d4334aa1fc67e587d3ee5', 'request_id': 'req-4beefb93-11ed-4751-9d52-f0d939e5844b'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:50.890398 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4beefb93-11ed-4751-9d52-f0d939e5844b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d138594bb5d4334aa1fc67e587d3ee5', 'request_id': 'req-4beefb93-11ed-4751-9d52-f0d939e5844b'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:50.921927 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4beefb93-11ed-4751-9d52-f0d939e5844b admin admin] The token cache is being invalidate because project 2d138594bb5d4334aa1fc67e587d3ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:33:50.923687 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4beefb93-11ed-4751-9d52-f0d939e5844b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:50.924636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4beefb93-11ed-4751-9d52-f0d939e5844b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:50.932584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 890/1803] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:33:50 2022] DELETE /identity/v3/projects/2d138594bb5d4334aa1fc67e587d3ee5 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:50.934259 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05525c18-ea1d-47b6-86ea-72d6cbce7715 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:50.934540 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05525c18-ea1d-47b6-86ea-72d6cbce7715 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:50.935028 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05525c18-ea1d-47b6-86ea-72d6cbce7715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:50.983970 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-05525c18-ea1d-47b6-86ea-72d6cbce7715 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:50.985843 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-05525c18-ea1d-47b6-86ea-72d6cbce7715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:51.149519 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 914/1804] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:51.156520 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a78abe-fc77-4364-8ebf-216948b5af8f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:51.156854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a78abe-fc77-4364-8ebf-216948b5af8f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:51.157134 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a78abe-fc77-4364-8ebf-216948b5af8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:51.213159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-91a78abe-fc77-4364-8ebf-216948b5af8f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:51.214468 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-91a78abe-fc77-4364-8ebf-216948b5af8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:51.250188 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 891/1805] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:51.251278 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05525c18-ea1d-47b6-86ea-72d6cbce7715 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:51.274063 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05525c18-ea1d-47b6-86ea-72d6cbce7715 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:51.300137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3dd7f-9697-42b6-86e4-32c336f1866a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:51.300852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3dd7f-9697-42b6-86e4-32c336f1866a admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:51.301300 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3dd7f-9697-42b6-86e4-32c336f1866a admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:51.301576 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3dd7f-9697-42b6-86e4-32c336f1866a admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:51.303413 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3dd7f-9697-42b6-86e4-32c336f1866a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:33:51.305142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3dd7f-9697-42b6-86e4-32c336f1866a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:51.325167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3dd7f-9697-42b6-86e4-32c336f1866a admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:51.378876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 915/1806] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:33:51.382361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a78abe-fc77-4364-8ebf-216948b5af8f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:51.392570 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a78abe-fc77-4364-8ebf-216948b5af8f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:51.413578 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f806f-9589-494b-bc2c-90aa35adf307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:51.414325 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f806f-9589-494b-bc2c-90aa35adf307 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:51.414675 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f806f-9589-494b-bc2c-90aa35adf307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:51.414974 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f806f-9589-494b-bc2c-90aa35adf307 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:51.428773 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f806f-9589-494b-bc2c-90aa35adf307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:51.430832 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f806f-9589-494b-bc2c-90aa35adf307 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:51.504120 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 892/1807] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:51 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:51.508653 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3dd7f-9697-42b6-86e4-32c336f1866a admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:51.522876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3dd7f-9697-42b6-86e4-32c336f1866a admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:51.732123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f806f-9589-494b-bc2c-90aa35adf307 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:51.734029 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9a7f806f-9589-494b-bc2c-90aa35adf307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:51.777385 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571049e2-1ecf-4053-85f5-7ea13b0e1142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:51.778122 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571049e2-1ecf-4053-85f5-7ea13b0e1142 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:51.778767 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571049e2-1ecf-4053-85f5-7ea13b0e1142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:51.778767 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571049e2-1ecf-4053-85f5-7ea13b0e1142 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:51.779401 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571049e2-1ecf-4053-85f5-7ea13b0e1142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:51.781423 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571049e2-1ecf-4053-85f5-7ea13b0e1142 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:51.835227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 916/1808] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:51 2022] POST /identity/v3/users => generated 289 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:51.844032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571049e2-1ecf-4053-85f5-7ea13b0e1142 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:51.863788 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f806f-9589-494b-bc2c-90aa35adf307 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:51.868595 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468714f-5c83-4b61-ab08-0a13fd5db325 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:51.869365 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468714f-5c83-4b61-ab08-0a13fd5db325 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:51.870358 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468714f-5c83-4b61-ab08-0a13fd5db325 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:51.870761 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468714f-5c83-4b61-ab08-0a13fd5db325 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:51.873039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f468714f-5c83-4b61-ab08-0a13fd5db325 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:51.879442 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571049e2-1ecf-4053-85f5-7ea13b0e1142 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:51.892643 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724f881-dd4e-4a95-961d-3082ff990653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:51.893327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724f881-dd4e-4a95-961d-3082ff990653 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:51.893633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724f881-dd4e-4a95-961d-3082ff990653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:51.893938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724f881-dd4e-4a95-961d-3082ff990653 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:51.894705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724f881-dd4e-4a95-961d-3082ff990653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:51.896471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724f881-dd4e-4a95-961d-3082ff990653 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:51.933021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 917/1809] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:51.937018 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724f881-dd4e-4a95-961d-3082ff990653 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:51.974224 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724f881-dd4e-4a95-961d-3082ff990653 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:52.000703 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a726d-6135-4bd5-878f-80142b48a25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:52.001014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468714f-5c83-4b61-ab08-0a13fd5db325 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:52.002036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a726d-6135-4bd5-878f-80142b48a25c admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:52.002585 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a726d-6135-4bd5-878f-80142b48a25c admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:52.002836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468714f-5c83-4b61-ab08-0a13fd5db325 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:52.003256 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a726d-6135-4bd5-878f-80142b48a25c admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:52.004230 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a726d-6135-4bd5-878f-80142b48a25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:52.006168 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a726d-6135-4bd5-878f-80142b48a25c admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:52.041466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 893/1810] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:33:52.042276 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 918/1811] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:52.043025 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468714f-5c83-4b61-ab08-0a13fd5db325 service cinder] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:52.073500 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468714f-5c83-4b61-ab08-0a13fd5db325 service cinder] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:52.083196 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e733d2a-ccad-4713-b180-d45c0d841e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:52.084420 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e733d2a-ccad-4713-b180-d45c0d841e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:52.084936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e733d2a-ccad-4713-b180-d45c0d841e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:52.085440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e733d2a-ccad-4713-b180-d45c0d841e70 admin admin] PATH_INFO: `/v3/projects/ebd30113048f4939931576e6486e96d4/users/12c13fb0a73d4851bd46d380db9e769b/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:52.126787 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e733d2a-ccad-4713-b180-d45c0d841e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd30113048f4939931576e6486e96d4, user_id=12c13fb0a73d4851bd46d380db9e769b, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:52.130171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e733d2a-ccad-4713-b180-d45c0d841e70 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:52.155184 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 894/1812] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:52 2022] PUT /identity/v3/projects/ebd30113048f4939931576e6486e96d4/users/12c13fb0a73d4851bd46d380db9e769b/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:52.166714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca428ec8-d6c7-439d-a74d-abe9569a72f9 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:52.167484 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca428ec8-d6c7-439d-a74d-abe9569a72f9 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:52.167954 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca428ec8-d6c7-439d-a74d-abe9569a72f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:52.218092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-ca428ec8-d6c7-439d-a74d-abe9569a72f9 None None] MFA Rules not processed for user `12c13fb0a73d4851bd46d380db9e769b`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:52.219355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-ca428ec8-d6c7-439d-a74d-abe9569a72f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:52.366681 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 919/1813] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:52.371544 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e733d2a-ccad-4713-b180-d45c0d841e70 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:52.460312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fb7a6-4e57-470f-ab03-f648de84f2c5 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:52.460699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fb7a6-4e57-470f-ab03-f648de84f2c5 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:52.460936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fb7a6-4e57-470f-ab03-f648de84f2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:52.500294 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-d39fb7a6-4e57-470f-ab03-f648de84f2c5 None None] MFA Rules not processed for user `d9fff6faa4cd424fb86378738e54d6fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:52.501559 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d39fb7a6-4e57-470f-ab03-f648de84f2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:52.517159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e733d2a-ccad-4713-b180-d45c0d841e70 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:52.530781 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041bb0d-3a5b-4fc0-8d91-c718146755c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:52.531455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041bb0d-3a5b-4fc0-8d91-c718146755c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:52.531793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041bb0d-3a5b-4fc0-8d91-c718146755c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:52.531997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041bb0d-3a5b-4fc0-8d91-c718146755c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:52.532738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041bb0d-3a5b-4fc0-8d91-c718146755c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:52.534710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041bb0d-3a5b-4fc0-8d91-c718146755c4 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:52.614555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 895/1814] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:52 2022] POST /identity/v3/projects => generated 375 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:52.617692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041bb0d-3a5b-4fc0-8d91-c718146755c4 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:52.625514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 920/1815] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:52.797552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041bb0d-3a5b-4fc0-8d91-c718146755c4 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:52.812876 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ebff7-a64e-460b-a834-6c3320a7499a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:52.814321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ebff7-a64e-460b-a834-6c3320a7499a admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:52.815343 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ebff7-a64e-460b-a834-6c3320a7499a admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:52.816655 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ebff7-a64e-460b-a834-6c3320a7499a admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:52.818730 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ebff7-a64e-460b-a834-6c3320a7499a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:52.825244 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ebff7-a64e-460b-a834-6c3320a7499a admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:52.875335 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 896/1816] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:52 2022] POST /identity/v3/users => generated 294 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:52.879047 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fb7a6-4e57-470f-ab03-f648de84f2c5 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:52.903706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fb7a6-4e57-470f-ab03-f648de84f2c5 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:52.921231 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31d980-8591-4c72-b9ec-1175e02f82e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:52.921925 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31d980-8591-4c72-b9ec-1175e02f82e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:52.924945 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31d980-8591-4c72-b9ec-1175e02f82e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:52.926534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31d980-8591-4c72-b9ec-1175e02f82e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:52.927303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31d980-8591-4c72-b9ec-1175e02f82e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:52.930515 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31d980-8591-4c72-b9ec-1175e02f82e5 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:52.981041 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 921/1817] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:52.983496 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ebff7-a64e-460b-a834-6c3320a7499a admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:53.004633 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ebff7-a64e-460b-a834-6c3320a7499a admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:53.032443 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369691df-f5de-461e-8e59-b4370d7df335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:53.048839 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369691df-f5de-461e-8e59-b4370d7df335 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:53.049136 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369691df-f5de-461e-8e59-b4370d7df335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:53.049415 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369691df-f5de-461e-8e59-b4370d7df335 admin admin] PATH_INFO: `/v3/projects/6010bfdc95a24783bfd25f48c941e0c2/users/e0f4d34c746d4ec58c2d40c50ef8cc6f/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:53.110793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369691df-f5de-461e-8e59-b4370d7df335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6010bfdc95a24783bfd25f48c941e0c2, user_id=e0f4d34c746d4ec58c2d40c50ef8cc6f, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:53.120587 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369691df-f5de-461e-8e59-b4370d7df335 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:53.155819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 897/1818] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:52 2022] PUT /identity/v3/projects/6010bfdc95a24783bfd25f48c941e0c2/users/e0f4d34c746d4ec58c2d40c50ef8cc6f/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:53.157383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31d980-8591-4c72-b9ec-1175e02f82e5 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:53.179226 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31d980-8591-4c72-b9ec-1175e02f82e5 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:53.353237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4a0ff-1bef-42c3-831a-98f3f19d93f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:53.354291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4a0ff-1bef-42c3-831a-98f3f19d93f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:53.355414 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4a0ff-1bef-42c3-831a-98f3f19d93f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:53.355854 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4a0ff-1bef-42c3-831a-98f3f19d93f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:53.357033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4a0ff-1bef-42c3-831a-98f3f19d93f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:53.359707 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4a0ff-1bef-42c3-831a-98f3f19d93f5 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:53.389832 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 922/1819] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:53.396037 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369691df-f5de-461e-8e59-b4370d7df335 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:53.417648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369691df-f5de-461e-8e59-b4370d7df335 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:53.431116 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc7a21-33f5-40aa-bd90-3961e3eb5713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:53.432176 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc7a21-33f5-40aa-bd90-3961e3eb5713 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:53.432499 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc7a21-33f5-40aa-bd90-3961e3eb5713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:53.432806 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc7a21-33f5-40aa-bd90-3961e3eb5713 admin admin] PATH_INFO: `/v3/projects/6010bfdc95a24783bfd25f48c941e0c2/users/e0f4d34c746d4ec58c2d40c50ef8cc6f/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:53.435240 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc7a21-33f5-40aa-bd90-3961e3eb5713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6010bfdc95a24783bfd25f48c941e0c2, user_id=e0f4d34c746d4ec58c2d40c50ef8cc6f, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:53.438206 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc7a21-33f5-40aa-bd90-3961e3eb5713 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:53.466879 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 898/1820] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:53 2022] PUT /identity/v3/projects/6010bfdc95a24783bfd25f48c941e0c2/users/e0f4d34c746d4ec58c2d40c50ef8cc6f/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:53.469566 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f8e73-8a59-44e8-9137-ca8f647529bd None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:53.469961 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f8e73-8a59-44e8-9137-ca8f647529bd None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:53.470339 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f8e73-8a59-44e8-9137-ca8f647529bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:53.527793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-393f8e73-8a59-44e8-9137-ca8f647529bd None None] MFA Rules not processed for user `e0f4d34c746d4ec58c2d40c50ef8cc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:53.529635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-393f8e73-8a59-44e8-9137-ca8f647529bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:53.680132 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 923/1821] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:53.693283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc7a21-33f5-40aa-bd90-3961e3eb5713 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:53.813766 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc7a21-33f5-40aa-bd90-3961e3eb5713 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:53.820253 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f21e9d-6ebd-4b12-99d9-471471ea819d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:53.821177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f21e9d-6ebd-4b12-99d9-471471ea819d service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:53.821656 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f21e9d-6ebd-4b12-99d9-471471ea819d service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:53.822076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f21e9d-6ebd-4b12-99d9-471471ea819d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:53.894828 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57762fa1-46aa-495d-b53d-3e883b6540b0 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:53.895115 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57762fa1-46aa-495d-b53d-3e883b6540b0 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:53.895390 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57762fa1-46aa-495d-b53d-3e883b6540b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:53.966617 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-57762fa1-46aa-495d-b53d-3e883b6540b0 None None] MFA Rules not processed for user `f8f765f9b7104604b1ea1ec482932814`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:53.971596 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-57762fa1-46aa-495d-b53d-3e883b6540b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:53.985183 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f21e9d-6ebd-4b12-99d9-471471ea819d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:53.986878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f21e9d-6ebd-4b12-99d9-471471ea819d service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:54.011807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 899/1822] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:54.130768 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 924/1823] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:55.758307 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f21e9d-6ebd-4b12-99d9-471471ea819d service cinder] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:55.759972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-11f21e9d-6ebd-4b12-99d9-471471ea819d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:55.897417 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f21e9d-6ebd-4b12-99d9-471471ea819d service cinder] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:55.918183 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fbb85-b76c-416e-b213-3e3aa01c1ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:55.918839 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fbb85-b76c-416e-b213-3e3aa01c1ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:55.919121 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fbb85-b76c-416e-b213-3e3aa01c1ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:55.924752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fbb85-b76c-416e-b213-3e3aa01c1ae1 admin admin] PATH_INFO: `/v3/users/51553fcbfeeb4b1abb4c7ed978ceb92d` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:55.927976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fbb85-b76c-416e-b213-3e3aa01c1ae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51553fcbfeeb4b1abb4c7ed978ceb92d)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:55.934904 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fbb85-b76c-416e-b213-3e3aa01c1ae1 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:56.059976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a07fbb85-b76c-416e-b213-3e3aa01c1ae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51553fcbfeeb4b1abb4c7ed978ceb92d'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:56.074549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a07fbb85-b76c-416e-b213-3e3aa01c1ae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51553fcbfeeb4b1abb4c7ed978ceb92d'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:56.099734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a07fbb85-b76c-416e-b213-3e3aa01c1ae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51553fcbfeeb4b1abb4c7ed978ceb92d'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:56.101535 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a07fbb85-b76c-416e-b213-3e3aa01c1ae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51553fcbfeeb4b1abb4c7ed978ceb92d'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:56.106171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a07fbb85-b76c-416e-b213-3e3aa01c1ae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51553fcbfeeb4b1abb4c7ed978ceb92d'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:56.165205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 900/1824] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:33:55 2022] DELETE /identity/v3/users/51553fcbfeeb4b1abb4c7ed978ceb92d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:56.170737 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801142a-6d3a-43bd-97a5-823fab5e030d None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:56.171317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801142a-6d3a-43bd-97a5-823fab5e030d None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:56.171571 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801142a-6d3a-43bd-97a5-823fab5e030d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:56.199937 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-c801142a-6d3a-43bd-97a5-823fab5e030d None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:56.202146 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c801142a-6d3a-43bd-97a5-823fab5e030d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:56.387051 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 925/1825] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:56.437322 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fbb85-b76c-416e-b213-3e3aa01c1ae1 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:56.439094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-a07fbb85-b76c-416e-b213-3e3aa01c1ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:56.506485 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801142a-6d3a-43bd-97a5-823fab5e030d None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:56.510333 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c801142a-6d3a-43bd-97a5-823fab5e030d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:56.651860 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fbb85-b76c-416e-b213-3e3aa01c1ae1 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:56.671707 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4bde7-ea28-4db5-9c39-2b3ab1b8d1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:56.672617 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4bde7-ea28-4db5-9c39-2b3ab1b8d1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:56.673580 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4bde7-ea28-4db5-9c39-2b3ab1b8d1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:56.673984 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4bde7-ea28-4db5-9c39-2b3ab1b8d1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:56.674381 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801142a-6d3a-43bd-97a5-823fab5e030d None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:56.678280 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e079f32-b677-4e37-a73b-fa40b307bc88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:56.679145 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e079f32-b677-4e37-a73b-fa40b307bc88 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:56.679536 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e079f32-b677-4e37-a73b-fa40b307bc88 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:56.679913 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e079f32-b677-4e37-a73b-fa40b307bc88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:56.690733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-3e079f32-b677-4e37-a73b-fa40b307bc88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:56.702295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4bde7-ea28-4db5-9c39-2b3ab1b8d1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:56.706634 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4bde7-ea28-4db5-9c39-2b3ab1b8d1b0 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:56.739335 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 901/1826] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:56.741020 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076df5c-c93b-4028-91df-4b135131faae None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:56.741416 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076df5c-c93b-4028-91df-4b135131faae None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:56.742790 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076df5c-c93b-4028-91df-4b135131faae None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:56.744160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 902/1827] 10.222.0.60 () {54 vars in 921 bytes} [Fri May 6 23:33:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:33:56.828702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e079f32-b677-4e37-a73b-fa40b307bc88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:56.830634 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e079f32-b677-4e37-a73b-fa40b307bc88 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:56.858678 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 926/1828] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:56.864648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cb881-7eb2-40c8-8b34-e654fe91bbfd None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:56.865053 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cb881-7eb2-40c8-8b34-e654fe91bbfd None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:56.865461 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cb881-7eb2-40c8-8b34-e654fe91bbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:56.899505 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-606cb881-7eb2-40c8-8b34-e654fe91bbfd None None] MFA Rules not processed for user `9b74631c6e1547d991753a65c41bc7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:56.901198 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-606cb881-7eb2-40c8-8b34-e654fe91bbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:57.067781 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 903/1829] 10.222.0.60 () {58 vars in 1018 bytes} [Fri May 6 23:33:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:57.341985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e079f32-b677-4e37-a73b-fa40b307bc88 service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:57.347497 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-3e079f32-b677-4e37-a73b-fa40b307bc88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:57.402670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e079f32-b677-4e37-a73b-fa40b307bc88 service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:57.420875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f793c-f3df-470d-bcf4-22f9866ccdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:57.433619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f793c-f3df-470d-bcf4-22f9866ccdf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:57.434639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f793c-f3df-470d-bcf4-22f9866ccdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:57.435769 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f793c-f3df-470d-bcf4-22f9866ccdf3 admin admin] PATH_INFO: `/v3/projects/56a9aa890dae4ed3afcbb0f9ad326105` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:57.447060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f793c-f3df-470d-bcf4-22f9866ccdf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56a9aa890dae4ed3afcbb0f9ad326105)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:57.464320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f793c-f3df-470d-bcf4-22f9866ccdf3 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:57.574654 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-513f793c-f3df-470d-bcf4-22f9866ccdf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56a9aa890dae4ed3afcbb0f9ad326105', 'request_id': 'req-513f793c-f3df-470d-bcf4-22f9866ccdf3'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:57.581985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-513f793c-f3df-470d-bcf4-22f9866ccdf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56a9aa890dae4ed3afcbb0f9ad326105', 'request_id': 'req-513f793c-f3df-470d-bcf4-22f9866ccdf3'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:57.593514 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cb881-7eb2-40c8-8b34-e654fe91bbfd None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:57.603273 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-606cb881-7eb2-40c8-8b34-e654fe91bbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:57.604420 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-513f793c-f3df-470d-bcf4-22f9866ccdf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56a9aa890dae4ed3afcbb0f9ad326105', 'request_id': 'req-513f793c-f3df-470d-bcf4-22f9866ccdf3'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:57.628214 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-513f793c-f3df-470d-bcf4-22f9866ccdf3 admin admin] The token cache is being invalidate because project 56a9aa890dae4ed3afcbb0f9ad326105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:33:57.628781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-513f793c-f3df-470d-bcf4-22f9866ccdf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:57.629544 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-513f793c-f3df-470d-bcf4-22f9866ccdf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:57.632131 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 927/1830] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:33:57 2022] DELETE /identity/v3/projects/56a9aa890dae4ed3afcbb0f9ad326105 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:57.635191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cb881-7eb2-40c8-8b34-e654fe91bbfd None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:57.636742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f793c-f3df-470d-bcf4-22f9866ccdf3 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:57.638294 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-513f793c-f3df-470d-bcf4-22f9866ccdf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:57.718947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f793c-f3df-470d-bcf4-22f9866ccdf3 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:57.726627 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585c410-bc32-4a8d-969b-e90aa98385f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:57.727768 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585c410-bc32-4a8d-969b-e90aa98385f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:57.728163 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585c410-bc32-4a8d-969b-e90aa98385f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:57.728612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585c410-bc32-4a8d-969b-e90aa98385f8 admin admin] PATH_INFO: `/v3/users/b6ae4f117bcc450984de4aa91b1fa372` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:57.730648 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585c410-bc32-4a8d-969b-e90aa98385f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ae4f117bcc450984de4aa91b1fa372)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:57.733539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585c410-bc32-4a8d-969b-e90aa98385f8 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:57.790398 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162aa23-d443-4da9-b03b-89674f6d3082 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:57.792720 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162aa23-d443-4da9-b03b-89674f6d3082 service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:57.794345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162aa23-d443-4da9-b03b-89674f6d3082 service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:57.795005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162aa23-d443-4da9-b03b-89674f6d3082 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:57.799550 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-d585c410-bc32-4a8d-969b-e90aa98385f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ae4f117bcc450984de4aa91b1fa372'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:57.803027 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-5162aa23-d443-4da9-b03b-89674f6d3082 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:57.807152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-d585c410-bc32-4a8d-969b-e90aa98385f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ae4f117bcc450984de4aa91b1fa372'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:57.807915 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-d585c410-bc32-4a8d-969b-e90aa98385f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ae4f117bcc450984de4aa91b1fa372'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:57.816927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-d585c410-bc32-4a8d-969b-e90aa98385f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ae4f117bcc450984de4aa91b1fa372'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:57.817546 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-d585c410-bc32-4a8d-969b-e90aa98385f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ae4f117bcc450984de4aa91b1fa372'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:57.829710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162aa23-d443-4da9-b03b-89674f6d3082 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:57.832141 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162aa23-d443-4da9-b03b-89674f6d3082 service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:57.846201 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 904/1831] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:57.848022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da565565-9cff-44fb-a537-7213208ab450 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:57.848313 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da565565-9cff-44fb-a537-7213208ab450 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:57.848695 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da565565-9cff-44fb-a537-7213208ab450 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:57.855166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 905/1832] 10.222.0.60 () {54 vars in 921 bytes} [Fri May 6 23:33:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:33:57.856458 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d746f-406d-4887-bd34-b2ad59989fbd None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:57.856788 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d746f-406d-4887-bd34-b2ad59989fbd None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:57.857100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d746f-406d-4887-bd34-b2ad59989fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:57.880141 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-bf6d746f-406d-4887-bd34-b2ad59989fbd None None] MFA Rules not processed for user `9b74631c6e1547d991753a65c41bc7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:57.882036 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-bf6d746f-406d-4887-bd34-b2ad59989fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:57.895519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 906/1833] 10.222.0.60 () {58 vars in 1018 bytes} [Fri May 6 23:33:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:57.899317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 928/1834] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:33:57 2022] DELETE /identity/v3/users/b6ae4f117bcc450984de4aa91b1fa372 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:33:58.065129 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d746f-406d-4887-bd34-b2ad59989fbd None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:58.066770 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-bf6d746f-406d-4887-bd34-b2ad59989fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:58.093620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d746f-406d-4887-bd34-b2ad59989fbd None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:58.188752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d490f-f45e-4f3a-99a5-77e675d07acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:58.189414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d490f-f45e-4f3a-99a5-77e675d07acf service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:58.189689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d490f-f45e-4f3a-99a5-77e675d07acf service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:58.190238 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d490f-f45e-4f3a-99a5-77e675d07acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:58.201832 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d490f-f45e-4f3a-99a5-77e675d07acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:58.203899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d490f-f45e-4f3a-99a5-77e675d07acf service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:58.216436 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 907/1835] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:33:58.256913 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585c410-bc32-4a8d-969b-e90aa98385f8 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:58.258839 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d585c410-bc32-4a8d-969b-e90aa98385f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:58.323590 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585c410-bc32-4a8d-969b-e90aa98385f8 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:58.328364 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14c0ce-bbf3-403c-95b1-17e3ff222d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:58.329238 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14c0ce-bbf3-403c-95b1-17e3ff222d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:58.329517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14c0ce-bbf3-403c-95b1-17e3ff222d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:58.329787 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14c0ce-bbf3-403c-95b1-17e3ff222d74 admin admin] PATH_INFO: `/v3/projects/776ff1c0661049198057d9734a9f43d0` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:58.330957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14c0ce-bbf3-403c-95b1-17e3ff222d74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=776ff1c0661049198057d9734a9f43d0)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:58.332897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14c0ce-bbf3-403c-95b1-17e3ff222d74 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:58.377187 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2c14c0ce-bbf3-403c-95b1-17e3ff222d74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '776ff1c0661049198057d9734a9f43d0', 'request_id': 'req-2c14c0ce-bbf3-403c-95b1-17e3ff222d74'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:58.383730 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2c14c0ce-bbf3-403c-95b1-17e3ff222d74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '776ff1c0661049198057d9734a9f43d0', 'request_id': 'req-2c14c0ce-bbf3-403c-95b1-17e3ff222d74'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:58.388920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2c14c0ce-bbf3-403c-95b1-17e3ff222d74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '776ff1c0661049198057d9734a9f43d0', 'request_id': 'req-2c14c0ce-bbf3-403c-95b1-17e3ff222d74'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:58.401398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2c14c0ce-bbf3-403c-95b1-17e3ff222d74 admin admin] The token cache is being invalidate because project 776ff1c0661049198057d9734a9f43d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:33:58.401668 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2c14c0ce-bbf3-403c-95b1-17e3ff222d74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:58.402305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2c14c0ce-bbf3-403c-95b1-17e3ff222d74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:58.404065 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 929/1836] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:33:58 2022] DELETE /identity/v3/projects/776ff1c0661049198057d9734a9f43d0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:58.407926 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d490f-f45e-4f3a-99a5-77e675d07acf service nova] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:58.418237 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d490f-f45e-4f3a-99a5-77e675d07acf service nova] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:58.490253 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7719658-f3c7-40d6-9813-2f2a2a2d7920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:58.491144 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7719658-f3c7-40d6-9813-2f2a2a2d7920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:58.491454 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7719658-f3c7-40d6-9813-2f2a2a2d7920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:58.492336 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7719658-f3c7-40d6-9813-2f2a2a2d7920 admin admin] PATH_INFO: `/v3/users/c90b80a8464942d19a8a1bd2b5657934` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:58.497441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7719658-f3c7-40d6-9813-2f2a2a2d7920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c90b80a8464942d19a8a1bd2b5657934)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:58.502132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7719658-f3c7-40d6-9813-2f2a2a2d7920 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:58.552727 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d7719658-f3c7-40d6-9813-2f2a2a2d7920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c90b80a8464942d19a8a1bd2b5657934'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:58.559914 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d7719658-f3c7-40d6-9813-2f2a2a2d7920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c90b80a8464942d19a8a1bd2b5657934'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:58.567393 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d7719658-f3c7-40d6-9813-2f2a2a2d7920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c90b80a8464942d19a8a1bd2b5657934'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:58.567953 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d7719658-f3c7-40d6-9813-2f2a2a2d7920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c90b80a8464942d19a8a1bd2b5657934'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:58.568670 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d7719658-f3c7-40d6-9813-2f2a2a2d7920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c90b80a8464942d19a8a1bd2b5657934'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:58.585809 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 908/1837] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:33:58 2022] DELETE /identity/v3/users/c90b80a8464942d19a8a1bd2b5657934 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:58.866754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14c0ce-bbf3-403c-95b1-17e3ff222d74 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:58.868306 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-2c14c0ce-bbf3-403c-95b1-17e3ff222d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:58.881947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14c0ce-bbf3-403c-95b1-17e3ff222d74 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:58.940458 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1708fa-7af1-416b-b3e2-a2c57ade9e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:58.941652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1708fa-7af1-416b-b3e2-a2c57ade9e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:58.941652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1708fa-7af1-416b-b3e2-a2c57ade9e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:58.941808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1708fa-7af1-416b-b3e2-a2c57ade9e24 admin admin] PATH_INFO: `/v3/projects/d2ad1cc6f28847ef853e0fa0db225a14` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:58.943003 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1708fa-7af1-416b-b3e2-a2c57ade9e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2ad1cc6f28847ef853e0fa0db225a14)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:58.945506 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1708fa-7af1-416b-b3e2-a2c57ade9e24 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:58.993091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ff1708fa-7af1-416b-b3e2-a2c57ade9e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2ad1cc6f28847ef853e0fa0db225a14', 'request_id': 'req-ff1708fa-7af1-416b-b3e2-a2c57ade9e24'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:58.999265 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ff1708fa-7af1-416b-b3e2-a2c57ade9e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2ad1cc6f28847ef853e0fa0db225a14', 'request_id': 'req-ff1708fa-7af1-416b-b3e2-a2c57ade9e24'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:59.004678 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ff1708fa-7af1-416b-b3e2-a2c57ade9e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2ad1cc6f28847ef853e0fa0db225a14', 'request_id': 'req-ff1708fa-7af1-416b-b3e2-a2c57ade9e24'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:59.017036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ff1708fa-7af1-416b-b3e2-a2c57ade9e24 admin admin] The token cache is being invalidate because project d2ad1cc6f28847ef853e0fa0db225a14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:33:59.017323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ff1708fa-7af1-416b-b3e2-a2c57ade9e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:59.017958 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ff1708fa-7af1-416b-b3e2-a2c57ade9e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:33:59.019494 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 930/1838] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:33:58 2022] DELETE /identity/v3/projects/d2ad1cc6f28847ef853e0fa0db225a14 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:59.025837 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf52fb1-ae98-49da-aa82-a737a1a363e1 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:59.026277 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf52fb1-ae98-49da-aa82-a737a1a363e1 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:59.026394 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf52fb1-ae98-49da-aa82-a737a1a363e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:59.046918 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-3bf52fb1-ae98-49da-aa82-a737a1a363e1 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:59.048191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-3bf52fb1-ae98-49da-aa82-a737a1a363e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:59.109920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 909/1839] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:33:59.117906 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5213bf-5617-4d75-98f3-08074294ab42 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:59.118197 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5213bf-5617-4d75-98f3-08074294ab42 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:59.118477 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5213bf-5617-4d75-98f3-08074294ab42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:59.139639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-6c5213bf-5617-4d75-98f3-08074294ab42 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:59.141120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-6c5213bf-5617-4d75-98f3-08074294ab42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:59.153544 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 931/1840] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:33:59.154746 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf52fb1-ae98-49da-aa82-a737a1a363e1 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:59.166674 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf52fb1-ae98-49da-aa82-a737a1a363e1 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:59.172128 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ef07b-76d5-4e1f-b723-bb20b5948fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:59.172947 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ef07b-76d5-4e1f-b723-bb20b5948fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:59.173256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ef07b-76d5-4e1f-b723-bb20b5948fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:59.173535 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ef07b-76d5-4e1f-b723-bb20b5948fb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:59.174270 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ef07b-76d5-4e1f-b723-bb20b5948fb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:33:59.174579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ef07b-76d5-4e1f-b723-bb20b5948fb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:59.176249 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ef07b-76d5-4e1f-b723-bb20b5948fb9 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:59.189572 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 910/1841] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:33:59.195239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5213bf-5617-4d75-98f3-08074294ab42 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:59.205933 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5213bf-5617-4d75-98f3-08074294ab42 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:59.212511 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b48602-58b1-46f3-884a-cd82e7733fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:59.213577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b48602-58b1-46f3-884a-cd82e7733fef admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:59.214008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b48602-58b1-46f3-884a-cd82e7733fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:59.214464 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b48602-58b1-46f3-884a-cd82e7733fef admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:59.215311 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b48602-58b1-46f3-884a-cd82e7733fef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:59.217460 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b48602-58b1-46f3-884a-cd82e7733fef admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:59.266900 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 932/1842] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:59 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:59.270628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ef07b-76d5-4e1f-b723-bb20b5948fb9 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:59.290978 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ef07b-76d5-4e1f-b723-bb20b5948fb9 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:59.403451 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a9f11-4703-4dcb-aa34-4e68dd2a70be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:59.404756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a9f11-4703-4dcb-aa34-4e68dd2a70be admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:59.405300 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a9f11-4703-4dcb-aa34-4e68dd2a70be admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:59.405854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a9f11-4703-4dcb-aa34-4e68dd2a70be admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:59.406880 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a9f11-4703-4dcb-aa34-4e68dd2a70be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:59.409729 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a9f11-4703-4dcb-aa34-4e68dd2a70be admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:59.443852 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 911/1843] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:33:59 2022] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:33:59.445671 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b48602-58b1-46f3-884a-cd82e7733fef admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:59.467901 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b48602-58b1-46f3-884a-cd82e7733fef admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:59.481063 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a66be-8c32-47e1-997e-654f95bcf1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:59.482038 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a66be-8c32-47e1-997e-654f95bcf1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:59.482430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a66be-8c32-47e1-997e-654f95bcf1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:59.482711 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a66be-8c32-47e1-997e-654f95bcf1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:59.483777 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a66be-8c32-47e1-997e-654f95bcf1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:59.485919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a66be-8c32-47e1-997e-654f95bcf1e8 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:59.497707 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 933/1844] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:59.502761 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a9f11-4703-4dcb-aa34-4e68dd2a70be admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:59.518965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a9f11-4703-4dcb-aa34-4e68dd2a70be admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:59.533427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab69c80-eafe-4a7b-b2c0-5761cb9835e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:59.534940 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab69c80-eafe-4a7b-b2c0-5761cb9835e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:59.535425 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab69c80-eafe-4a7b-b2c0-5761cb9835e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:59.535795 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab69c80-eafe-4a7b-b2c0-5761cb9835e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:59.537308 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab69c80-eafe-4a7b-b2c0-5761cb9835e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:59.539960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab69c80-eafe-4a7b-b2c0-5761cb9835e1 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:59.571816 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 912/1845] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:33:59.576649 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a66be-8c32-47e1-997e-654f95bcf1e8 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:59.587173 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab69c80-eafe-4a7b-b2c0-5761cb9835e1 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:33:59.594928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a66be-8c32-47e1-997e-654f95bcf1e8 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:59.598230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-8ab69c80-eafe-4a7b-b2c0-5761cb9835e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:59.616611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728695a-a171-48f6-b470-c2192e038609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:59.617666 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728695a-a171-48f6-b470-c2192e038609 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:59.617909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728695a-a171-48f6-b470-c2192e038609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:59.618227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728695a-a171-48f6-b470-c2192e038609 admin admin] PATH_INFO: `/v3/projects/c8e6483a65344160b9b9ed9b14832017/users/df3102b83a2c42c5b9f1fc642e09cd44/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:59.666321 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728695a-a171-48f6-b470-c2192e038609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e6483a65344160b9b9ed9b14832017, user_id=df3102b83a2c42c5b9f1fc642e09cd44, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:33:59.669447 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728695a-a171-48f6-b470-c2192e038609 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:33:59.689998 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 934/1846] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:33:59 2022] PUT /identity/v3/projects/c8e6483a65344160b9b9ed9b14832017/users/df3102b83a2c42c5b9f1fc642e09cd44/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:33:59.705216 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0a259-7e73-4e31-8ba9-cf8bec097e7a None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:59.705562 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0a259-7e73-4e31-8ba9-cf8bec097e7a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:59.705963 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0a259-7e73-4e31-8ba9-cf8bec097e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:59.729812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab69c80-eafe-4a7b-b2c0-5761cb9835e1 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:33:59.744483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-eef0a259-7e73-4e31-8ba9-cf8bec097e7a None None] MFA Rules not processed for user `df3102b83a2c42c5b9f1fc642e09cd44`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:33:59.746475 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-eef0a259-7e73-4e31-8ba9-cf8bec097e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:59.837560 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e400f-24b0-468f-a03b-d380d5330200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:33:59.838229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e400f-24b0-468f-a03b-d380d5330200 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:33:59.842844 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e400f-24b0-468f-a03b-d380d5330200 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:33:59.842844 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e400f-24b0-468f-a03b-d380d5330200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:33:59.848646 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-128e400f-24b0-468f-a03b-d380d5330200 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:33:59.912576 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 935/1847] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:33:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:33:59.917020 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0a259-7e73-4e31-8ba9-cf8bec097e7a None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:00.005842 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e400f-24b0-468f-a03b-d380d5330200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:00.007665 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e400f-24b0-468f-a03b-d380d5330200 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:00.038211 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 913/1848] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:33:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:34:00.050076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0a259-7e73-4e31-8ba9-cf8bec097e7a None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:00.065147 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5000b-af36-4a74-8779-e7ab1ef3a614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:00.066993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5000b-af36-4a74-8779-e7ab1ef3a614 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:00.067278 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5000b-af36-4a74-8779-e7ab1ef3a614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:00.067568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5000b-af36-4a74-8779-e7ab1ef3a614 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:00.068257 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5000b-af36-4a74-8779-e7ab1ef3a614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:00.076227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5000b-af36-4a74-8779-e7ab1ef3a614 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:00.132313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 936/1849] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:33:59 2022] POST /identity/v3/projects => generated 367 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:34:00.139776 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e400f-24b0-468f-a03b-d380d5330200 service cinder] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:00.154223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e400f-24b0-468f-a03b-d380d5330200 service cinder] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:00.290700 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d0382-645a-42fa-8f2d-1f73abc1661d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:00.291544 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d0382-645a-42fa-8f2d-1f73abc1661d admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:00.291838 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d0382-645a-42fa-8f2d-1f73abc1661d admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:00.292117 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d0382-645a-42fa-8f2d-1f73abc1661d admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:00.292863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d0382-645a-42fa-8f2d-1f73abc1661d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:00.294947 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d0382-645a-42fa-8f2d-1f73abc1661d admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:00.328662 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 914/1850] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:34:00 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:00.331960 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5000b-af36-4a74-8779-e7ab1ef3a614 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:00.344389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5000b-af36-4a74-8779-e7ab1ef3a614 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:00.357045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a36801-6b4f-4a68-a2a2-dde566cd1b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:00.357785 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a36801-6b4f-4a68-a2a2-dde566cd1b8b admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:00.358082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a36801-6b4f-4a68-a2a2-dde566cd1b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:00.359078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a36801-6b4f-4a68-a2a2-dde566cd1b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:00.377696 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a36801-6b4f-4a68-a2a2-dde566cd1b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:00.385080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a36801-6b4f-4a68-a2a2-dde566cd1b8b admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:00.413453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 937/1851] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:00.418462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d0382-645a-42fa-8f2d-1f73abc1661d admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:00.437371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d0382-645a-42fa-8f2d-1f73abc1661d admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:00.442600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63b4fb-a379-4693-a0c9-fec0f57f695f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:00.443527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63b4fb-a379-4693-a0c9-fec0f57f695f admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:00.443808 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63b4fb-a379-4693-a0c9-fec0f57f695f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:00.444084 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63b4fb-a379-4693-a0c9-fec0f57f695f admin admin] PATH_INFO: `/v3/projects/1e54c1ed93f645a3bdc3d5f93cfdbd90/users/21549a0209514352b70c0988c3730167/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:00.466195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63b4fb-a379-4693-a0c9-fec0f57f695f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e54c1ed93f645a3bdc3d5f93cfdbd90, user_id=21549a0209514352b70c0988c3730167, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:00.469986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63b4fb-a379-4693-a0c9-fec0f57f695f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:00.491881 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 915/1852] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:00 2022] PUT /identity/v3/projects/1e54c1ed93f645a3bdc3d5f93cfdbd90/users/21549a0209514352b70c0988c3730167/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:00.501783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a36801-6b4f-4a68-a2a2-dde566cd1b8b admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:00.522438 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a36801-6b4f-4a68-a2a2-dde566cd1b8b admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:00.620800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3c6f1-1351-47d8-bec8-12db240d570f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:00.621646 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3c6f1-1351-47d8-bec8-12db240d570f admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:00.621957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3c6f1-1351-47d8-bec8-12db240d570f admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:00.622465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3c6f1-1351-47d8-bec8-12db240d570f admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:00.623394 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3c6f1-1351-47d8-bec8-12db240d570f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:00.625039 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3c6f1-1351-47d8-bec8-12db240d570f admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:00.641066 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 938/1853] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:00.642384 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63b4fb-a379-4693-a0c9-fec0f57f695f admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:00.655904 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63b4fb-a379-4693-a0c9-fec0f57f695f admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:00.662049 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab18802-9523-474c-bf68-e5effd6ed039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:00.663337 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab18802-9523-474c-bf68-e5effd6ed039 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:00.663790 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab18802-9523-474c-bf68-e5effd6ed039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:00.664137 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab18802-9523-474c-bf68-e5effd6ed039 admin admin] PATH_INFO: `/v3/projects/1e54c1ed93f645a3bdc3d5f93cfdbd90/users/21549a0209514352b70c0988c3730167/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:00.667903 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab18802-9523-474c-bf68-e5effd6ed039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e54c1ed93f645a3bdc3d5f93cfdbd90, user_id=21549a0209514352b70c0988c3730167, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:00.670717 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab18802-9523-474c-bf68-e5effd6ed039 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:00.684431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 916/1854] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:00 2022] PUT /identity/v3/projects/1e54c1ed93f645a3bdc3d5f93cfdbd90/users/21549a0209514352b70c0988c3730167/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:34:00.694395 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe4f58-6ddc-4f8c-8d20-94fafc1bb523 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:00.694925 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe4f58-6ddc-4f8c-8d20-94fafc1bb523 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:00.695711 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe4f58-6ddc-4f8c-8d20-94fafc1bb523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:00.724149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-cefe4f58-6ddc-4f8c-8d20-94fafc1bb523 None None] MFA Rules not processed for user `21549a0209514352b70c0988c3730167`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:00.726046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-cefe4f58-6ddc-4f8c-8d20-94fafc1bb523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:00.819358 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 939/1855] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:00 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:00.837909 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab18802-9523-474c-bf68-e5effd6ed039 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:00.909680 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab18802-9523-474c-bf68-e5effd6ed039 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:00.915792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c760c7-01ce-485a-a514-cf8684f8efec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:00.916454 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c760c7-01ce-485a-a514-cf8684f8efec service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:00.916771 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c760c7-01ce-485a-a514-cf8684f8efec service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:00.917049 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c760c7-01ce-485a-a514-cf8684f8efec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:00.931416 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c760c7-01ce-485a-a514-cf8684f8efec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:00.933766 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c760c7-01ce-485a-a514-cf8684f8efec service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:00.945927 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 917/1856] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:00 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:34:01.039267 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe4f58-6ddc-4f8c-8d20-94fafc1bb523 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:01.050241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe4f58-6ddc-4f8c-8d20-94fafc1bb523 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:01.053938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b6e0a-f329-40a1-9e91-87b302faa914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:01.054651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b6e0a-f329-40a1-9e91-87b302faa914 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:01.054935 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b6e0a-f329-40a1-9e91-87b302faa914 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:01.055212 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b6e0a-f329-40a1-9e91-87b302faa914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:01.130836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b6e0a-f329-40a1-9e91-87b302faa914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:01.131975 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b6e0a-f329-40a1-9e91-87b302faa914 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:01.149478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 940/1857] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:34:05.491437 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c760c7-01ce-485a-a514-cf8684f8efec service cinder] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:05.493181 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-97c760c7-01ce-485a-a514-cf8684f8efec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:05.598617 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c760c7-01ce-485a-a514-cf8684f8efec service cinder] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:05.604326 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e410ba-5908-4a4a-9e4b-392aa8b523d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:05.605246 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e410ba-5908-4a4a-9e4b-392aa8b523d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:05.605534 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e410ba-5908-4a4a-9e4b-392aa8b523d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:05.605811 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e410ba-5908-4a4a-9e4b-392aa8b523d3 admin admin] PATH_INFO: `/v3/users/4c9294240b61486bbb4837cd5b16d156` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:05.607148 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e410ba-5908-4a4a-9e4b-392aa8b523d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c9294240b61486bbb4837cd5b16d156)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:05.609974 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e410ba-5908-4a4a-9e4b-392aa8b523d3 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:05.665314 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c7e410ba-5908-4a4a-9e4b-392aa8b523d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c9294240b61486bbb4837cd5b16d156'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:05.673470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c7e410ba-5908-4a4a-9e4b-392aa8b523d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c9294240b61486bbb4837cd5b16d156'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:05.682067 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c7e410ba-5908-4a4a-9e4b-392aa8b523d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c9294240b61486bbb4837cd5b16d156'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:05.682915 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c7e410ba-5908-4a4a-9e4b-392aa8b523d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c9294240b61486bbb4837cd5b16d156'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:05.683639 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c7e410ba-5908-4a4a-9e4b-392aa8b523d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c9294240b61486bbb4837cd5b16d156'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:05.703206 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 918/1858] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:34:05 2022] DELETE /identity/v3/users/4c9294240b61486bbb4837cd5b16d156 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:05.707630 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98647c0-bf3e-4236-829a-6917e3321bbe None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:05.708117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98647c0-bf3e-4236-829a-6917e3321bbe None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:05.708570 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98647c0-bf3e-4236-829a-6917e3321bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:05.728653 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-a98647c0-bf3e-4236-829a-6917e3321bbe None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:05.730297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-a98647c0-bf3e-4236-829a-6917e3321bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:05.815814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 941/1859] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:05.823739 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e410ba-5908-4a4a-9e4b-392aa8b523d3 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:05.825551 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c7e410ba-5908-4a4a-9e4b-392aa8b523d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:05.903392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e410ba-5908-4a4a-9e4b-392aa8b523d3 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:05.907384 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75149eb1-9579-49a7-b6df-3fea807e6193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:05.908339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75149eb1-9579-49a7-b6df-3fea807e6193 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:05.908895 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75149eb1-9579-49a7-b6df-3fea807e6193 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:05.909170 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75149eb1-9579-49a7-b6df-3fea807e6193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:05.921534 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75149eb1-9579-49a7-b6df-3fea807e6193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:05.923089 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75149eb1-9579-49a7-b6df-3fea807e6193 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:05.948255 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 919/1860] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:34:06.623592 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98647c0-bf3e-4236-829a-6917e3321bbe None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:06.625268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-a98647c0-bf3e-4236-829a-6917e3321bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:06.642647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98647c0-bf3e-4236-829a-6917e3321bbe None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:06.666628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86125403-df86-453f-84bf-150fd4c6c074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:06.667510 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86125403-df86-453f-84bf-150fd4c6c074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:06.667793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86125403-df86-453f-84bf-150fd4c6c074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:06.668070 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86125403-df86-453f-84bf-150fd4c6c074 admin admin] PATH_INFO: `/v3/projects/391f10f34dbe4f6c881696aa4b8ad3f2` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:06.673429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86125403-df86-453f-84bf-150fd4c6c074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=391f10f34dbe4f6c881696aa4b8ad3f2)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:06.675407 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86125403-df86-453f-84bf-150fd4c6c074 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:06.730302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-86125403-df86-453f-84bf-150fd4c6c074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '391f10f34dbe4f6c881696aa4b8ad3f2', 'request_id': 'req-86125403-df86-453f-84bf-150fd4c6c074'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:06.740757 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-86125403-df86-453f-84bf-150fd4c6c074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '391f10f34dbe4f6c881696aa4b8ad3f2', 'request_id': 'req-86125403-df86-453f-84bf-150fd4c6c074'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:06.745526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-86125403-df86-453f-84bf-150fd4c6c074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '391f10f34dbe4f6c881696aa4b8ad3f2', 'request_id': 'req-86125403-df86-453f-84bf-150fd4c6c074'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:06.761564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-86125403-df86-453f-84bf-150fd4c6c074 admin admin] The token cache is being invalidate because project 391f10f34dbe4f6c881696aa4b8ad3f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:34:06.761852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-86125403-df86-453f-84bf-150fd4c6c074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:06.762613 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-86125403-df86-453f-84bf-150fd4c6c074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:06.764214 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 942/1861] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:34:06 2022] DELETE /identity/v3/projects/391f10f34dbe4f6c881696aa4b8ad3f2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:06.768549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75149eb1-9579-49a7-b6df-3fea807e6193 service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:06.778580 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75149eb1-9579-49a7-b6df-3fea807e6193 service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:06.864361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bcd10-3d5f-485e-8449-13199bd25457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:06.865376 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bcd10-3d5f-485e-8449-13199bd25457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:06.865720 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bcd10-3d5f-485e-8449-13199bd25457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:06.866058 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bcd10-3d5f-485e-8449-13199bd25457 admin admin] PATH_INFO: `/v3/users/61e4ded9d650481f84dc339297b9ffa1` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:06.869370 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90bcd10-3d5f-485e-8449-13199bd25457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61e4ded9d650481f84dc339297b9ffa1)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:06.872400 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90bcd10-3d5f-485e-8449-13199bd25457 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:06.954547 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d90bcd10-3d5f-485e-8449-13199bd25457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61e4ded9d650481f84dc339297b9ffa1'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:06.963534 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d90bcd10-3d5f-485e-8449-13199bd25457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61e4ded9d650481f84dc339297b9ffa1'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:06.978416 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d90bcd10-3d5f-485e-8449-13199bd25457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61e4ded9d650481f84dc339297b9ffa1'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:06.979385 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d90bcd10-3d5f-485e-8449-13199bd25457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61e4ded9d650481f84dc339297b9ffa1'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:06.980459 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d90bcd10-3d5f-485e-8449-13199bd25457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61e4ded9d650481f84dc339297b9ffa1'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:07.032696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 920/1862] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:34:06 2022] DELETE /identity/v3/users/61e4ded9d650481f84dc339297b9ffa1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:07.528460 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86125403-df86-453f-84bf-150fd4c6c074 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:07.530133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-86125403-df86-453f-84bf-150fd4c6c074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:07.545309 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86125403-df86-453f-84bf-150fd4c6c074 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:07.617569 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf4fcf-27ed-4f91-95d6-4c47332b7d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:07.618516 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf4fcf-27ed-4f91-95d6-4c47332b7d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:07.618876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf4fcf-27ed-4f91-95d6-4c47332b7d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:07.619297 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf4fcf-27ed-4f91-95d6-4c47332b7d37 admin admin] PATH_INFO: `/v3/projects/938f0d4575c64da1b87ea1743f15f08f` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:07.620589 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf4fcf-27ed-4f91-95d6-4c47332b7d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=938f0d4575c64da1b87ea1743f15f08f)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:07.622632 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf4fcf-27ed-4f91-95d6-4c47332b7d37 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:07.679676 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-24bf4fcf-27ed-4f91-95d6-4c47332b7d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938f0d4575c64da1b87ea1743f15f08f', 'request_id': 'req-24bf4fcf-27ed-4f91-95d6-4c47332b7d37'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:07.688268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-24bf4fcf-27ed-4f91-95d6-4c47332b7d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938f0d4575c64da1b87ea1743f15f08f', 'request_id': 'req-24bf4fcf-27ed-4f91-95d6-4c47332b7d37'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:07.695574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-24bf4fcf-27ed-4f91-95d6-4c47332b7d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938f0d4575c64da1b87ea1743f15f08f', 'request_id': 'req-24bf4fcf-27ed-4f91-95d6-4c47332b7d37'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:07.710447 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-24bf4fcf-27ed-4f91-95d6-4c47332b7d37 admin admin] The token cache is being invalidate because project 938f0d4575c64da1b87ea1743f15f08f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:34:07.711149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-24bf4fcf-27ed-4f91-95d6-4c47332b7d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:07.712022 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-24bf4fcf-27ed-4f91-95d6-4c47332b7d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:07.713886 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 943/1863] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:34:07 2022] DELETE /identity/v3/projects/938f0d4575c64da1b87ea1743f15f08f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:07.719946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18fbec-f9e4-4d01-80ef-a52efd6c18af None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:07.720246 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18fbec-f9e4-4d01-80ef-a52efd6c18af None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:07.720515 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18fbec-f9e4-4d01-80ef-a52efd6c18af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:07.742206 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-da18fbec-f9e4-4d01-80ef-a52efd6c18af None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:07.743127 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-da18fbec-f9e4-4d01-80ef-a52efd6c18af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:07.829970 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 921/1864] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:34:07.838279 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd5248-458d-471d-b572-acce2416a197 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:07.838719 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd5248-458d-471d-b572-acce2416a197 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:07.838884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd5248-458d-471d-b572-acce2416a197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:07.862346 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-76cd5248-458d-471d-b572-acce2416a197 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:07.863565 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-76cd5248-458d-471d-b572-acce2416a197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:07.871949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 944/1865] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:07.876184 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18fbec-f9e4-4d01-80ef-a52efd6c18af None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:07.886537 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18fbec-f9e4-4d01-80ef-a52efd6c18af None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:07.892679 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d45c4-b7c7-4395-8681-77016ae8c420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:07.893644 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d45c4-b7c7-4395-8681-77016ae8c420 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:07.894194 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d45c4-b7c7-4395-8681-77016ae8c420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:07.894867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d45c4-b7c7-4395-8681-77016ae8c420 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:07.895799 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d45c4-b7c7-4395-8681-77016ae8c420 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:34:07.896292 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d45c4-b7c7-4395-8681-77016ae8c420 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:07.898502 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d45c4-b7c7-4395-8681-77016ae8c420 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:07.910486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 922/1866] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:34:07.915460 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd5248-458d-471d-b572-acce2416a197 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:07.925069 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd5248-458d-471d-b572-acce2416a197 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:07.930402 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fef27-f614-4cce-bc8c-1519cd6c6ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:07.931045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fef27-f614-4cce-bc8c-1519cd6c6ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:07.931322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fef27-f614-4cce-bc8c-1519cd6c6ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:07.931592 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fef27-f614-4cce-bc8c-1519cd6c6ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:07.932290 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fef27-f614-4cce-bc8c-1519cd6c6ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:07.934240 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fef27-f614-4cce-bc8c-1519cd6c6ea2 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:07.962341 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 945/1867] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:34:07 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:07.963428 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d45c4-b7c7-4395-8681-77016ae8c420 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:07.973823 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d45c4-b7c7-4395-8681-77016ae8c420 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:08.036863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468238cc-aed1-4dce-af58-f7b4fe7acdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:08.037531 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468238cc-aed1-4dce-af58-f7b4fe7acdca admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:08.037812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468238cc-aed1-4dce-af58-f7b4fe7acdca admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:08.038081 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468238cc-aed1-4dce-af58-f7b4fe7acdca admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:08.038792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468238cc-aed1-4dce-af58-f7b4fe7acdca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:08.040906 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468238cc-aed1-4dce-af58-f7b4fe7acdca admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:08.064638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 923/1868] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:34:07 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:34:08.068727 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fef27-f614-4cce-bc8c-1519cd6c6ea2 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:08.081852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fef27-f614-4cce-bc8c-1519cd6c6ea2 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:08.087087 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac6342-558e-44e5-a4a6-4ed0947b3720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:08.088394 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac6342-558e-44e5-a4a6-4ed0947b3720 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:08.088810 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac6342-558e-44e5-a4a6-4ed0947b3720 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:08.089292 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac6342-558e-44e5-a4a6-4ed0947b3720 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:08.090217 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac6342-558e-44e5-a4a6-4ed0947b3720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:08.091927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac6342-558e-44e5-a4a6-4ed0947b3720 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:08.108720 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468238cc-aed1-4dce-af58-f7b4fe7acdca admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:08.108916 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 946/1869] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:08.119630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468238cc-aed1-4dce-af58-f7b4fe7acdca admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:08.124776 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ed736-a44e-42dd-b794-47900aea8788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:08.125564 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ed736-a44e-42dd-b794-47900aea8788 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:08.125971 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ed736-a44e-42dd-b794-47900aea8788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:08.126346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ed736-a44e-42dd-b794-47900aea8788 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:08.127181 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ed736-a44e-42dd-b794-47900aea8788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:08.128935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ed736-a44e-42dd-b794-47900aea8788 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:08.140481 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 924/1870] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:08.144671 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac6342-558e-44e5-a4a6-4ed0947b3720 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:08.155562 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac6342-558e-44e5-a4a6-4ed0947b3720 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:08.163031 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec101a4d-1943-4cd5-9308-1fde0be338fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:08.164183 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec101a4d-1943-4cd5-9308-1fde0be338fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:08.164546 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec101a4d-1943-4cd5-9308-1fde0be338fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:08.164903 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec101a4d-1943-4cd5-9308-1fde0be338fc admin admin] PATH_INFO: `/v3/projects/d91efb815bca496f8f7a24c0cd5d411d/users/58e5db8662d049c58cd41212289c79a1/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:08.180444 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec101a4d-1943-4cd5-9308-1fde0be338fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91efb815bca496f8f7a24c0cd5d411d, user_id=58e5db8662d049c58cd41212289c79a1, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:08.183316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec101a4d-1943-4cd5-9308-1fde0be338fc admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:08.199727 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 947/1871] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:08 2022] PUT /identity/v3/projects/d91efb815bca496f8f7a24c0cd5d411d/users/58e5db8662d049c58cd41212289c79a1/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:08.213002 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5580d4-804a-4dc9-b5f4-ad3d8a09c23f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:08.213319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5580d4-804a-4dc9-b5f4-ad3d8a09c23f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:08.213717 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5580d4-804a-4dc9-b5f4-ad3d8a09c23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:08.243793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-7a5580d4-804a-4dc9-b5f4-ad3d8a09c23f None None] MFA Rules not processed for user `58e5db8662d049c58cd41212289c79a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:08.245075 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-7a5580d4-804a-4dc9-b5f4-ad3d8a09c23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:08.313820 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 925/1872] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:08.318164 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec101a4d-1943-4cd5-9308-1fde0be338fc admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:08.377580 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec101a4d-1943-4cd5-9308-1fde0be338fc admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:08.382210 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99519bc-f00f-4587-b0e1-cefe070d1683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:08.382862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99519bc-f00f-4587-b0e1-cefe070d1683 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:08.383146 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99519bc-f00f-4587-b0e1-cefe070d1683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:08.383421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99519bc-f00f-4587-b0e1-cefe070d1683 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:08.384107 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99519bc-f00f-4587-b0e1-cefe070d1683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:08.386043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99519bc-f00f-4587-b0e1-cefe070d1683 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:08.414056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 948/1873] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:34:08 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:08.415209 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5580d4-804a-4dc9-b5f4-ad3d8a09c23f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:08.425736 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5580d4-804a-4dc9-b5f4-ad3d8a09c23f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:08.482240 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69807ac7-b68c-4f4b-a0fb-da8c8db01180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:08.482910 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69807ac7-b68c-4f4b-a0fb-da8c8db01180 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:08.483187 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69807ac7-b68c-4f4b-a0fb-da8c8db01180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:08.483458 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69807ac7-b68c-4f4b-a0fb-da8c8db01180 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:08.484134 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69807ac7-b68c-4f4b-a0fb-da8c8db01180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:08.487124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69807ac7-b68c-4f4b-a0fb-da8c8db01180 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:08.508952 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 926/1874] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:34:08 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:08.513477 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99519bc-f00f-4587-b0e1-cefe070d1683 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:08.524646 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99519bc-f00f-4587-b0e1-cefe070d1683 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:08.529258 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d2680-1951-47e1-8da3-2fce834be998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:08.529916 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d2680-1951-47e1-8da3-2fce834be998 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:08.530198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d2680-1951-47e1-8da3-2fce834be998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:08.530474 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d2680-1951-47e1-8da3-2fce834be998 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:08.531200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d2680-1951-47e1-8da3-2fce834be998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:08.532831 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d2680-1951-47e1-8da3-2fce834be998 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:08.543668 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 949/1875] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:08.547742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69807ac7-b68c-4f4b-a0fb-da8c8db01180 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:08.559670 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69807ac7-b68c-4f4b-a0fb-da8c8db01180 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:08.565560 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97d2b6-128b-4aad-aa56-d1ff065c66e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:08.566230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97d2b6-128b-4aad-aa56-d1ff065c66e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:08.566509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97d2b6-128b-4aad-aa56-d1ff065c66e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:08.566781 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97d2b6-128b-4aad-aa56-d1ff065c66e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:08.567508 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97d2b6-128b-4aad-aa56-d1ff065c66e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:08.569144 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97d2b6-128b-4aad-aa56-d1ff065c66e0 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:08.583468 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 927/1876] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:08.587866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d2680-1951-47e1-8da3-2fce834be998 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:08.597979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d2680-1951-47e1-8da3-2fce834be998 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:08.603244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24910420-3f96-4294-8d2d-8560d22bc19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:08.604247 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24910420-3f96-4294-8d2d-8560d22bc19b admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:08.604586 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24910420-3f96-4294-8d2d-8560d22bc19b admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:08.604839 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24910420-3f96-4294-8d2d-8560d22bc19b admin admin] PATH_INFO: `/v3/projects/78bf5c4f93a64acdb609daa256349d0e/users/096f47e7a3b44d549a01d203b2fd5d22/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:08.621649 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24910420-3f96-4294-8d2d-8560d22bc19b admin admin] RBAC: Authorizing `identity:create_grant(project_id=78bf5c4f93a64acdb609daa256349d0e, user_id=096f47e7a3b44d549a01d203b2fd5d22, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:08.624323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24910420-3f96-4294-8d2d-8560d22bc19b admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:08.637605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 950/1877] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:08 2022] PUT /identity/v3/projects/78bf5c4f93a64acdb609daa256349d0e/users/096f47e7a3b44d549a01d203b2fd5d22/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:08.647606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f484f56-01de-402e-a1d5-5f61569b9bc7 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:08.648003 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f484f56-01de-402e-a1d5-5f61569b9bc7 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:08.648288 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f484f56-01de-402e-a1d5-5f61569b9bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:08.673787 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-1f484f56-01de-402e-a1d5-5f61569b9bc7 None None] MFA Rules not processed for user `096f47e7a3b44d549a01d203b2fd5d22`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:08.674974 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-1f484f56-01de-402e-a1d5-5f61569b9bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:08.735355 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 928/1878] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:08.739668 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24910420-3f96-4294-8d2d-8560d22bc19b admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:08.800066 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24910420-3f96-4294-8d2d-8560d22bc19b admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:08.805176 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abce11d-36f3-4671-97ef-562787b12df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:08.805868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abce11d-36f3-4671-97ef-562787b12df2 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:08.806150 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abce11d-36f3-4671-97ef-562787b12df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:08.806417 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abce11d-36f3-4671-97ef-562787b12df2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:08.807108 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abce11d-36f3-4671-97ef-562787b12df2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:08.809035 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abce11d-36f3-4671-97ef-562787b12df2 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:08.834154 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 951/1879] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:34:08 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:08.838110 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f484f56-01de-402e-a1d5-5f61569b9bc7 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:08.850006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f484f56-01de-402e-a1d5-5f61569b9bc7 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:08.911527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf011a-84b2-4e8a-a0d7-8dd15a46e738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:08.912197 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf011a-84b2-4e8a-a0d7-8dd15a46e738 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:08.912480 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf011a-84b2-4e8a-a0d7-8dd15a46e738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:08.912781 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf011a-84b2-4e8a-a0d7-8dd15a46e738 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:08.913493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf011a-84b2-4e8a-a0d7-8dd15a46e738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:08.915447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf011a-84b2-4e8a-a0d7-8dd15a46e738 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:08.939363 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 929/1880] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:34:08 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:08.940990 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abce11d-36f3-4671-97ef-562787b12df2 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:08.952178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abce11d-36f3-4671-97ef-562787b12df2 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:08.957577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cda37-cf08-47d5-802e-ed0c752ad2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:08.958234 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cda37-cf08-47d5-802e-ed0c752ad2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:08.958510 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cda37-cf08-47d5-802e-ed0c752ad2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:08.958778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cda37-cf08-47d5-802e-ed0c752ad2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:08.959499 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cda37-cf08-47d5-802e-ed0c752ad2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:08.961191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cda37-cf08-47d5-802e-ed0c752ad2a1 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:08.971602 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 952/1881] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:08.976182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf011a-84b2-4e8a-a0d7-8dd15a46e738 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:08.985935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf011a-84b2-4e8a-a0d7-8dd15a46e738 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:08.990442 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36ad2b-6bdb-45b3-8cd5-d23d7a25116d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:08.991317 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36ad2b-6bdb-45b3-8cd5-d23d7a25116d admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:08.992114 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36ad2b-6bdb-45b3-8cd5-d23d7a25116d admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:08.992386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36ad2b-6bdb-45b3-8cd5-d23d7a25116d admin admin] PATH_INFO: `/v3/projects/e4ae0a0b7f384759b3c6ddb3d7dc636e/users/71f030a374bd4f26958c442a23c68f4c/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:09.006741 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36ad2b-6bdb-45b3-8cd5-d23d7a25116d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4ae0a0b7f384759b3c6ddb3d7dc636e, user_id=71f030a374bd4f26958c442a23c68f4c, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:09.009611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36ad2b-6bdb-45b3-8cd5-d23d7a25116d admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:09.021955 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 930/1882] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:08 2022] PUT /identity/v3/projects/e4ae0a0b7f384759b3c6ddb3d7dc636e/users/71f030a374bd4f26958c442a23c68f4c/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:09.026416 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cda37-cf08-47d5-802e-ed0c752ad2a1 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:09.036117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cda37-cf08-47d5-802e-ed0c752ad2a1 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:09.090829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6f87f-f296-47cc-bc58-4cff557bdb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:09.091513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6f87f-f296-47cc-bc58-4cff557bdb75 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:09.091766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6f87f-f296-47cc-bc58-4cff557bdb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:09.092035 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6f87f-f296-47cc-bc58-4cff557bdb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:09.092848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6f87f-f296-47cc-bc58-4cff557bdb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:09.094434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6f87f-f296-47cc-bc58-4cff557bdb75 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:09.105019 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 953/1883] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:09.109113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36ad2b-6bdb-45b3-8cd5-d23d7a25116d admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:09.119120 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36ad2b-6bdb-45b3-8cd5-d23d7a25116d admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:09.123699 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d581eb3-fe40-436d-b203-566ca0fdb2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:09.124582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d581eb3-fe40-436d-b203-566ca0fdb2c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:09.124862 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d581eb3-fe40-436d-b203-566ca0fdb2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:09.125135 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d581eb3-fe40-436d-b203-566ca0fdb2c5 admin admin] PATH_INFO: `/v3/projects/e4ae0a0b7f384759b3c6ddb3d7dc636e/users/71f030a374bd4f26958c442a23c68f4c/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:09.127074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d581eb3-fe40-436d-b203-566ca0fdb2c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4ae0a0b7f384759b3c6ddb3d7dc636e, user_id=71f030a374bd4f26958c442a23c68f4c, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:09.129766 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d581eb3-fe40-436d-b203-566ca0fdb2c5 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:09.139386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 931/1884] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:09 2022] PUT /identity/v3/projects/e4ae0a0b7f384759b3c6ddb3d7dc636e/users/71f030a374bd4f26958c442a23c68f4c/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:09.149615 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bc99f-5bd2-48d4-a518-37ce6e541258 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:09.149898 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bc99f-5bd2-48d4-a518-37ce6e541258 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:09.150170 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bc99f-5bd2-48d4-a518-37ce6e541258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:09.175945 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-087bc99f-5bd2-48d4-a518-37ce6e541258 None None] MFA Rules not processed for user `71f030a374bd4f26958c442a23c68f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:09.177226 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-087bc99f-5bd2-48d4-a518-37ce6e541258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:09.242007 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 954/1885] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:09.253542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d581eb3-fe40-436d-b203-566ca0fdb2c5 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:09.255188 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-7d581eb3-fe40-436d-b203-566ca0fdb2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:09.309257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d581eb3-fe40-436d-b203-566ca0fdb2c5 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:09.312855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6f939-a319-405a-8223-cff97d10d3c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:09.313482 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6f939-a319-405a-8223-cff97d10d3c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:09.313757 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6f939-a319-405a-8223-cff97d10d3c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:09.314070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6f939-a319-405a-8223-cff97d10d3c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:09.372515 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6f939-a319-405a-8223-cff97d10d3c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:09.374008 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6f939-a319-405a-8223-cff97d10d3c7 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:09.383551 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 932/1886] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:34:10.675849 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bc99f-5bd2-48d4-a518-37ce6e541258 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:10.677367 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-087bc99f-5bd2-48d4-a518-37ce6e541258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:10.773391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bc99f-5bd2-48d4-a518-37ce6e541258 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:10.779529 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca0295-417d-4228-aa30-3e5dd6613bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:10.780716 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca0295-417d-4228-aa30-3e5dd6613bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:10.781094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca0295-417d-4228-aa30-3e5dd6613bde admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:10.781575 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca0295-417d-4228-aa30-3e5dd6613bde admin admin] PATH_INFO: `/v3/users/df3102b83a2c42c5b9f1fc642e09cd44` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:10.783037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca0295-417d-4228-aa30-3e5dd6613bde admin admin] RBAC: Authorizing `identity:delete_user(user_id=df3102b83a2c42c5b9f1fc642e09cd44)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:10.785113 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca0295-417d-4228-aa30-3e5dd6613bde admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:10.839773 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2bca0295-417d-4228-aa30-3e5dd6613bde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df3102b83a2c42c5b9f1fc642e09cd44'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:10.848145 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2bca0295-417d-4228-aa30-3e5dd6613bde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df3102b83a2c42c5b9f1fc642e09cd44'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:10.848865 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2bca0295-417d-4228-aa30-3e5dd6613bde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df3102b83a2c42c5b9f1fc642e09cd44'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:10.857481 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2bca0295-417d-4228-aa30-3e5dd6613bde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df3102b83a2c42c5b9f1fc642e09cd44'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:10.858303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2bca0295-417d-4228-aa30-3e5dd6613bde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df3102b83a2c42c5b9f1fc642e09cd44'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:10.876788 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 955/1887] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:34:10 2022] DELETE /identity/v3/users/df3102b83a2c42c5b9f1fc642e09cd44 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:10.881229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c41072-6c07-48d3-ad36-bc5884bd855f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:10.881664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c41072-6c07-48d3-ad36-bc5884bd855f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:10.881910 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c41072-6c07-48d3-ad36-bc5884bd855f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:10.901173 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-06c41072-6c07-48d3-ad36-bc5884bd855f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:10.902431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-06c41072-6c07-48d3-ad36-bc5884bd855f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:10.986831 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca0295-417d-4228-aa30-3e5dd6613bde admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:10.986831 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-2bca0295-417d-4228-aa30-3e5dd6613bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:10.987002 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 933/1888] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:10.996305 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c41072-6c07-48d3-ad36-bc5884bd855f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:10.997875 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-06c41072-6c07-48d3-ad36-bc5884bd855f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:11.039776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca0295-417d-4228-aa30-3e5dd6613bde admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:11.044100 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e81fc-18dd-4709-8850-3fd79a1c01f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:11.044887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e81fc-18dd-4709-8850-3fd79a1c01f6 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:11.045245 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e81fc-18dd-4709-8850-3fd79a1c01f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:11.045591 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e81fc-18dd-4709-8850-3fd79a1c01f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:11.047629 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-af2e81fc-18dd-4709-8850-3fd79a1c01f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:11.082777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c41072-6c07-48d3-ad36-bc5884bd855f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:11.086333 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a0f9b-fa2c-4c46-806d-a1b9818a9ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:11.087110 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a0f9b-fa2c-4c46-806d-a1b9818a9ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:11.087393 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a0f9b-fa2c-4c46-806d-a1b9818a9ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:11.087696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a0f9b-fa2c-4c46-806d-a1b9818a9ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:11.097210 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a0f9b-fa2c-4c46-806d-a1b9818a9ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:11.099587 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a0f9b-fa2c-4c46-806d-a1b9818a9ad1 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:11.108993 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 934/1889] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:34:11.116903 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e81fc-18dd-4709-8850-3fd79a1c01f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:11.117761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e81fc-18dd-4709-8850-3fd79a1c01f6 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:11.127061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 956/1890] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:34:11.675685 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a0f9b-fa2c-4c46-806d-a1b9818a9ad1 service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:11.677786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-0d5a0f9b-fa2c-4c46-806d-a1b9818a9ad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:11.692898 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a0f9b-fa2c-4c46-806d-a1b9818a9ad1 service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:11.701403 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f658301-169b-49ec-b9ea-f949bc641623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:11.702426 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f658301-169b-49ec-b9ea-f949bc641623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:11.702871 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f658301-169b-49ec-b9ea-f949bc641623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:11.703297 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f658301-169b-49ec-b9ea-f949bc641623 admin admin] PATH_INFO: `/v3/projects/c8e6483a65344160b9b9ed9b14832017` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:11.704793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f658301-169b-49ec-b9ea-f949bc641623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e6483a65344160b9b9ed9b14832017)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:11.707167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f658301-169b-49ec-b9ea-f949bc641623 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:11.772779 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-0f658301-169b-49ec-b9ea-f949bc641623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e6483a65344160b9b9ed9b14832017', 'request_id': 'req-0f658301-169b-49ec-b9ea-f949bc641623'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:11.783760 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e81fc-18dd-4709-8850-3fd79a1c01f6 service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:11.788128 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-0f658301-169b-49ec-b9ea-f949bc641623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e6483a65344160b9b9ed9b14832017', 'request_id': 'req-0f658301-169b-49ec-b9ea-f949bc641623'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:11.796191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e81fc-18dd-4709-8850-3fd79a1c01f6 service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:11.796385 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-0f658301-169b-49ec-b9ea-f949bc641623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e6483a65344160b9b9ed9b14832017', 'request_id': 'req-0f658301-169b-49ec-b9ea-f949bc641623'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:11.817403 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-0f658301-169b-49ec-b9ea-f949bc641623 admin admin] The token cache is being invalidate because project c8e6483a65344160b9b9ed9b14832017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:34:11.817867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-0f658301-169b-49ec-b9ea-f949bc641623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:11.818855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-0f658301-169b-49ec-b9ea-f949bc641623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:11.825349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 935/1891] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:34:11 2022] DELETE /identity/v3/projects/c8e6483a65344160b9b9ed9b14832017 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:11.829027 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f658301-169b-49ec-b9ea-f949bc641623 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:11.830787 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-0f658301-169b-49ec-b9ea-f949bc641623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:11.905427 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf85f7-8d48-43ea-983f-3d938222abad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:11.906240 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf85f7-8d48-43ea-983f-3d938222abad service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:11.906622 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf85f7-8d48-43ea-983f-3d938222abad service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:11.907028 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf85f7-8d48-43ea-983f-3d938222abad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:11.910055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-43cf85f7-8d48-43ea-983f-3d938222abad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:11.957912 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f658301-169b-49ec-b9ea-f949bc641623 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:11.973169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bd057-ef0e-410e-a206-f727c0d1cf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:11.974223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bd057-ef0e-410e-a206-f727c0d1cf78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:11.974593 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bd057-ef0e-410e-a206-f727c0d1cf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:11.974946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bd057-ef0e-410e-a206-f727c0d1cf78 admin admin] PATH_INFO: `/v3/users/21549a0209514352b70c0988c3730167` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:11.977331 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bd057-ef0e-410e-a206-f727c0d1cf78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21549a0209514352b70c0988c3730167)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:11.979404 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bd057-ef0e-410e-a206-f727c0d1cf78 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:12.028227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf85f7-8d48-43ea-983f-3d938222abad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:12.030156 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf85f7-8d48-43ea-983f-3d938222abad service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:12.060722 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 957/1892] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:34:12.071679 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-524bd057-ef0e-410e-a206-f727c0d1cf78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21549a0209514352b70c0988c3730167'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:12.086800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-524bd057-ef0e-410e-a206-f727c0d1cf78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21549a0209514352b70c0988c3730167'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:12.102468 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-524bd057-ef0e-410e-a206-f727c0d1cf78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21549a0209514352b70c0988c3730167'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:12.103734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-524bd057-ef0e-410e-a206-f727c0d1cf78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21549a0209514352b70c0988c3730167'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:12.104834 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-524bd057-ef0e-410e-a206-f727c0d1cf78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21549a0209514352b70c0988c3730167'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:12.156854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 936/1893] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:34:11 2022] DELETE /identity/v3/users/21549a0209514352b70c0988c3730167 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:12.535404 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf85f7-8d48-43ea-983f-3d938222abad service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:12.546965 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf85f7-8d48-43ea-983f-3d938222abad service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:12.612676 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cb479-d138-415f-9540-24316947735d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:12.613718 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cb479-d138-415f-9540-24316947735d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:12.614067 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cb479-d138-415f-9540-24316947735d admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:12.614406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cb479-d138-415f-9540-24316947735d admin admin] PATH_INFO: `/v3/projects/1e54c1ed93f645a3bdc3d5f93cfdbd90` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:12.615692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cb479-d138-415f-9540-24316947735d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e54c1ed93f645a3bdc3d5f93cfdbd90)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:12.618428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cb479-d138-415f-9540-24316947735d admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:12.665373 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6e8cb479-d138-415f-9540-24316947735d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e54c1ed93f645a3bdc3d5f93cfdbd90', 'request_id': 'req-6e8cb479-d138-415f-9540-24316947735d'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:12.671488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6e8cb479-d138-415f-9540-24316947735d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e54c1ed93f645a3bdc3d5f93cfdbd90', 'request_id': 'req-6e8cb479-d138-415f-9540-24316947735d'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:12.676692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6e8cb479-d138-415f-9540-24316947735d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e54c1ed93f645a3bdc3d5f93cfdbd90', 'request_id': 'req-6e8cb479-d138-415f-9540-24316947735d'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:12.689579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6e8cb479-d138-415f-9540-24316947735d admin admin] The token cache is being invalidate because project 1e54c1ed93f645a3bdc3d5f93cfdbd90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:34:12.689863 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6e8cb479-d138-415f-9540-24316947735d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:12.690543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6e8cb479-d138-415f-9540-24316947735d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:12.692226 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 958/1894] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:34:12 2022] DELETE /identity/v3/projects/1e54c1ed93f645a3bdc3d5f93cfdbd90 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:34:12.698025 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffcb56-26f8-413e-8c1d-2770590769b2 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:12.698310 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffcb56-26f8-413e-8c1d-2770590769b2 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:12.698745 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffcb56-26f8-413e-8c1d-2770590769b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:12.716402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-25ffcb56-26f8-413e-8c1d-2770590769b2 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:12.718990 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-25ffcb56-26f8-413e-8c1d-2770590769b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:12.783793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 937/1895] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:12.791881 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8ed9c-1688-40d8-825c-beaaed419325 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:12.792339 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8ed9c-1688-40d8-825c-beaaed419325 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:12.792454 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8ed9c-1688-40d8-825c-beaaed419325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:12.810681 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-5aa8ed9c-1688-40d8-825c-beaaed419325 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:12.811859 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-5aa8ed9c-1688-40d8-825c-beaaed419325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:12.820378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 959/1896] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:12.824674 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ffcb56-26f8-413e-8c1d-2770590769b2 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:12.834232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ffcb56-26f8-413e-8c1d-2770590769b2 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:12.838899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075cfe9-f986-465a-80a4-9052a7ace6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:12.839549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075cfe9-f986-465a-80a4-9052a7ace6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:12.839829 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075cfe9-f986-465a-80a4-9052a7ace6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:12.840101 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075cfe9-f986-465a-80a4-9052a7ace6e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:12.840852 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075cfe9-f986-465a-80a4-9052a7ace6e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:34:12.841159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075cfe9-f986-465a-80a4-9052a7ace6e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:12.842771 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075cfe9-f986-465a-80a4-9052a7ace6e4 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:12.854383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 938/1897] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:34:12.858724 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8ed9c-1688-40d8-825c-beaaed419325 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:12.868289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8ed9c-1688-40d8-825c-beaaed419325 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:12.872823 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0855c0-5a10-49f7-8728-8c01ce2cabd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:12.873458 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0855c0-5a10-49f7-8728-8c01ce2cabd5 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:12.873737 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0855c0-5a10-49f7-8728-8c01ce2cabd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:12.874011 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0855c0-5a10-49f7-8728-8c01ce2cabd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:12.874708 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0855c0-5a10-49f7-8728-8c01ce2cabd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:12.876623 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0855c0-5a10-49f7-8728-8c01ce2cabd5 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:12.901412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 960/1898] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:34:12 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:12.905479 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075cfe9-f986-465a-80a4-9052a7ace6e4 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:12.915628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075cfe9-f986-465a-80a4-9052a7ace6e4 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:12.969618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6923c76-2295-41fc-8e76-0793875dce9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:12.970278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6923c76-2295-41fc-8e76-0793875dce9c admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:12.970562 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6923c76-2295-41fc-8e76-0793875dce9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:12.970840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6923c76-2295-41fc-8e76-0793875dce9c admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:12.971519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6923c76-2295-41fc-8e76-0793875dce9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:12.973733 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6923c76-2295-41fc-8e76-0793875dce9c admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:12.993894 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 939/1899] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:34:12 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:34:12.997879 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0855c0-5a10-49f7-8728-8c01ce2cabd5 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:13.008003 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0855c0-5a10-49f7-8728-8c01ce2cabd5 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:13.012447 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024250da-7af0-47a7-a5d8-fb63178ce828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:13.013121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024250da-7af0-47a7-a5d8-fb63178ce828 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:13.013397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024250da-7af0-47a7-a5d8-fb63178ce828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:13.013665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024250da-7af0-47a7-a5d8-fb63178ce828 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:13.014379 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024250da-7af0-47a7-a5d8-fb63178ce828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:13.015960 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024250da-7af0-47a7-a5d8-fb63178ce828 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:13.026289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 961/1900] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:13.029916 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6923c76-2295-41fc-8e76-0793875dce9c admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:13.039927 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6923c76-2295-41fc-8e76-0793875dce9c admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:13.044435 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3895a-5fb7-4459-bb50-3639d89a4b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:13.045104 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3895a-5fb7-4459-bb50-3639d89a4b3d admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:13.045383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3895a-5fb7-4459-bb50-3639d89a4b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:13.045653 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3895a-5fb7-4459-bb50-3639d89a4b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:13.046358 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3895a-5fb7-4459-bb50-3639d89a4b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:13.047936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3895a-5fb7-4459-bb50-3639d89a4b3d admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:13.058105 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 940/1901] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:13.062212 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024250da-7af0-47a7-a5d8-fb63178ce828 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:13.073981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024250da-7af0-47a7-a5d8-fb63178ce828 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:13.081252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da27de-2dbe-4972-8338-c8404c1bc277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:13.082200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da27de-2dbe-4972-8338-c8404c1bc277 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:13.082478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da27de-2dbe-4972-8338-c8404c1bc277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:13.082750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da27de-2dbe-4972-8338-c8404c1bc277 admin admin] PATH_INFO: `/v3/projects/edee035c7a024ee38f791a44cfdc4845/users/14eb1408b79a4f1c8b68fa2b16954aa5/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:13.099280 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da27de-2dbe-4972-8338-c8404c1bc277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edee035c7a024ee38f791a44cfdc4845, user_id=14eb1408b79a4f1c8b68fa2b16954aa5, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:13.102503 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da27de-2dbe-4972-8338-c8404c1bc277 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:13.114993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 962/1902] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:13 2022] PUT /identity/v3/projects/edee035c7a024ee38f791a44cfdc4845/users/14eb1408b79a4f1c8b68fa2b16954aa5/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:13.126516 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dc924-4354-44cd-b6c9-edfbda7b00fe None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:13.126745 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dc924-4354-44cd-b6c9-edfbda7b00fe None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:13.127025 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dc924-4354-44cd-b6c9-edfbda7b00fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:13.153441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-444dc924-4354-44cd-b6c9-edfbda7b00fe None None] MFA Rules not processed for user `14eb1408b79a4f1c8b68fa2b16954aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:13.154693 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-444dc924-4354-44cd-b6c9-edfbda7b00fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:13.229339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 941/1903] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:13.242252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da27de-2dbe-4972-8338-c8404c1bc277 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:13.244191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-30da27de-2dbe-4972-8338-c8404c1bc277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:13.308478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da27de-2dbe-4972-8338-c8404c1bc277 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:13.313214 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e420c-c7ab-4899-a181-45588173c48e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:13.313867 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e420c-c7ab-4899-a181-45588173c48e service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:13.314150 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e420c-c7ab-4899-a181-45588173c48e service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:13.314427 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e420c-c7ab-4899-a181-45588173c48e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:13.325062 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e420c-c7ab-4899-a181-45588173c48e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:13.326644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e420c-c7ab-4899-a181-45588173c48e service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:13.339175 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 963/1904] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:34:13.362523 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dc924-4354-44cd-b6c9-edfbda7b00fe None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:13.438979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dc924-4354-44cd-b6c9-edfbda7b00fe None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:13.443576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb35501-f007-4125-9387-f70576119760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:13.444464 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb35501-f007-4125-9387-f70576119760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:13.445307 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb35501-f007-4125-9387-f70576119760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:13.445581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb35501-f007-4125-9387-f70576119760 admin admin] PATH_INFO: `/v3/users/14eb1408b79a4f1c8b68fa2b16954aa5` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:13.446786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb35501-f007-4125-9387-f70576119760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14eb1408b79a4f1c8b68fa2b16954aa5)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:13.448748 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb35501-f007-4125-9387-f70576119760 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:13.496660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-edb35501-f007-4125-9387-f70576119760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14eb1408b79a4f1c8b68fa2b16954aa5'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:13.509553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-edb35501-f007-4125-9387-f70576119760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14eb1408b79a4f1c8b68fa2b16954aa5'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:13.517802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-edb35501-f007-4125-9387-f70576119760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14eb1408b79a4f1c8b68fa2b16954aa5'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:13.518722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-edb35501-f007-4125-9387-f70576119760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14eb1408b79a4f1c8b68fa2b16954aa5'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:13.520493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-edb35501-f007-4125-9387-f70576119760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14eb1408b79a4f1c8b68fa2b16954aa5'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:13.538201 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 942/1905] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:34:13 2022] DELETE /identity/v3/users/14eb1408b79a4f1c8b68fa2b16954aa5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:13.543094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ce0b0-b304-4efb-9950-5050efc4ebb9 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:13.543384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ce0b0-b304-4efb-9950-5050efc4ebb9 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:13.543664 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ce0b0-b304-4efb-9950-5050efc4ebb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:13.562916 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-154ce0b0-b304-4efb-9950-5050efc4ebb9 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:13.564556 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-154ce0b0-b304-4efb-9950-5050efc4ebb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:13.627934 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 964/1906] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:34:13.638379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb35501-f007-4125-9387-f70576119760 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:13.639809 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-edb35501-f007-4125-9387-f70576119760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:13.706284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb35501-f007-4125-9387-f70576119760 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:13.710224 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1244c-a67d-4df5-81d2-372a167ec05e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:13.710875 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1244c-a67d-4df5-81d2-372a167ec05e service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:13.711152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1244c-a67d-4df5-81d2-372a167ec05e service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:13.711422 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1244c-a67d-4df5-81d2-372a167ec05e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:13.720935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1244c-a67d-4df5-81d2-372a167ec05e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:13.722383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1244c-a67d-4df5-81d2-372a167ec05e service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:13.732862 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 943/1907] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:34:13.997986 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ce0b0-b304-4efb-9950-5050efc4ebb9 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:13.999423 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-154ce0b0-b304-4efb-9950-5050efc4ebb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:14.014150 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ce0b0-b304-4efb-9950-5050efc4ebb9 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:14.020027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f865b7-d896-493b-8b4d-202ce9b91e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:14.021382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f865b7-d896-493b-8b4d-202ce9b91e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:14.021382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f865b7-d896-493b-8b4d-202ce9b91e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:14.022495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f865b7-d896-493b-8b4d-202ce9b91e74 admin admin] PATH_INFO: `/v3/projects/edee035c7a024ee38f791a44cfdc4845` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:14.023152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f865b7-d896-493b-8b4d-202ce9b91e74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edee035c7a024ee38f791a44cfdc4845)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:14.025230 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f865b7-d896-493b-8b4d-202ce9b91e74 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:14.077327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-77f865b7-d896-493b-8b4d-202ce9b91e74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edee035c7a024ee38f791a44cfdc4845', 'request_id': 'req-77f865b7-d896-493b-8b4d-202ce9b91e74'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:14.084077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-77f865b7-d896-493b-8b4d-202ce9b91e74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edee035c7a024ee38f791a44cfdc4845', 'request_id': 'req-77f865b7-d896-493b-8b4d-202ce9b91e74'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:14.089921 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-77f865b7-d896-493b-8b4d-202ce9b91e74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edee035c7a024ee38f791a44cfdc4845', 'request_id': 'req-77f865b7-d896-493b-8b4d-202ce9b91e74'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:14.102401 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-77f865b7-d896-493b-8b4d-202ce9b91e74 admin admin] The token cache is being invalidate because project edee035c7a024ee38f791a44cfdc4845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:34:14.102712 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-77f865b7-d896-493b-8b4d-202ce9b91e74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:14.103343 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-77f865b7-d896-493b-8b4d-202ce9b91e74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:14.104969 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 965/1908] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:34:13 2022] DELETE /identity/v3/projects/edee035c7a024ee38f791a44cfdc4845 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:14.109857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a86d0-f95f-4893-a8cb-a747e3022530 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:14.110307 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a86d0-f95f-4893-a8cb-a747e3022530 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:14.110395 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a86d0-f95f-4893-a8cb-a747e3022530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:14.127520 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-3d8a86d0-f95f-4893-a8cb-a747e3022530 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:14.128752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-3d8a86d0-f95f-4893-a8cb-a747e3022530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:14.186871 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 944/1909] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:14.195216 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aee333-44b6-45b9-b6ac-540279ec0d3e None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:14.195509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aee333-44b6-45b9-b6ac-540279ec0d3e None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:14.195788 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aee333-44b6-45b9-b6ac-540279ec0d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:14.213648 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-93aee333-44b6-45b9-b6ac-540279ec0d3e None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:14.214862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-93aee333-44b6-45b9-b6ac-540279ec0d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:14.223225 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 966/1910] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:14.227428 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a86d0-f95f-4893-a8cb-a747e3022530 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:14.237583 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a86d0-f95f-4893-a8cb-a747e3022530 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:14.242996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746693d-83df-4167-b107-cce53eebb2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:14.243666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746693d-83df-4167-b107-cce53eebb2cb admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:14.243949 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746693d-83df-4167-b107-cce53eebb2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:14.244420 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746693d-83df-4167-b107-cce53eebb2cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:14.245238 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746693d-83df-4167-b107-cce53eebb2cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:34:14.245560 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746693d-83df-4167-b107-cce53eebb2cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:14.247250 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746693d-83df-4167-b107-cce53eebb2cb admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:14.263949 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 945/1911] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:34:14.265180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aee333-44b6-45b9-b6ac-540279ec0d3e None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:14.275894 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aee333-44b6-45b9-b6ac-540279ec0d3e None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:14.280882 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305b906-3dcf-4b19-82c5-b3f84a0b6d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:14.281572 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305b906-3dcf-4b19-82c5-b3f84a0b6d25 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:14.281854 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305b906-3dcf-4b19-82c5-b3f84a0b6d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:14.282133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305b906-3dcf-4b19-82c5-b3f84a0b6d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:14.282873 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305b906-3dcf-4b19-82c5-b3f84a0b6d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:14.284950 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305b906-3dcf-4b19-82c5-b3f84a0b6d25 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:14.316279 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 967/1912] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:34:14 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:14.317584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746693d-83df-4167-b107-cce53eebb2cb admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:14.332380 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746693d-83df-4167-b107-cce53eebb2cb admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:14.414579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d913e-ba2d-457c-9ea8-6e14a270c83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:14.415251 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d913e-ba2d-457c-9ea8-6e14a270c83c admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:14.415529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d913e-ba2d-457c-9ea8-6e14a270c83c admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:14.415802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d913e-ba2d-457c-9ea8-6e14a270c83c admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:14.416522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d913e-ba2d-457c-9ea8-6e14a270c83c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:14.418483 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d913e-ba2d-457c-9ea8-6e14a270c83c admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:14.446372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 946/1913] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:34:14 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:14.447605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305b906-3dcf-4b19-82c5-b3f84a0b6d25 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:14.460906 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305b906-3dcf-4b19-82c5-b3f84a0b6d25 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:14.467546 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd825aee-78fd-4913-9f3d-f56787844dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:14.468222 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd825aee-78fd-4913-9f3d-f56787844dbf admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:14.468507 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd825aee-78fd-4913-9f3d-f56787844dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:14.468999 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd825aee-78fd-4913-9f3d-f56787844dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:14.470231 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd825aee-78fd-4913-9f3d-f56787844dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:14.472982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd825aee-78fd-4913-9f3d-f56787844dbf admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:14.490218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 968/1914] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:34:14.494123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d913e-ba2d-457c-9ea8-6e14a270c83c admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:14.505251 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d913e-ba2d-457c-9ea8-6e14a270c83c admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:14.511977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54a8df-2c52-4411-bb19-5b1c285dba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:14.512908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54a8df-2c52-4411-bb19-5b1c285dba4a admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:14.513377 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54a8df-2c52-4411-bb19-5b1c285dba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:14.513833 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54a8df-2c52-4411-bb19-5b1c285dba4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:14.514760 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54a8df-2c52-4411-bb19-5b1c285dba4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:14.516593 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54a8df-2c52-4411-bb19-5b1c285dba4a admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:14.529581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 947/1915] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:14.534446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd825aee-78fd-4913-9f3d-f56787844dbf admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:14.544868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd825aee-78fd-4913-9f3d-f56787844dbf admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:14.551494 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d71f5-4f94-4e59-b017-1001226e458d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:14.552712 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d71f5-4f94-4e59-b017-1001226e458d admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:14.553237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d71f5-4f94-4e59-b017-1001226e458d admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:14.553869 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d71f5-4f94-4e59-b017-1001226e458d admin admin] PATH_INFO: `/v3/projects/aaefe79114294546850dbb5643052c04/users/48f6cd0e160b4e18a649c6b9daa48e0b/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:14.572949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d71f5-4f94-4e59-b017-1001226e458d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaefe79114294546850dbb5643052c04, user_id=48f6cd0e160b4e18a649c6b9daa48e0b, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:14.575639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d71f5-4f94-4e59-b017-1001226e458d admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:14.617558 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 969/1916] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:14 2022] PUT /identity/v3/projects/aaefe79114294546850dbb5643052c04/users/48f6cd0e160b4e18a649c6b9daa48e0b/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:14.627549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08b98b-2d7c-4f85-bdc4-ccdb691e2158 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:14.627868 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08b98b-2d7c-4f85-bdc4-ccdb691e2158 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:14.628149 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08b98b-2d7c-4f85-bdc4-ccdb691e2158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:14.667029 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-9e08b98b-2d7c-4f85-bdc4-ccdb691e2158 None None] MFA Rules not processed for user `48f6cd0e160b4e18a649c6b9daa48e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:14.668343 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9e08b98b-2d7c-4f85-bdc4-ccdb691e2158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:14.742723 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 948/1917] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:34:14.753661 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d71f5-4f94-4e59-b017-1001226e458d admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:14.755358 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-1b5d71f5-4f94-4e59-b017-1001226e458d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:14.818002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d71f5-4f94-4e59-b017-1001226e458d admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:14.822765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c3249-5591-46b4-8119-cda36278e526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:14.828304 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c3249-5591-46b4-8119-cda36278e526 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:14.828304 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c3249-5591-46b4-8119-cda36278e526 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:14.828304 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c3249-5591-46b4-8119-cda36278e526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:14.834232 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c3249-5591-46b4-8119-cda36278e526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:14.836213 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c3249-5591-46b4-8119-cda36278e526 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:14.847122 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 970/1918] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:34:17.316946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08b98b-2d7c-4f85-bdc4-ccdb691e2158 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:17.318999 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9e08b98b-2d7c-4f85-bdc4-ccdb691e2158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:17.396026 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08b98b-2d7c-4f85-bdc4-ccdb691e2158 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:17.409731 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59141c-0c1a-496d-a49b-33f72fa49d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:17.410757 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59141c-0c1a-496d-a49b-33f72fa49d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:17.411259 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59141c-0c1a-496d-a49b-33f72fa49d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:17.411606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59141c-0c1a-496d-a49b-33f72fa49d6c admin admin] PATH_INFO: `/v3/users/58e5db8662d049c58cd41212289c79a1` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:17.413193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59141c-0c1a-496d-a49b-33f72fa49d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e5db8662d049c58cd41212289c79a1)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:17.415208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59141c-0c1a-496d-a49b-33f72fa49d6c admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:17.465070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6a59141c-0c1a-496d-a49b-33f72fa49d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e5db8662d049c58cd41212289c79a1'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:17.471583 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6a59141c-0c1a-496d-a49b-33f72fa49d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e5db8662d049c58cd41212289c79a1'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:17.480561 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6a59141c-0c1a-496d-a49b-33f72fa49d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e5db8662d049c58cd41212289c79a1'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:17.481260 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6a59141c-0c1a-496d-a49b-33f72fa49d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e5db8662d049c58cd41212289c79a1'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:17.481913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6a59141c-0c1a-496d-a49b-33f72fa49d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e5db8662d049c58cd41212289c79a1'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:17.504979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 949/1919] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:34:17 2022] DELETE /identity/v3/users/58e5db8662d049c58cd41212289c79a1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:17.509995 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662a90e-2170-4637-81c4-86fbcf093081 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:17.510491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662a90e-2170-4637-81c4-86fbcf093081 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:17.510593 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662a90e-2170-4637-81c4-86fbcf093081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:17.534268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-3662a90e-2170-4637-81c4-86fbcf093081 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:17.535628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-3662a90e-2170-4637-81c4-86fbcf093081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:17.612282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 971/1920] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:34:17.623609 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59141c-0c1a-496d-a49b-33f72fa49d6c admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:17.625379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-6a59141c-0c1a-496d-a49b-33f72fa49d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:17.687832 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59141c-0c1a-496d-a49b-33f72fa49d6c admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:17.691540 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a1791-be5f-4247-b894-1a29d0b0a5a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:17.692157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a1791-be5f-4247-b894-1a29d0b0a5a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:17.692436 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a1791-be5f-4247-b894-1a29d0b0a5a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:17.692739 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a1791-be5f-4247-b894-1a29d0b0a5a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:17.702060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a1791-be5f-4247-b894-1a29d0b0a5a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:17.703480 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a1791-be5f-4247-b894-1a29d0b0a5a1 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:17.715500 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 950/1921] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:34:17.869151 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662a90e-2170-4637-81c4-86fbcf093081 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:17.871128 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-3662a90e-2170-4637-81c4-86fbcf093081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:17.884676 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662a90e-2170-4637-81c4-86fbcf093081 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:17.895542 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48a292-99b7-4d01-adb4-bc208d242c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:17.896485 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48a292-99b7-4d01-adb4-bc208d242c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:17.896817 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48a292-99b7-4d01-adb4-bc208d242c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:17.897114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48a292-99b7-4d01-adb4-bc208d242c24 admin admin] PATH_INFO: `/v3/users/48f6cd0e160b4e18a649c6b9daa48e0b` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:17.904761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48a292-99b7-4d01-adb4-bc208d242c24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48f6cd0e160b4e18a649c6b9daa48e0b)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:17.908198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48a292-99b7-4d01-adb4-bc208d242c24 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:17.962967 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ff48a292-99b7-4d01-adb4-bc208d242c24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f6cd0e160b4e18a649c6b9daa48e0b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:17.969506 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ff48a292-99b7-4d01-adb4-bc208d242c24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f6cd0e160b4e18a649c6b9daa48e0b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:17.970160 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ff48a292-99b7-4d01-adb4-bc208d242c24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f6cd0e160b4e18a649c6b9daa48e0b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:17.977994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ff48a292-99b7-4d01-adb4-bc208d242c24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f6cd0e160b4e18a649c6b9daa48e0b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:17.978749 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ff48a292-99b7-4d01-adb4-bc208d242c24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f6cd0e160b4e18a649c6b9daa48e0b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:17.996519 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 972/1922] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:34:17 2022] DELETE /identity/v3/users/48f6cd0e160b4e18a649c6b9daa48e0b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:18.000899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43108014-a6c5-4cba-b4d8-c2e287406537 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:18.001190 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43108014-a6c5-4cba-b4d8-c2e287406537 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:18.001466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43108014-a6c5-4cba-b4d8-c2e287406537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:18.019578 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-43108014-a6c5-4cba-b4d8-c2e287406537 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:18.020905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-43108014-a6c5-4cba-b4d8-c2e287406537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:18.023935 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48a292-99b7-4d01-adb4-bc208d242c24 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:18.025408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-ff48a292-99b7-4d01-adb4-bc208d242c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:18.086998 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 951/1923] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:18.095548 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48a292-99b7-4d01-adb4-bc208d242c24 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:18.096521 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43108014-a6c5-4cba-b4d8-c2e287406537 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:18.098145 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-43108014-a6c5-4cba-b4d8-c2e287406537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:18.101409 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bc222-87f7-479e-9220-dc984c811e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:18.102268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bc222-87f7-479e-9220-dc984c811e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:18.102550 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bc222-87f7-479e-9220-dc984c811e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:18.102825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bc222-87f7-479e-9220-dc984c811e06 admin admin] PATH_INFO: `/v3/projects/d91efb815bca496f8f7a24c0cd5d411d` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:18.104037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bc222-87f7-479e-9220-dc984c811e06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d91efb815bca496f8f7a24c0cd5d411d)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:18.106188 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bc222-87f7-479e-9220-dc984c811e06 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:18.150925 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b01bc222-87f7-479e-9220-dc984c811e06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd91efb815bca496f8f7a24c0cd5d411d', 'request_id': 'req-b01bc222-87f7-479e-9220-dc984c811e06'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:18.152777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43108014-a6c5-4cba-b4d8-c2e287406537 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:18.157248 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b01bc222-87f7-479e-9220-dc984c811e06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd91efb815bca496f8f7a24c0cd5d411d', 'request_id': 'req-b01bc222-87f7-479e-9220-dc984c811e06'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:18.162443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b01bc222-87f7-479e-9220-dc984c811e06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd91efb815bca496f8f7a24c0cd5d411d', 'request_id': 'req-b01bc222-87f7-479e-9220-dc984c811e06'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:18.175355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b01bc222-87f7-479e-9220-dc984c811e06 admin admin] The token cache is being invalidate because project d91efb815bca496f8f7a24c0cd5d411d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:34:18.175642 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b01bc222-87f7-479e-9220-dc984c811e06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:18.176276 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b01bc222-87f7-479e-9220-dc984c811e06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:18.178314 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 973/1924] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:34:18 2022] DELETE /identity/v3/projects/d91efb815bca496f8f7a24c0cd5d411d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:34:18.181854 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bc222-87f7-479e-9220-dc984c811e06 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:18.183363 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b01bc222-87f7-479e-9220-dc984c811e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:18.201074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9060db-013f-416b-ab34-30992ae80f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:18.201751 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9060db-013f-416b-ab34-30992ae80f64 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:18.202062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9060db-013f-416b-ab34-30992ae80f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:18.202336 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9060db-013f-416b-ab34-30992ae80f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:18.204115 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-4b9060db-013f-416b-ab34-30992ae80f64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:18.246003 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bc222-87f7-479e-9220-dc984c811e06 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:18.250614 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ae035-09b2-44c4-a927-e35bb027f755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:18.251479 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ae035-09b2-44c4-a927-e35bb027f755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:18.251755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ae035-09b2-44c4-a927-e35bb027f755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:18.252025 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ae035-09b2-44c4-a927-e35bb027f755 admin admin] PATH_INFO: `/v3/users/096f47e7a3b44d549a01d203b2fd5d22` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:18.253223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ae035-09b2-44c4-a927-e35bb027f755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=096f47e7a3b44d549a01d203b2fd5d22)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:18.255135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ae035-09b2-44c4-a927-e35bb027f755 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:18.266000 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9060db-013f-416b-ab34-30992ae80f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:18.267547 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9060db-013f-416b-ab34-30992ae80f64 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:18.277179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 952/1925] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:34:18.300884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c85ae035-09b2-44c4-a927-e35bb027f755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '096f47e7a3b44d549a01d203b2fd5d22'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:18.307911 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c85ae035-09b2-44c4-a927-e35bb027f755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '096f47e7a3b44d549a01d203b2fd5d22'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:18.308638 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c85ae035-09b2-44c4-a927-e35bb027f755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '096f47e7a3b44d549a01d203b2fd5d22'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:18.316401 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c85ae035-09b2-44c4-a927-e35bb027f755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '096f47e7a3b44d549a01d203b2fd5d22'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:18.317060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c85ae035-09b2-44c4-a927-e35bb027f755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '096f47e7a3b44d549a01d203b2fd5d22'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:18.336585 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 974/1926] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:34:18 2022] DELETE /identity/v3/users/096f47e7a3b44d549a01d203b2fd5d22 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:34:18.633110 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9060db-013f-416b-ab34-30992ae80f64 service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:18.645703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9060db-013f-416b-ab34-30992ae80f64 service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:18.709287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aab6f8-5e10-46d2-bb4c-d5348e6f8fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:18.713398 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aab6f8-5e10-46d2-bb4c-d5348e6f8fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:18.714644 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aab6f8-5e10-46d2-bb4c-d5348e6f8fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:18.714937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aab6f8-5e10-46d2-bb4c-d5348e6f8fd6 admin admin] PATH_INFO: `/v3/projects/78bf5c4f93a64acdb609daa256349d0e` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:18.716172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aab6f8-5e10-46d2-bb4c-d5348e6f8fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78bf5c4f93a64acdb609daa256349d0e)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:18.718676 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aab6f8-5e10-46d2-bb4c-d5348e6f8fd6 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:18.742246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ae035-09b2-44c4-a927-e35bb027f755 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:18.745396 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c85ae035-09b2-44c4-a927-e35bb027f755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:18.765763 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ae035-09b2-44c4-a927-e35bb027f755 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:18.774220 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d4aaf-719a-4a7d-9620-5e3211ab8e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:18.775327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d4aaf-719a-4a7d-9620-5e3211ab8e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:18.775780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d4aaf-719a-4a7d-9620-5e3211ab8e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:18.776374 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d4aaf-719a-4a7d-9620-5e3211ab8e76 admin admin] PATH_INFO: `/v3/projects/aaefe79114294546850dbb5643052c04` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:18.777885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d4aaf-719a-4a7d-9620-5e3211ab8e76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaefe79114294546850dbb5643052c04)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:18.780492 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d4aaf-719a-4a7d-9620-5e3211ab8e76 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:18.833091 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-01aab6f8-5e10-46d2-bb4c-d5348e6f8fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78bf5c4f93a64acdb609daa256349d0e', 'request_id': 'req-01aab6f8-5e10-46d2-bb4c-d5348e6f8fd6'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:18.842177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-01aab6f8-5e10-46d2-bb4c-d5348e6f8fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78bf5c4f93a64acdb609daa256349d0e', 'request_id': 'req-01aab6f8-5e10-46d2-bb4c-d5348e6f8fd6'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:18.848483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-748d4aaf-719a-4a7d-9620-5e3211ab8e76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaefe79114294546850dbb5643052c04', 'request_id': 'req-748d4aaf-719a-4a7d-9620-5e3211ab8e76'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:18.854731 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-01aab6f8-5e10-46d2-bb4c-d5348e6f8fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78bf5c4f93a64acdb609daa256349d0e', 'request_id': 'req-01aab6f8-5e10-46d2-bb4c-d5348e6f8fd6'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:18.856103 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-748d4aaf-719a-4a7d-9620-5e3211ab8e76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaefe79114294546850dbb5643052c04', 'request_id': 'req-748d4aaf-719a-4a7d-9620-5e3211ab8e76'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:18.862345 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-748d4aaf-719a-4a7d-9620-5e3211ab8e76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaefe79114294546850dbb5643052c04', 'request_id': 'req-748d4aaf-719a-4a7d-9620-5e3211ab8e76'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:18.870135 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-01aab6f8-5e10-46d2-bb4c-d5348e6f8fd6 admin admin] The token cache is being invalidate because project 78bf5c4f93a64acdb609daa256349d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:34:18.870395 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-01aab6f8-5e10-46d2-bb4c-d5348e6f8fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:18.871063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-01aab6f8-5e10-46d2-bb4c-d5348e6f8fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:18.875651 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 953/1927] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:34:18 2022] DELETE /identity/v3/projects/78bf5c4f93a64acdb609daa256349d0e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:18.876180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-748d4aaf-719a-4a7d-9620-5e3211ab8e76 admin admin] The token cache is being invalidate because project aaefe79114294546850dbb5643052c04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:34:18.876496 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-748d4aaf-719a-4a7d-9620-5e3211ab8e76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:18.877195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-748d4aaf-719a-4a7d-9620-5e3211ab8e76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:18.878966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 975/1928] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:34:18 2022] DELETE /identity/v3/projects/aaefe79114294546850dbb5643052c04 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:18.880027 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aab6f8-5e10-46d2-bb4c-d5348e6f8fd6 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:18.881436 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-01aab6f8-5e10-46d2-bb4c-d5348e6f8fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:18.883356 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c990f-1f22-4f69-9f32-271f36186482 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:18.883652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c990f-1f22-4f69-9f32-271f36186482 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:18.883951 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c990f-1f22-4f69-9f32-271f36186482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:18.903720 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-356c990f-1f22-4f69-9f32-271f36186482 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:18.904658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-356c990f-1f22-4f69-9f32-271f36186482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:18.961809 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aab6f8-5e10-46d2-bb4c-d5348e6f8fd6 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:18.990815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 976/1929] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:34:18.992643 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab5671-0a06-4f08-8682-787f9f0d5300 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:18.993757 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab5671-0a06-4f08-8682-787f9f0d5300 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:18.993757 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab5671-0a06-4f08-8682-787f9f0d5300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:19.030388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-07ab5671-0a06-4f08-8682-787f9f0d5300 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:19.030814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19732cb4-d071-4cdd-a990-6ecce0f5ae8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:19.031713 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-07ab5671-0a06-4f08-8682-787f9f0d5300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:19.031831 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19732cb4-d071-4cdd-a990-6ecce0f5ae8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:19.032121 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19732cb4-d071-4cdd-a990-6ecce0f5ae8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:19.032457 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19732cb4-d071-4cdd-a990-6ecce0f5ae8d admin admin] PATH_INFO: `/v3/users/71f030a374bd4f26958c442a23c68f4c` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:19.033806 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19732cb4-d071-4cdd-a990-6ecce0f5ae8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f030a374bd4f26958c442a23c68f4c)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:19.035800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19732cb4-d071-4cdd-a990-6ecce0f5ae8d admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:19.047371 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 977/1930] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:19.053091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab5671-0a06-4f08-8682-787f9f0d5300 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:19.067395 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab5671-0a06-4f08-8682-787f9f0d5300 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:19.074642 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69f98e-9466-40e6-86b6-50d43cb490fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:19.075310 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69f98e-9466-40e6-86b6-50d43cb490fb admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:19.075626 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69f98e-9466-40e6-86b6-50d43cb490fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:19.075932 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69f98e-9466-40e6-86b6-50d43cb490fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:19.076843 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69f98e-9466-40e6-86b6-50d43cb490fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:34:19.077393 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69f98e-9466-40e6-86b6-50d43cb490fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:19.079091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69f98e-9466-40e6-86b6-50d43cb490fb admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:19.095907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 978/1931] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:34:19.102392 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69f98e-9466-40e6-86b6-50d43cb490fb admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:19.112177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-19732cb4-d071-4cdd-a990-6ecce0f5ae8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f030a374bd4f26958c442a23c68f4c'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:19.115628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69f98e-9466-40e6-86b6-50d43cb490fb admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:19.120902 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-19732cb4-d071-4cdd-a990-6ecce0f5ae8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f030a374bd4f26958c442a23c68f4c'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:19.122244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715c170-f9e0-4c76-a1f4-a1b4ee0377fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:19.122969 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715c170-f9e0-4c76-a1f4-a1b4ee0377fa admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:19.123508 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715c170-f9e0-4c76-a1f4-a1b4ee0377fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:19.123845 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715c170-f9e0-4c76-a1f4-a1b4ee0377fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:19.124639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715c170-f9e0-4c76-a1f4-a1b4ee0377fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:19.126649 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715c170-f9e0-4c76-a1f4-a1b4ee0377fa admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:19.130516 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-19732cb4-d071-4cdd-a990-6ecce0f5ae8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f030a374bd4f26958c442a23c68f4c'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:19.131139 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-19732cb4-d071-4cdd-a990-6ecce0f5ae8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f030a374bd4f26958c442a23c68f4c'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:19.132606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-19732cb4-d071-4cdd-a990-6ecce0f5ae8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f030a374bd4f26958c442a23c68f4c'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:19.158006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 954/1932] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:34:18 2022] DELETE /identity/v3/users/71f030a374bd4f26958c442a23c68f4c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:19.168141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 979/1933] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:34:19 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:19.175024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19732cb4-d071-4cdd-a990-6ecce0f5ae8d admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:19.178589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-19732cb4-d071-4cdd-a990-6ecce0f5ae8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:19.282113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19732cb4-d071-4cdd-a990-6ecce0f5ae8d admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:19.362936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaab4bf-35dd-4f2e-be6c-f0066c3cf093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:19.363783 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaab4bf-35dd-4f2e-be6c-f0066c3cf093 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:19.364165 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaab4bf-35dd-4f2e-be6c-f0066c3cf093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:19.364593 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaab4bf-35dd-4f2e-be6c-f0066c3cf093 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:19.365400 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaab4bf-35dd-4f2e-be6c-f0066c3cf093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:19.368030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaab4bf-35dd-4f2e-be6c-f0066c3cf093 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:19.392254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 955/1934] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:34:19 2022] POST /identity/v3/users => generated 285 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:19.393542 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715c170-f9e0-4c76-a1f4-a1b4ee0377fa admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:19.404865 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715c170-f9e0-4c76-a1f4-a1b4ee0377fa admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:19.409658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b8e84-0324-4b26-96a1-c08695df8448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:19.410367 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b8e84-0324-4b26-96a1-c08695df8448 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:19.410650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b8e84-0324-4b26-96a1-c08695df8448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:19.410917 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b8e84-0324-4b26-96a1-c08695df8448 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:19.411646 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b8e84-0324-4b26-96a1-c08695df8448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:19.413356 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b8e84-0324-4b26-96a1-c08695df8448 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:19.423866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 980/1935] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:19.427924 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaab4bf-35dd-4f2e-be6c-f0066c3cf093 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:19.438814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaab4bf-35dd-4f2e-be6c-f0066c3cf093 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:19.443591 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9fffb-183d-4c2d-9529-abc980262202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:19.444284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9fffb-183d-4c2d-9529-abc980262202 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:19.444639 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9fffb-183d-4c2d-9529-abc980262202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:19.444918 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9fffb-183d-4c2d-9529-abc980262202 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:19.445704 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9fffb-183d-4c2d-9529-abc980262202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:19.447310 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9fffb-183d-4c2d-9529-abc980262202 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:19.457961 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 956/1936] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:19.462816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b8e84-0324-4b26-96a1-c08695df8448 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:19.473835 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b8e84-0324-4b26-96a1-c08695df8448 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:19.479349 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87de9ec-0871-4809-a305-b1d0d146ce84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:19.480226 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87de9ec-0871-4809-a305-b1d0d146ce84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:19.480505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87de9ec-0871-4809-a305-b1d0d146ce84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:19.480809 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87de9ec-0871-4809-a305-b1d0d146ce84 admin admin] PATH_INFO: `/v3/projects/80dcf451975b4afb9e1dc9b7793c4027/users/11786d75c3a442dc94d80dac65917309/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:19.482896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9fffb-183d-4c2d-9529-abc980262202 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:19.485066 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-41f9fffb-183d-4c2d-9529-abc980262202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:19.500419 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9fffb-183d-4c2d-9529-abc980262202 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:19.503684 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87de9ec-0871-4809-a305-b1d0d146ce84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80dcf451975b4afb9e1dc9b7793c4027, user_id=11786d75c3a442dc94d80dac65917309, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:19.505564 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59cc06-d026-4c61-9a8b-aa8fdb7bb37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:19.506419 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59cc06-d026-4c61-9a8b-aa8fdb7bb37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:19.506565 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87de9ec-0871-4809-a305-b1d0d146ce84 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:19.506772 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59cc06-d026-4c61-9a8b-aa8fdb7bb37a admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:19.507009 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59cc06-d026-4c61-9a8b-aa8fdb7bb37a admin admin] PATH_INFO: `/v3/projects/e4ae0a0b7f384759b3c6ddb3d7dc636e` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:19.508208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59cc06-d026-4c61-9a8b-aa8fdb7bb37a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4ae0a0b7f384759b3c6ddb3d7dc636e)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:19.510142 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59cc06-d026-4c61-9a8b-aa8fdb7bb37a admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:19.520310 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 981/1937] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:19 2022] PUT /identity/v3/projects/80dcf451975b4afb9e1dc9b7793c4027/users/11786d75c3a442dc94d80dac65917309/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:34:19.531005 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c76c7-b902-493d-b93f-87111ef4cacd None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:19.531289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c76c7-b902-493d-b93f-87111ef4cacd None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:19.531560 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c76c7-b902-493d-b93f-87111ef4cacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:19.558454 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-322c76c7-b902-493d-b93f-87111ef4cacd None None] MFA Rules not processed for user `11786d75c3a442dc94d80dac65917309`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:19.559675 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-322c76c7-b902-493d-b93f-87111ef4cacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:19.561261 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8d59cc06-d026-4c61-9a8b-aa8fdb7bb37a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4ae0a0b7f384759b3c6ddb3d7dc636e', 'request_id': 'req-8d59cc06-d026-4c61-9a8b-aa8fdb7bb37a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:19.569074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8d59cc06-d026-4c61-9a8b-aa8fdb7bb37a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4ae0a0b7f384759b3c6ddb3d7dc636e', 'request_id': 'req-8d59cc06-d026-4c61-9a8b-aa8fdb7bb37a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:19.574590 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8d59cc06-d026-4c61-9a8b-aa8fdb7bb37a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4ae0a0b7f384759b3c6ddb3d7dc636e', 'request_id': 'req-8d59cc06-d026-4c61-9a8b-aa8fdb7bb37a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:19.587063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8d59cc06-d026-4c61-9a8b-aa8fdb7bb37a admin admin] The token cache is being invalidate because project e4ae0a0b7f384759b3c6ddb3d7dc636e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:34:19.587483 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8d59cc06-d026-4c61-9a8b-aa8fdb7bb37a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:19.588218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8d59cc06-d026-4c61-9a8b-aa8fdb7bb37a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:19.589913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 957/1938] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:34:19 2022] DELETE /identity/v3/projects/e4ae0a0b7f384759b3c6ddb3d7dc636e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:34:19.594543 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bca373-ab0f-4318-845d-cc538d89f450 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:19.594855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bca373-ab0f-4318-845d-cc538d89f450 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:19.595155 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bca373-ab0f-4318-845d-cc538d89f450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:19.612765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-e4bca373-ab0f-4318-845d-cc538d89f450 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:19.613949 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e4bca373-ab0f-4318-845d-cc538d89f450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:19.623351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 982/1939] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:34:19.634751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c76c7-b902-493d-b93f-87111ef4cacd None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:19.636092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-322c76c7-b902-493d-b93f-87111ef4cacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:19.671940 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 958/1940] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:34:19.679723 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c0e36-6182-4c5a-b624-78c68ea66b7d None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:19.680014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c0e36-6182-4c5a-b624-78c68ea66b7d None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:19.680294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c0e36-6182-4c5a-b624-78c68ea66b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:19.690260 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c76c7-b902-493d-b93f-87111ef4cacd None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:19.694052 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dcdac-855e-4d12-8ceb-8ea8fd62ce95 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a63ecc7210574058aad75a3114b57202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:19.695112 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dcdac-855e-4d12-8ceb-8ea8fd62ce95 service glance] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:19.695393 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dcdac-855e-4d12-8ceb-8ea8fd62ce95 service glance] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:19.695664 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dcdac-855e-4d12-8ceb-8ea8fd62ce95 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:19.698515 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-fd5c0e36-6182-4c5a-b624-78c68ea66b7d None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:19.699733 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-fd5c0e36-6182-4c5a-b624-78c68ea66b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:19.704132 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30dcdac-855e-4d12-8ceb-8ea8fd62ce95 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:19.705594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30dcdac-855e-4d12-8ceb-8ea8fd62ce95 service glance] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:19.708209 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 959/1941] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:34:19.712416 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c0e36-6182-4c5a-b624-78c68ea66b7d None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:19.714913 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 983/1942] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:34:19.721282 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c0e36-6182-4c5a-b624-78c68ea66b7d None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:19.726821 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257934d-f89a-4247-b108-618bc1f3e038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:19.727470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257934d-f89a-4247-b108-618bc1f3e038 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:19.727754 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257934d-f89a-4247-b108-618bc1f3e038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:19.728029 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257934d-f89a-4247-b108-618bc1f3e038 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:19.728944 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257934d-f89a-4247-b108-618bc1f3e038 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:34:19.729256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257934d-f89a-4247-b108-618bc1f3e038 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:19.730858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257934d-f89a-4247-b108-618bc1f3e038 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:19.743369 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 960/1943] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:34:19.747572 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dcdac-855e-4d12-8ceb-8ea8fd62ce95 service glance] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:19.759565 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dcdac-855e-4d12-8ceb-8ea8fd62ce95 service glance] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:19.766102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4bdb2-5713-4030-a87e-68a31aa03a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:19.766825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4bdb2-5713-4030-a87e-68a31aa03a8d admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:19.767169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4bdb2-5713-4030-a87e-68a31aa03a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:19.767506 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4bdb2-5713-4030-a87e-68a31aa03a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:19.768365 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4bdb2-5713-4030-a87e-68a31aa03a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:19.770269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4bdb2-5713-4030-a87e-68a31aa03a8d admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:19.820812 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 984/1944] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:34:19 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:19.825135 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257934d-f89a-4247-b108-618bc1f3e038 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:19.845636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257934d-f89a-4247-b108-618bc1f3e038 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:19.909977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17423859-5964-4782-ace9-47fc68c915db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:19.910653 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17423859-5964-4782-ace9-47fc68c915db admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:19.910935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17423859-5964-4782-ace9-47fc68c915db admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:19.911207 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17423859-5964-4782-ace9-47fc68c915db admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:19.911894 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17423859-5964-4782-ace9-47fc68c915db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:19.914412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17423859-5964-4782-ace9-47fc68c915db admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:19.935184 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 961/1945] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:34:19 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:34:19.938957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4bdb2-5713-4030-a87e-68a31aa03a8d admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:19.958991 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4bdb2-5713-4030-a87e-68a31aa03a8d admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:19.966545 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbc7d1-dcfa-47a6-9bd1-a38bd71792ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:19.966877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbc7d1-dcfa-47a6-9bd1-a38bd71792ca admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:19.967164 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbc7d1-dcfa-47a6-9bd1-a38bd71792ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:19.967442 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbc7d1-dcfa-47a6-9bd1-a38bd71792ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:19.968182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbc7d1-dcfa-47a6-9bd1-a38bd71792ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:19.970244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbc7d1-dcfa-47a6-9bd1-a38bd71792ca admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:19.983656 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 985/1946] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:19.987797 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17423859-5964-4782-ace9-47fc68c915db admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:19.999655 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17423859-5964-4782-ace9-47fc68c915db admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:20.008761 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad5e76-15d8-4e23-87eb-80143de0ca2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:20.009623 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad5e76-15d8-4e23-87eb-80143de0ca2c admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:20.009951 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad5e76-15d8-4e23-87eb-80143de0ca2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:20.010379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad5e76-15d8-4e23-87eb-80143de0ca2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:20.011371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad5e76-15d8-4e23-87eb-80143de0ca2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:20.013252 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad5e76-15d8-4e23-87eb-80143de0ca2c admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:20.025256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 962/1947] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:34:20.030174 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbc7d1-dcfa-47a6-9bd1-a38bd71792ca admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:20.043639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbc7d1-dcfa-47a6-9bd1-a38bd71792ca admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:20.054354 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ab45d-230d-4e77-a823-1fc05ae20666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:20.055260 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ab45d-230d-4e77-a823-1fc05ae20666 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:20.055567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ab45d-230d-4e77-a823-1fc05ae20666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:20.055796 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ab45d-230d-4e77-a823-1fc05ae20666 admin admin] PATH_INFO: `/v3/projects/e6bcfbcf3cf84607a2ea593055bf4cd6/users/f7fe55e67014453f87f47418493e0b92/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:20.088115 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ab45d-230d-4e77-a823-1fc05ae20666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6bcfbcf3cf84607a2ea593055bf4cd6, user_id=f7fe55e67014453f87f47418493e0b92, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:20.091042 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ab45d-230d-4e77-a823-1fc05ae20666 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:20.105848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 986/1948] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:20 2022] PUT /identity/v3/projects/e6bcfbcf3cf84607a2ea593055bf4cd6/users/f7fe55e67014453f87f47418493e0b92/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:20.113536 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299c3d6-4530-47b4-a74b-a077f264a972 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:20.114107 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299c3d6-4530-47b4-a74b-a077f264a972 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:20.114325 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299c3d6-4530-47b4-a74b-a077f264a972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:20.136327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-9299c3d6-4530-47b4-a74b-a077f264a972 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:20.137795 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9299c3d6-4530-47b4-a74b-a077f264a972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:20.204787 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 963/1949] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:20.217941 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ab45d-230d-4e77-a823-1fc05ae20666 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:20.220756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c71ab45d-230d-4e77-a823-1fc05ae20666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:20.296190 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ab45d-230d-4e77-a823-1fc05ae20666 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:20.300072 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5750c6-3a9e-4a9a-adf0-fd92a78aadd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:20.301169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5750c6-3a9e-4a9a-adf0-fd92a78aadd5 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:20.301569 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5750c6-3a9e-4a9a-adf0-fd92a78aadd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:20.302163 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5750c6-3a9e-4a9a-adf0-fd92a78aadd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:20.313899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5750c6-3a9e-4a9a-adf0-fd92a78aadd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:20.315546 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5750c6-3a9e-4a9a-adf0-fd92a78aadd5 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:20.329391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 987/1950] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:34:20.914058 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e521a4-1bf5-41b9-93fb-ea3a7d1e6ea9 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:20.914535 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e521a4-1bf5-41b9-93fb-ea3a7d1e6ea9 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:20.914653 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e521a4-1bf5-41b9-93fb-ea3a7d1e6ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:20.940995 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-70e521a4-1bf5-41b9-93fb-ea3a7d1e6ea9 None None] MFA Rules not processed for user `f7fe55e67014453f87f47418493e0b92`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:20.942180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-70e521a4-1bf5-41b9-93fb-ea3a7d1e6ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:21.022804 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 964/1951] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:21.032002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5750c6-3a9e-4a9a-adf0-fd92a78aadd5 service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:21.035521 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-de5750c6-3a9e-4a9a-adf0-fd92a78aadd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:21.141138 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5750c6-3a9e-4a9a-adf0-fd92a78aadd5 service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:21.146111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa17ab3-2237-4bb6-806a-b2377232a094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:21.146769 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa17ab3-2237-4bb6-806a-b2377232a094 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:21.147044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa17ab3-2237-4bb6-806a-b2377232a094 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:21.147841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa17ab3-2237-4bb6-806a-b2377232a094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:21.158689 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa17ab3-2237-4bb6-806a-b2377232a094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:21.160469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa17ab3-2237-4bb6-806a-b2377232a094 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:21.184830 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 988/1952] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:34:22.798462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fd892-adc5-4361-9e3b-45b70488da35 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:22.799004 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fd892-adc5-4361-9e3b-45b70488da35 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:22.799162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fd892-adc5-4361-9e3b-45b70488da35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:22.818209 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-cd7fd892-adc5-4361-9e3b-45b70488da35 None None] MFA Rules not processed for user `f7fe55e67014453f87f47418493e0b92`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:22.820027 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-cd7fd892-adc5-4361-9e3b-45b70488da35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:22.836846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 965/1953] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:25.688219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa17ab3-2237-4bb6-806a-b2377232a094 service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:25.694553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-7aa17ab3-2237-4bb6-806a-b2377232a094 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:25.735753 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa17ab3-2237-4bb6-806a-b2377232a094 service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:25.747016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68ff01-6c60-4e95-a100-159df51ceeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:25.748273 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68ff01-6c60-4e95-a100-159df51ceeef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:25.748719 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68ff01-6c60-4e95-a100-159df51ceeef admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:25.749116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68ff01-6c60-4e95-a100-159df51ceeef admin admin] PATH_INFO: `/v3/users/12c13fb0a73d4851bd46d380db9e769b` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:25.753410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68ff01-6c60-4e95-a100-159df51ceeef admin admin] RBAC: Authorizing `identity:delete_user(user_id=12c13fb0a73d4851bd46d380db9e769b)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:25.755397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68ff01-6c60-4e95-a100-159df51ceeef admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:25.815785 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-cc68ff01-6c60-4e95-a100-159df51ceeef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12c13fb0a73d4851bd46d380db9e769b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:25.823718 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-cc68ff01-6c60-4e95-a100-159df51ceeef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12c13fb0a73d4851bd46d380db9e769b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:25.824407 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-cc68ff01-6c60-4e95-a100-159df51ceeef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12c13fb0a73d4851bd46d380db9e769b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:25.833293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-cc68ff01-6c60-4e95-a100-159df51ceeef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12c13fb0a73d4851bd46d380db9e769b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:25.834101 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-cc68ff01-6c60-4e95-a100-159df51ceeef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12c13fb0a73d4851bd46d380db9e769b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:25.854323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 989/1954] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:34:25 2022] DELETE /identity/v3/users/12c13fb0a73d4851bd46d380db9e769b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:25.858422 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e079e5-f731-47b1-935d-dbe5fc091489 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:25.858900 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e079e5-f731-47b1-935d-dbe5fc091489 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:25.858991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e079e5-f731-47b1-935d-dbe5fc091489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:25.877115 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-a3e079e5-f731-47b1-935d-dbe5fc091489 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:25.878298 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-a3e079e5-f731-47b1-935d-dbe5fc091489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:25.937674 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 966/1955] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:25.947494 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68ff01-6c60-4e95-a100-159df51ceeef admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:25.949027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-cc68ff01-6c60-4e95-a100-159df51ceeef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:26.003830 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68ff01-6c60-4e95-a100-159df51ceeef admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:26.007929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d66b2-ee9c-4b0f-a5fe-fca724aeab44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:26.008580 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d66b2-ee9c-4b0f-a5fe-fca724aeab44 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:26.008862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d66b2-ee9c-4b0f-a5fe-fca724aeab44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:26.009134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d66b2-ee9c-4b0f-a5fe-fca724aeab44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:26.018195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d66b2-ee9c-4b0f-a5fe-fca724aeab44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:26.019615 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d66b2-ee9c-4b0f-a5fe-fca724aeab44 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:26.029798 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 990/1956] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:34:26.294924 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e079e5-f731-47b1-935d-dbe5fc091489 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:26.296758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-a3e079e5-f731-47b1-935d-dbe5fc091489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:26.315205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e079e5-f731-47b1-935d-dbe5fc091489 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:26.321281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1c9d6-cadd-4d5d-867a-d3c995ec820f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:26.322715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1c9d6-cadd-4d5d-867a-d3c995ec820f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:26.324627 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1c9d6-cadd-4d5d-867a-d3c995ec820f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:26.325057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1c9d6-cadd-4d5d-867a-d3c995ec820f admin admin] PATH_INFO: `/v3/projects/ebd30113048f4939931576e6486e96d4` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:26.326450 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1c9d6-cadd-4d5d-867a-d3c995ec820f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd30113048f4939931576e6486e96d4)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:26.328418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1c9d6-cadd-4d5d-867a-d3c995ec820f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:26.395340 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-ddc1c9d6-cadd-4d5d-867a-d3c995ec820f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd30113048f4939931576e6486e96d4', 'request_id': 'req-ddc1c9d6-cadd-4d5d-867a-d3c995ec820f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:26.404772 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-ddc1c9d6-cadd-4d5d-867a-d3c995ec820f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd30113048f4939931576e6486e96d4', 'request_id': 'req-ddc1c9d6-cadd-4d5d-867a-d3c995ec820f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:26.414946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-ddc1c9d6-cadd-4d5d-867a-d3c995ec820f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd30113048f4939931576e6486e96d4', 'request_id': 'req-ddc1c9d6-cadd-4d5d-867a-d3c995ec820f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:26.427657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-ddc1c9d6-cadd-4d5d-867a-d3c995ec820f admin admin] The token cache is being invalidate because project ebd30113048f4939931576e6486e96d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:34:26.427915 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-ddc1c9d6-cadd-4d5d-867a-d3c995ec820f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:26.428592 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-ddc1c9d6-cadd-4d5d-867a-d3c995ec820f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:26.430195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 967/1957] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:34:26 2022] DELETE /identity/v3/projects/ebd30113048f4939931576e6486e96d4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:26.434032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d66b2-ee9c-4b0f-a5fe-fca724aeab44 service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:26.443579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d66b2-ee9c-4b0f-a5fe-fca724aeab44 service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:26.500852 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4ab7d-ed0f-4e00-9525-276c0d92b440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:26.501752 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4ab7d-ed0f-4e00-9525-276c0d92b440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:26.502355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4ab7d-ed0f-4e00-9525-276c0d92b440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:26.502644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4ab7d-ed0f-4e00-9525-276c0d92b440 admin admin] PATH_INFO: `/v3/users/e0f4d34c746d4ec58c2d40c50ef8cc6f` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:26.504053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4ab7d-ed0f-4e00-9525-276c0d92b440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f4d34c746d4ec58c2d40c50ef8cc6f)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:26.506230 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4ab7d-ed0f-4e00-9525-276c0d92b440 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:26.571409 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-54b4ab7d-ed0f-4e00-9525-276c0d92b440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f4d34c746d4ec58c2d40c50ef8cc6f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:26.580374 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-54b4ab7d-ed0f-4e00-9525-276c0d92b440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f4d34c746d4ec58c2d40c50ef8cc6f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:26.581141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-54b4ab7d-ed0f-4e00-9525-276c0d92b440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f4d34c746d4ec58c2d40c50ef8cc6f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:26.591445 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-54b4ab7d-ed0f-4e00-9525-276c0d92b440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f4d34c746d4ec58c2d40c50ef8cc6f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:26.592211 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-54b4ab7d-ed0f-4e00-9525-276c0d92b440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f4d34c746d4ec58c2d40c50ef8cc6f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:26.614001 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 991/1958] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:34:26 2022] DELETE /identity/v3/users/e0f4d34c746d4ec58c2d40c50ef8cc6f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:27.445875 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1c9d6-cadd-4d5d-867a-d3c995ec820f admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:27.447781 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-ddc1c9d6-cadd-4d5d-867a-d3c995ec820f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:27.472136 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1c9d6-cadd-4d5d-867a-d3c995ec820f admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:27.542772 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992ac91-9e2a-431e-b36b-97abab482618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:27.543645 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992ac91-9e2a-431e-b36b-97abab482618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:27.543925 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992ac91-9e2a-431e-b36b-97abab482618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:27.544199 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992ac91-9e2a-431e-b36b-97abab482618 admin admin] PATH_INFO: `/v3/projects/6010bfdc95a24783bfd25f48c941e0c2` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:27.545597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992ac91-9e2a-431e-b36b-97abab482618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6010bfdc95a24783bfd25f48c941e0c2)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:27.547535 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992ac91-9e2a-431e-b36b-97abab482618 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:27.599549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-f992ac91-9e2a-431e-b36b-97abab482618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6010bfdc95a24783bfd25f48c941e0c2', 'request_id': 'req-f992ac91-9e2a-431e-b36b-97abab482618'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:27.605962 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-f992ac91-9e2a-431e-b36b-97abab482618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6010bfdc95a24783bfd25f48c941e0c2', 'request_id': 'req-f992ac91-9e2a-431e-b36b-97abab482618'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:27.611792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-f992ac91-9e2a-431e-b36b-97abab482618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6010bfdc95a24783bfd25f48c941e0c2', 'request_id': 'req-f992ac91-9e2a-431e-b36b-97abab482618'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:27.627982 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-f992ac91-9e2a-431e-b36b-97abab482618 admin admin] The token cache is being invalidate because project 6010bfdc95a24783bfd25f48c941e0c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:34:27.628417 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-f992ac91-9e2a-431e-b36b-97abab482618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:27.629131 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-f992ac91-9e2a-431e-b36b-97abab482618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:27.631706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 968/1959] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:34:27 2022] DELETE /identity/v3/projects/6010bfdc95a24783bfd25f48c941e0c2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:27.636877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb1a67-047a-446d-a78a-0532c64df622 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:27.637382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb1a67-047a-446d-a78a-0532c64df622 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:27.637621 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb1a67-047a-446d-a78a-0532c64df622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:27.657384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-67fb1a67-047a-446d-a78a-0532c64df622 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:27.658691 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-67fb1a67-047a-446d-a78a-0532c64df622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:27.729208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 992/1960] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:27.737442 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea73a51-1872-4da5-a6c1-00db0e5adf22 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:27.737845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea73a51-1872-4da5-a6c1-00db0e5adf22 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:27.738220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea73a51-1872-4da5-a6c1-00db0e5adf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:27.759113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-8ea73a51-1872-4da5-a6c1-00db0e5adf22 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:27.760303 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-8ea73a51-1872-4da5-a6c1-00db0e5adf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:27.768327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 969/1961] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:27.773031 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb1a67-047a-446d-a78a-0532c64df622 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:27.782397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb1a67-047a-446d-a78a-0532c64df622 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:27.786944 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b140feb-d536-41f2-b1bf-5d4250d63390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:27.787604 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b140feb-d536-41f2-b1bf-5d4250d63390 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:27.788614 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b140feb-d536-41f2-b1bf-5d4250d63390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:27.788890 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b140feb-d536-41f2-b1bf-5d4250d63390 admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:27.789642 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b140feb-d536-41f2-b1bf-5d4250d63390 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:34:27.790050 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b140feb-d536-41f2-b1bf-5d4250d63390 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:27.791681 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b140feb-d536-41f2-b1bf-5d4250d63390 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:27.802920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 993/1962] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:34:27.807663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea73a51-1872-4da5-a6c1-00db0e5adf22 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:27.816467 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea73a51-1872-4da5-a6c1-00db0e5adf22 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:27.822040 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd3262-fae0-4b4f-b472-bd5f727c3e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:27.822681 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd3262-fae0-4b4f-b472-bd5f727c3e08 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:27.823389 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd3262-fae0-4b4f-b472-bd5f727c3e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:27.823666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd3262-fae0-4b4f-b472-bd5f727c3e08 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:27.824365 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd3262-fae0-4b4f-b472-bd5f727c3e08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:27.826302 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd3262-fae0-4b4f-b472-bd5f727c3e08 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:27.855160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 970/1963] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:34:27 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:34:27.859663 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b140feb-d536-41f2-b1bf-5d4250d63390 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:27.878120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b140feb-d536-41f2-b1bf-5d4250d63390 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:27.941458 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b202e1-d9eb-44d9-b519-2587c09cbc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:27.942139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b202e1-d9eb-44d9-b519-2587c09cbc84 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:27.942419 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b202e1-d9eb-44d9-b519-2587c09cbc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:27.942695 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b202e1-d9eb-44d9-b519-2587c09cbc84 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:27.943405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b202e1-d9eb-44d9-b519-2587c09cbc84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:27.945385 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b202e1-d9eb-44d9-b519-2587c09cbc84 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:27.967650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 994/1964] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:34:27 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:27.972952 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd3262-fae0-4b4f-b472-bd5f727c3e08 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:27.984984 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd3262-fae0-4b4f-b472-bd5f727c3e08 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:27.992486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbd74e-28c9-42a9-beab-dfd78be0bafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:27.993233 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbd74e-28c9-42a9-beab-dfd78be0bafb admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:27.993525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbd74e-28c9-42a9-beab-dfd78be0bafb admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:27.993810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbd74e-28c9-42a9-beab-dfd78be0bafb admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:27.994541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbd74e-28c9-42a9-beab-dfd78be0bafb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:27.996172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbd74e-28c9-42a9-beab-dfd78be0bafb admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:28.010428 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 971/1965] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:28.014201 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b202e1-d9eb-44d9-b519-2587c09cbc84 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:28.024363 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b202e1-d9eb-44d9-b519-2587c09cbc84 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:28.029363 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc42f95-ca05-4759-baed-991dd423b095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:28.030061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc42f95-ca05-4759-baed-991dd423b095 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:28.030353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc42f95-ca05-4759-baed-991dd423b095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:28.030633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc42f95-ca05-4759-baed-991dd423b095 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:28.031367 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc42f95-ca05-4759-baed-991dd423b095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:28.033097 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc42f95-ca05-4759-baed-991dd423b095 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:28.044012 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 995/1966] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:28.048010 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbd74e-28c9-42a9-beab-dfd78be0bafb admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:28.058574 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbd74e-28c9-42a9-beab-dfd78be0bafb admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:28.063245 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e04e5-1daa-4396-a2d5-637363fde33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:28.064212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e04e5-1daa-4396-a2d5-637363fde33b admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:28.064399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e04e5-1daa-4396-a2d5-637363fde33b admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:28.064700 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e04e5-1daa-4396-a2d5-637363fde33b admin admin] PATH_INFO: `/v3/projects/f7b23136cc73475e90942ee179d5d2af/users/d0d1e15e13c44e8ba09e0a3225f3154e/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:28.082157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e04e5-1daa-4396-a2d5-637363fde33b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7b23136cc73475e90942ee179d5d2af, user_id=d0d1e15e13c44e8ba09e0a3225f3154e, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:28.085723 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e04e5-1daa-4396-a2d5-637363fde33b admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:28.098866 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 972/1967] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:28 2022] PUT /identity/v3/projects/f7b23136cc73475e90942ee179d5d2af/users/d0d1e15e13c44e8ba09e0a3225f3154e/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:28.110027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9475f-6207-4ba2-a974-5b6d6a1c1159 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:28.110397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9475f-6207-4ba2-a974-5b6d6a1c1159 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:28.110742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9475f-6207-4ba2-a974-5b6d6a1c1159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:28.140219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-14e9475f-6207-4ba2-a974-5b6d6a1c1159 None None] MFA Rules not processed for user `d0d1e15e13c44e8ba09e0a3225f3154e`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:28.141639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-14e9475f-6207-4ba2-a974-5b6d6a1c1159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:28.235507 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 996/1968] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:28.239893 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e04e5-1daa-4396-a2d5-637363fde33b admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:28.312887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e04e5-1daa-4396-a2d5-637363fde33b admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:28.322359 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4821362-056c-4632-b4c6-634d1e9f5b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:28.323130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4821362-056c-4632-b4c6-634d1e9f5b60 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:28.323410 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4821362-056c-4632-b4c6-634d1e9f5b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:28.323677 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4821362-056c-4632-b4c6-634d1e9f5b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:28.324386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4821362-056c-4632-b4c6-634d1e9f5b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:28.326360 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4821362-056c-4632-b4c6-634d1e9f5b60 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:28.365014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 973/1969] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:34:28 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:34:28.369718 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9475f-6207-4ba2-a974-5b6d6a1c1159 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:28.383302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9475f-6207-4ba2-a974-5b6d6a1c1159 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:28.466960 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2952b-4b24-4232-a91d-10a6a34fc8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:28.467660 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2952b-4b24-4232-a91d-10a6a34fc8ab admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:28.467949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2952b-4b24-4232-a91d-10a6a34fc8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:28.468235 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2952b-4b24-4232-a91d-10a6a34fc8ab admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:28.469608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2952b-4b24-4232-a91d-10a6a34fc8ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:28.471554 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2952b-4b24-4232-a91d-10a6a34fc8ab admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:28.497945 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 997/1970] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:34:28 2022] POST /identity/v3/users => generated 299 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:28.499234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4821362-056c-4632-b4c6-634d1e9f5b60 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:28.509819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4821362-056c-4632-b4c6-634d1e9f5b60 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:28.515360 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cb733-c235-41ee-85bf-5096ab01fd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:28.516150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cb733-c235-41ee-85bf-5096ab01fd85 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:28.516552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cb733-c235-41ee-85bf-5096ab01fd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:28.516944 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cb733-c235-41ee-85bf-5096ab01fd85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:28.518000 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cb733-c235-41ee-85bf-5096ab01fd85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:28.521014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cb733-c235-41ee-85bf-5096ab01fd85 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:28.537342 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 974/1971] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:28.538736 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2952b-4b24-4232-a91d-10a6a34fc8ab admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:28.549690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2952b-4b24-4232-a91d-10a6a34fc8ab admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:28.555123 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bbfcb-f14a-4501-9878-996f94336f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:28.556016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bbfcb-f14a-4501-9878-996f94336f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:28.556316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bbfcb-f14a-4501-9878-996f94336f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:28.556568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bbfcb-f14a-4501-9878-996f94336f17 admin admin] PATH_INFO: `/v3/projects/4552ecfb98244555a39544eddc67bd8c/users/dd3501651699484583b9c70b02b3396f/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:28.572734 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bbfcb-f14a-4501-9878-996f94336f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4552ecfb98244555a39544eddc67bd8c, user_id=dd3501651699484583b9c70b02b3396f, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:28.575498 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bbfcb-f14a-4501-9878-996f94336f17 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:28.591937 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 998/1972] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:28 2022] PUT /identity/v3/projects/4552ecfb98244555a39544eddc67bd8c/users/dd3501651699484583b9c70b02b3396f/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:28.596036 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cb733-c235-41ee-85bf-5096ab01fd85 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:28.611223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cb733-c235-41ee-85bf-5096ab01fd85 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:28.693162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffde5e-dc45-40b1-bafe-655f42cc739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:28.693851 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffde5e-dc45-40b1-bafe-655f42cc739d admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:28.695226 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffde5e-dc45-40b1-bafe-655f42cc739d admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:28.695226 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffde5e-dc45-40b1-bafe-655f42cc739d admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:28.695819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffde5e-dc45-40b1-bafe-655f42cc739d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:28.697471 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffde5e-dc45-40b1-bafe-655f42cc739d admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:28.707386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 975/1973] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:34:28.712003 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bbfcb-f14a-4501-9878-996f94336f17 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:28.723071 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bbfcb-f14a-4501-9878-996f94336f17 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:28.728518 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3f129-db9f-462e-a36b-f9fda73ba1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:28.729505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3f129-db9f-462e-a36b-f9fda73ba1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:28.729851 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3f129-db9f-462e-a36b-f9fda73ba1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:28.730211 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3f129-db9f-462e-a36b-f9fda73ba1bf admin admin] PATH_INFO: `/v3/projects/4552ecfb98244555a39544eddc67bd8c/users/dd3501651699484583b9c70b02b3396f/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:28.732329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3f129-db9f-462e-a36b-f9fda73ba1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4552ecfb98244555a39544eddc67bd8c, user_id=dd3501651699484583b9c70b02b3396f, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:28.735234 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3f129-db9f-462e-a36b-f9fda73ba1bf admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:28.747674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 999/1974] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:28 2022] PUT /identity/v3/projects/4552ecfb98244555a39544eddc67bd8c/users/dd3501651699484583b9c70b02b3396f/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:34:28.759541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcca22-e9c5-48dc-b17b-baf8fce2ecbe None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:28.759888 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcca22-e9c5-48dc-b17b-baf8fce2ecbe None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:28.760319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcca22-e9c5-48dc-b17b-baf8fce2ecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:28.800256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-41dcca22-e9c5-48dc-b17b-baf8fce2ecbe None None] MFA Rules not processed for user `dd3501651699484583b9c70b02b3396f`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:28.801681 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-41dcca22-e9c5-48dc-b17b-baf8fce2ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:28.892862 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 976/1975] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:28.904313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3f129-db9f-462e-a36b-f9fda73ba1bf admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:28.906179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-9cf3f129-db9f-462e-a36b-f9fda73ba1bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:28.980510 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3f129-db9f-462e-a36b-f9fda73ba1bf admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:28.984109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efd5bb-ef25-45c3-9d36-741838e9972e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:28.984810 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efd5bb-ef25-45c3-9d36-741838e9972e service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:28.985088 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efd5bb-ef25-45c3-9d36-741838e9972e service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:28.985401 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efd5bb-ef25-45c3-9d36-741838e9972e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:28.994364 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efd5bb-ef25-45c3-9d36-741838e9972e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:28.995884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efd5bb-ef25-45c3-9d36-741838e9972e service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:29.005799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1000/1976] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:34:29.103848 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcca22-e9c5-48dc-b17b-baf8fce2ecbe None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:29.192768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcca22-e9c5-48dc-b17b-baf8fce2ecbe None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:29.202083 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f182c-25b4-4c17-9840-142c5b53a380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:29.204800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f182c-25b4-4c17-9840-142c5b53a380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:29.205344 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f182c-25b4-4c17-9840-142c5b53a380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:29.205652 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f182c-25b4-4c17-9840-142c5b53a380 admin admin] PATH_INFO: `/v3/users/d0d1e15e13c44e8ba09e0a3225f3154e` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:29.209403 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f182c-25b4-4c17-9840-142c5b53a380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0d1e15e13c44e8ba09e0a3225f3154e)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:29.211822 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f182c-25b4-4c17-9840-142c5b53a380 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:29.280226 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c08f182c-25b4-4c17-9840-142c5b53a380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0d1e15e13c44e8ba09e0a3225f3154e'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:29.293231 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c08f182c-25b4-4c17-9840-142c5b53a380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0d1e15e13c44e8ba09e0a3225f3154e'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:29.301124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c08f182c-25b4-4c17-9840-142c5b53a380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0d1e15e13c44e8ba09e0a3225f3154e'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:29.302377 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c08f182c-25b4-4c17-9840-142c5b53a380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0d1e15e13c44e8ba09e0a3225f3154e'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:29.303028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c08f182c-25b4-4c17-9840-142c5b53a380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0d1e15e13c44e8ba09e0a3225f3154e'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:29.324662 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 977/1977] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:34:29 2022] DELETE /identity/v3/users/d0d1e15e13c44e8ba09e0a3225f3154e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:29.329159 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792a461-7c5e-475b-b3e6-77839ff34148 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:29.329449 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792a461-7c5e-475b-b3e6-77839ff34148 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:29.329750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792a461-7c5e-475b-b3e6-77839ff34148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:29.347006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-3792a461-7c5e-475b-b3e6-77839ff34148 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:29.348524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-3792a461-7c5e-475b-b3e6-77839ff34148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:29.433482 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1001/1978] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:29.442792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f182c-25b4-4c17-9840-142c5b53a380 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:29.444279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c08f182c-25b4-4c17-9840-142c5b53a380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:29.505630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f182c-25b4-4c17-9840-142c5b53a380 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:29.509704 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583c90b-aace-49aa-8dd4-00fdb6982348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:29.510407 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583c90b-aace-49aa-8dd4-00fdb6982348 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:29.510690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583c90b-aace-49aa-8dd4-00fdb6982348 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:29.510968 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583c90b-aace-49aa-8dd4-00fdb6982348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:29.521112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583c90b-aace-49aa-8dd4-00fdb6982348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:29.522665 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583c90b-aace-49aa-8dd4-00fdb6982348 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:29.533613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 978/1979] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:34:30.425943 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792a461-7c5e-475b-b3e6-77839ff34148 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:30.427524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-3792a461-7c5e-475b-b3e6-77839ff34148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:30.441683 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792a461-7c5e-475b-b3e6-77839ff34148 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:30.446701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7e734-1b87-4d43-bf4e-3b378b8e66f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:30.447603 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7e734-1b87-4d43-bf4e-3b378b8e66f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:30.447884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7e734-1b87-4d43-bf4e-3b378b8e66f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:30.448160 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7e734-1b87-4d43-bf4e-3b378b8e66f5 admin admin] PATH_INFO: `/v3/projects/f7b23136cc73475e90942ee179d5d2af` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:30.449349 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7e734-1b87-4d43-bf4e-3b378b8e66f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7b23136cc73475e90942ee179d5d2af)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:30.451263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7e734-1b87-4d43-bf4e-3b378b8e66f5 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:30.504625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c3e7e734-1b87-4d43-bf4e-3b378b8e66f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7b23136cc73475e90942ee179d5d2af', 'request_id': 'req-c3e7e734-1b87-4d43-bf4e-3b378b8e66f5'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:30.514184 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c3e7e734-1b87-4d43-bf4e-3b378b8e66f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7b23136cc73475e90942ee179d5d2af', 'request_id': 'req-c3e7e734-1b87-4d43-bf4e-3b378b8e66f5'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:30.524610 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c3e7e734-1b87-4d43-bf4e-3b378b8e66f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7b23136cc73475e90942ee179d5d2af', 'request_id': 'req-c3e7e734-1b87-4d43-bf4e-3b378b8e66f5'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:30.548794 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c3e7e734-1b87-4d43-bf4e-3b378b8e66f5 admin admin] The token cache is being invalidate because project f7b23136cc73475e90942ee179d5d2af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:34:30.548794 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c3e7e734-1b87-4d43-bf4e-3b378b8e66f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:30.549639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c3e7e734-1b87-4d43-bf4e-3b378b8e66f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:30.554742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1002/1980] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:34:30 2022] DELETE /identity/v3/projects/f7b23136cc73475e90942ee179d5d2af => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:30.558679 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583c90b-aace-49aa-8dd4-00fdb6982348 service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:30.571668 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583c90b-aace-49aa-8dd4-00fdb6982348 service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:30.651008 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924d36d-9d96-4542-8b98-409e09e36333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:30.652331 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924d36d-9d96-4542-8b98-409e09e36333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:30.652787 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924d36d-9d96-4542-8b98-409e09e36333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:30.653204 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924d36d-9d96-4542-8b98-409e09e36333 admin admin] PATH_INFO: `/v3/users/dd3501651699484583b9c70b02b3396f` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:30.655134 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924d36d-9d96-4542-8b98-409e09e36333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd3501651699484583b9c70b02b3396f)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:30.657155 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924d36d-9d96-4542-8b98-409e09e36333 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:30.706985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8924d36d-9d96-4542-8b98-409e09e36333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd3501651699484583b9c70b02b3396f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:30.733190 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8924d36d-9d96-4542-8b98-409e09e36333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd3501651699484583b9c70b02b3396f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:30.733190 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8924d36d-9d96-4542-8b98-409e09e36333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd3501651699484583b9c70b02b3396f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:30.733190 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8924d36d-9d96-4542-8b98-409e09e36333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd3501651699484583b9c70b02b3396f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:30.733881 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8924d36d-9d96-4542-8b98-409e09e36333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd3501651699484583b9c70b02b3396f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:30.761478 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 979/1981] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:34:30 2022] DELETE /identity/v3/users/dd3501651699484583b9c70b02b3396f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:32.624074 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7e734-1b87-4d43-bf4e-3b378b8e66f5 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:32.625577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c3e7e734-1b87-4d43-bf4e-3b378b8e66f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:32.640679 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7e734-1b87-4d43-bf4e-3b378b8e66f5 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:32.727962 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15370df1-f65a-4638-a9b5-2b1eddd86939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:32.761285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15370df1-f65a-4638-a9b5-2b1eddd86939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:32.761285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15370df1-f65a-4638-a9b5-2b1eddd86939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:32.761285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15370df1-f65a-4638-a9b5-2b1eddd86939 admin admin] PATH_INFO: `/v3/projects/4552ecfb98244555a39544eddc67bd8c` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:32.761285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15370df1-f65a-4638-a9b5-2b1eddd86939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4552ecfb98244555a39544eddc67bd8c)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:32.768524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15370df1-f65a-4638-a9b5-2b1eddd86939 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:32.858619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-15370df1-f65a-4638-a9b5-2b1eddd86939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4552ecfb98244555a39544eddc67bd8c', 'request_id': 'req-15370df1-f65a-4638-a9b5-2b1eddd86939'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:32.871906 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-15370df1-f65a-4638-a9b5-2b1eddd86939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4552ecfb98244555a39544eddc67bd8c', 'request_id': 'req-15370df1-f65a-4638-a9b5-2b1eddd86939'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:32.881055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-15370df1-f65a-4638-a9b5-2b1eddd86939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4552ecfb98244555a39544eddc67bd8c', 'request_id': 'req-15370df1-f65a-4638-a9b5-2b1eddd86939'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:32.899511 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-15370df1-f65a-4638-a9b5-2b1eddd86939 admin admin] The token cache is being invalidate because project 4552ecfb98244555a39544eddc67bd8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:34:32.899511 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-15370df1-f65a-4638-a9b5-2b1eddd86939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:32.899812 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-15370df1-f65a-4638-a9b5-2b1eddd86939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:32.902066 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1003/1982] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:34:32 2022] DELETE /identity/v3/projects/4552ecfb98244555a39544eddc67bd8c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:32.906921 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe81606-28ed-4def-8b69-e5b5b8662187 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:32.907846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe81606-28ed-4def-8b69-e5b5b8662187 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:32.908585 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe81606-28ed-4def-8b69-e5b5b8662187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:32.934294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-9fe81606-28ed-4def-8b69-e5b5b8662187 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:32.935903 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9fe81606-28ed-4def-8b69-e5b5b8662187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:33.036232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 980/1983] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:34:33.050829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895247e-e294-4172-9307-b9dbf7d23847 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:33.051559 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895247e-e294-4172-9307-b9dbf7d23847 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:33.052385 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895247e-e294-4172-9307-b9dbf7d23847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:33.100957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-c895247e-e294-4172-9307-b9dbf7d23847 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:33.105253 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c895247e-e294-4172-9307-b9dbf7d23847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:33.114641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1004/1984] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:33.119646 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe81606-28ed-4def-8b69-e5b5b8662187 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:33.137870 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe81606-28ed-4def-8b69-e5b5b8662187 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:33.144771 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26876085-4ed5-4cd8-974e-87f8612d3760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:33.145609 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26876085-4ed5-4cd8-974e-87f8612d3760 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:33.145988 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26876085-4ed5-4cd8-974e-87f8612d3760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:33.147188 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26876085-4ed5-4cd8-974e-87f8612d3760 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:33.147597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26876085-4ed5-4cd8-974e-87f8612d3760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:34:33.147976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26876085-4ed5-4cd8-974e-87f8612d3760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:33.149738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26876085-4ed5-4cd8-974e-87f8612d3760 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:33.169560 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 981/1985] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:34:33.170189 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895247e-e294-4172-9307-b9dbf7d23847 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:33.182407 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895247e-e294-4172-9307-b9dbf7d23847 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:33.194482 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f6362-4a90-4c68-99b0-1e5457c76085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:33.198888 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f6362-4a90-4c68-99b0-1e5457c76085 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:33.198888 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f6362-4a90-4c68-99b0-1e5457c76085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:33.198888 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f6362-4a90-4c68-99b0-1e5457c76085 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:33.198888 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f6362-4a90-4c68-99b0-1e5457c76085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:33.198888 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f6362-4a90-4c68-99b0-1e5457c76085 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:33.230388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1005/1986] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:34:33 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:34:33.234395 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26876085-4ed5-4cd8-974e-87f8612d3760 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:33.259842 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26876085-4ed5-4cd8-974e-87f8612d3760 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:33.351709 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0ea40-f1be-4f13-820f-237474dbecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:33.352753 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0ea40-f1be-4f13-820f-237474dbecea admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:33.353256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0ea40-f1be-4f13-820f-237474dbecea admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:33.353726 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0ea40-f1be-4f13-820f-237474dbecea admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:33.355831 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0ea40-f1be-4f13-820f-237474dbecea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:33.358116 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0ea40-f1be-4f13-820f-237474dbecea admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:33.387568 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 982/1987] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:34:33 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:33.393257 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f6362-4a90-4c68-99b0-1e5457c76085 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:33.413610 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f6362-4a90-4c68-99b0-1e5457c76085 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:33.422951 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59d2ff-2a17-47a3-9804-68b34db3a30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:33.424261 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59d2ff-2a17-47a3-9804-68b34db3a30b admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:33.424929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59d2ff-2a17-47a3-9804-68b34db3a30b admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:33.425493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59d2ff-2a17-47a3-9804-68b34db3a30b admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:33.426788 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59d2ff-2a17-47a3-9804-68b34db3a30b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:33.429707 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59d2ff-2a17-47a3-9804-68b34db3a30b admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:33.459145 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1006/1988] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:33.463489 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0ea40-f1be-4f13-820f-237474dbecea admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:33.480214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0ea40-f1be-4f13-820f-237474dbecea admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:33.493112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b7c66-7307-480f-9b20-adf44d31f874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:33.493959 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b7c66-7307-480f-9b20-adf44d31f874 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:33.494266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b7c66-7307-480f-9b20-adf44d31f874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:33.494737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b7c66-7307-480f-9b20-adf44d31f874 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:33.495716 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b7c66-7307-480f-9b20-adf44d31f874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:33.499406 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b7c66-7307-480f-9b20-adf44d31f874 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:33.523661 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 983/1989] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:33.527887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59d2ff-2a17-47a3-9804-68b34db3a30b admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:33.557279 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59d2ff-2a17-47a3-9804-68b34db3a30b admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:33.613839 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110d661-e14a-45c5-9454-e23dc0a8a710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:33.627884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110d661-e14a-45c5-9454-e23dc0a8a710 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:33.630237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110d661-e14a-45c5-9454-e23dc0a8a710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:33.630745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110d661-e14a-45c5-9454-e23dc0a8a710 admin admin] PATH_INFO: `/v3/projects/bb430890341e42d3a99202c4291b6b67/users/be9c5a7977774f55a0bfc3e93c3e7df3/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:33.677520 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110d661-e14a-45c5-9454-e23dc0a8a710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb430890341e42d3a99202c4291b6b67, user_id=be9c5a7977774f55a0bfc3e93c3e7df3, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:33.682806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110d661-e14a-45c5-9454-e23dc0a8a710 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:33.711106 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1007/1990] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:33 2022] PUT /identity/v3/projects/bb430890341e42d3a99202c4291b6b67/users/be9c5a7977774f55a0bfc3e93c3e7df3/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:33.717903 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe714708-d9b7-4e66-9159-2c52154a92bb None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:33.717903 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe714708-d9b7-4e66-9159-2c52154a92bb None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:33.717903 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe714708-d9b7-4e66-9159-2c52154a92bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:33.745637 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-fe714708-d9b7-4e66-9159-2c52154a92bb None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:33.747538 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-fe714708-d9b7-4e66-9159-2c52154a92bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:33.864332 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 984/1991] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:33.873337 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110d661-e14a-45c5-9454-e23dc0a8a710 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:33.875690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-f110d661-e14a-45c5-9454-e23dc0a8a710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:33.976955 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110d661-e14a-45c5-9454-e23dc0a8a710 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:33.981882 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ad321-cbdc-44eb-b9ef-ba1fae0f4b0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:33.984409 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ad321-cbdc-44eb-b9ef-ba1fae0f4b0a service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:33.984860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ad321-cbdc-44eb-b9ef-ba1fae0f4b0a service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:33.985078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ad321-cbdc-44eb-b9ef-ba1fae0f4b0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:34.001415 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ad321-cbdc-44eb-b9ef-ba1fae0f4b0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:34.003975 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ad321-cbdc-44eb-b9ef-ba1fae0f4b0a service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:34.031500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1008/1992] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:34:35.371007 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d52d4-172d-4d6e-8166-9197decf1ff5 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:35.371868 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d52d4-172d-4d6e-8166-9197decf1ff5 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:35.372351 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d52d4-172d-4d6e-8166-9197decf1ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:35.401878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-188d52d4-172d-4d6e-8166-9197decf1ff5 None None] MFA Rules not processed for user `be9c5a7977774f55a0bfc3e93c3e7df3`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:35.403465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-188d52d4-172d-4d6e-8166-9197decf1ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:35.490471 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 985/1993] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:35.495136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ad321-cbdc-44eb-b9ef-ba1fae0f4b0a service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:35.505458 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ad321-cbdc-44eb-b9ef-ba1fae0f4b0a service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:35.511388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d39402-c735-45a1-9c42-6bd4d72f94e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:35.512322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d39402-c735-45a1-9c42-6bd4d72f94e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:35.512991 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d39402-c735-45a1-9c42-6bd4d72f94e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:35.513969 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d39402-c735-45a1-9c42-6bd4d72f94e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:35.514881 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d39402-c735-45a1-9c42-6bd4d72f94e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:35.518118 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d39402-c735-45a1-9c42-6bd4d72f94e4 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:35.555217 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1009/1994] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:34:35 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:35.559285 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d52d4-172d-4d6e-8166-9197decf1ff5 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:35.584489 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d52d4-172d-4d6e-8166-9197decf1ff5 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:35.657790 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68863c8f-f35f-4bfb-904a-275a7c4b5c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:35.658467 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68863c8f-f35f-4bfb-904a-275a7c4b5c4a admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:35.658793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68863c8f-f35f-4bfb-904a-275a7c4b5c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:35.659064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68863c8f-f35f-4bfb-904a-275a7c4b5c4a admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:35.659754 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68863c8f-f35f-4bfb-904a-275a7c4b5c4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:35.661740 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68863c8f-f35f-4bfb-904a-275a7c4b5c4a admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:35.680306 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 986/1995] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:34:35 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:35.684267 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d39402-c735-45a1-9c42-6bd4d72f94e4 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:35.694720 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d39402-c735-45a1-9c42-6bd4d72f94e4 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:35.699305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a08f1-4187-460e-998d-e19735f43414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:35.699958 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a08f1-4187-460e-998d-e19735f43414 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:35.700235 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a08f1-4187-460e-998d-e19735f43414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:35.700505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a08f1-4187-460e-998d-e19735f43414 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:35.701249 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a08f1-4187-460e-998d-e19735f43414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:35.702840 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a08f1-4187-460e-998d-e19735f43414 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:35.713861 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1010/1996] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:35.717951 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68863c8f-f35f-4bfb-904a-275a7c4b5c4a admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:35.727881 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68863c8f-f35f-4bfb-904a-275a7c4b5c4a admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:35.732378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f388b8-70a2-44b7-8a2b-f17bc2c67991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:35.733269 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f388b8-70a2-44b7-8a2b-f17bc2c67991 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:35.733543 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f388b8-70a2-44b7-8a2b-f17bc2c67991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:35.733815 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f388b8-70a2-44b7-8a2b-f17bc2c67991 admin admin] PATH_INFO: `/v3/projects/941f9c0bac1e462b86fbdc5842af3d7e/users/bde86c415e7d4b97ab92ee8f9e398531/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:35.747922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f388b8-70a2-44b7-8a2b-f17bc2c67991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=941f9c0bac1e462b86fbdc5842af3d7e, user_id=bde86c415e7d4b97ab92ee8f9e398531, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:35.750597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f388b8-70a2-44b7-8a2b-f17bc2c67991 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:35.763713 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 987/1997] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:35 2022] PUT /identity/v3/projects/941f9c0bac1e462b86fbdc5842af3d7e/users/bde86c415e7d4b97ab92ee8f9e398531/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:35.767555 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a08f1-4187-460e-998d-e19735f43414 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:35.777968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a08f1-4187-460e-998d-e19735f43414 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:35.831945 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f528c5-dd1b-4b8e-bbe7-1d80798b2de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:35.832549 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f528c5-dd1b-4b8e-bbe7-1d80798b2de1 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:35.832838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f528c5-dd1b-4b8e-bbe7-1d80798b2de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:35.833107 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f528c5-dd1b-4b8e-bbe7-1d80798b2de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:35.833837 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f528c5-dd1b-4b8e-bbe7-1d80798b2de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:35.835962 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f528c5-dd1b-4b8e-bbe7-1d80798b2de1 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:35.845591 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1011/1998] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:35.849897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f388b8-70a2-44b7-8a2b-f17bc2c67991 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:35.860682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f388b8-70a2-44b7-8a2b-f17bc2c67991 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:35.865467 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b1712-d17c-46c7-b276-549ae83af394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:35.866348 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b1712-d17c-46c7-b276-549ae83af394 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:35.866632 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b1712-d17c-46c7-b276-549ae83af394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:35.866907 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b1712-d17c-46c7-b276-549ae83af394 admin admin] PATH_INFO: `/v3/projects/941f9c0bac1e462b86fbdc5842af3d7e/users/bde86c415e7d4b97ab92ee8f9e398531/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:35.868998 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b1712-d17c-46c7-b276-549ae83af394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=941f9c0bac1e462b86fbdc5842af3d7e, user_id=bde86c415e7d4b97ab92ee8f9e398531, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:35.871655 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b1712-d17c-46c7-b276-549ae83af394 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:35.883329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 988/1999] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:35 2022] PUT /identity/v3/projects/941f9c0bac1e462b86fbdc5842af3d7e/users/bde86c415e7d4b97ab92ee8f9e398531/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:34:36.685056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f528c5-dd1b-4b8e-bbe7-1d80798b2de1 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:36.687067 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b1f528c5-dd1b-4b8e-bbe7-1d80798b2de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:36.695383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaea728-7caf-430a-b83c-25ccf2f63872 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:36.696447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaea728-7caf-430a-b83c-25ccf2f63872 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:36.697018 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaea728-7caf-430a-b83c-25ccf2f63872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:36.703084 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f528c5-dd1b-4b8e-bbe7-1d80798b2de1 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:36.728615 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-bdaea728-7caf-430a-b83c-25ccf2f63872 None None] MFA Rules not processed for user `bde86c415e7d4b97ab92ee8f9e398531`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:36.729824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-bdaea728-7caf-430a-b83c-25ccf2f63872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:36.769882 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97548f5a-1492-486e-8877-ade0da93d3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:36.771147 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97548f5a-1492-486e-8877-ade0da93d3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:36.771426 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97548f5a-1492-486e-8877-ade0da93d3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:36.771698 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97548f5a-1492-486e-8877-ade0da93d3b8 admin admin] PATH_INFO: `/v3/users/257a68514f964cca8c38194ce6c9a5ea` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:36.773372 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97548f5a-1492-486e-8877-ade0da93d3b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=257a68514f964cca8c38194ce6c9a5ea)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:36.775853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97548f5a-1492-486e-8877-ade0da93d3b8 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:36.845667 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-97548f5a-1492-486e-8877-ade0da93d3b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '257a68514f964cca8c38194ce6c9a5ea'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:36.853996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 989/2000] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:36 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:34:36.863033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaea728-7caf-430a-b83c-25ccf2f63872 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:36.866542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-bdaea728-7caf-430a-b83c-25ccf2f63872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:36.866885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-97548f5a-1492-486e-8877-ade0da93d3b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '257a68514f964cca8c38194ce6c9a5ea'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:36.867690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-97548f5a-1492-486e-8877-ade0da93d3b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '257a68514f964cca8c38194ce6c9a5ea'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:36.880062 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-97548f5a-1492-486e-8877-ade0da93d3b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '257a68514f964cca8c38194ce6c9a5ea'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:36.881617 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-97548f5a-1492-486e-8877-ade0da93d3b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '257a68514f964cca8c38194ce6c9a5ea'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:36.904353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1012/2001] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:34:36 2022] DELETE /identity/v3/users/257a68514f964cca8c38194ce6c9a5ea => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:36.942484 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaea728-7caf-430a-b83c-25ccf2f63872 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:36.998337 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96e622-716c-4a75-9f2f-6868b4940e5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:36.999072 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96e622-716c-4a75-9f2f-6868b4940e5e service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:36.999375 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96e622-716c-4a75-9f2f-6868b4940e5e service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:37.000074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96e622-716c-4a75-9f2f-6868b4940e5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:37.002161 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-6c96e622-716c-4a75-9f2f-6868b4940e5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:37.089512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96e622-716c-4a75-9f2f-6868b4940e5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:37.091007 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96e622-716c-4a75-9f2f-6868b4940e5e service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:37.100914 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 990/2002] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:34:37.145654 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97548f5a-1492-486e-8877-ade0da93d3b8 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:37.147336 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-97548f5a-1492-486e-8877-ade0da93d3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:37.259384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97548f5a-1492-486e-8877-ade0da93d3b8 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:37.265095 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fea127-9f49-47a2-90bf-21c7a3f08131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:37.266025 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fea127-9f49-47a2-90bf-21c7a3f08131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:37.266308 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fea127-9f49-47a2-90bf-21c7a3f08131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:37.266612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fea127-9f49-47a2-90bf-21c7a3f08131 admin admin] PATH_INFO: `/v3/projects/c2eeb9017821482580e5f489157f77b3` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:37.267841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fea127-9f49-47a2-90bf-21c7a3f08131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2eeb9017821482580e5f489157f77b3)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:37.270036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fea127-9f49-47a2-90bf-21c7a3f08131 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:37.338850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-96fea127-9f49-47a2-90bf-21c7a3f08131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2eeb9017821482580e5f489157f77b3', 'request_id': 'req-96fea127-9f49-47a2-90bf-21c7a3f08131'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:37.349244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-96fea127-9f49-47a2-90bf-21c7a3f08131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2eeb9017821482580e5f489157f77b3', 'request_id': 'req-96fea127-9f49-47a2-90bf-21c7a3f08131'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:37.356428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-96fea127-9f49-47a2-90bf-21c7a3f08131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2eeb9017821482580e5f489157f77b3', 'request_id': 'req-96fea127-9f49-47a2-90bf-21c7a3f08131'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:37.372268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-96fea127-9f49-47a2-90bf-21c7a3f08131 admin admin] The token cache is being invalidate because project c2eeb9017821482580e5f489157f77b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:34:37.372592 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-96fea127-9f49-47a2-90bf-21c7a3f08131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:37.373224 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-96fea127-9f49-47a2-90bf-21c7a3f08131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:37.374780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1013/2003] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:34:37 2022] DELETE /identity/v3/projects/c2eeb9017821482580e5f489157f77b3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:37.379927 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d80a5-cbb1-4fde-973e-922ffa77611f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:37.380240 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d80a5-cbb1-4fde-973e-922ffa77611f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:37.380520 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d80a5-cbb1-4fde-973e-922ffa77611f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:37.399604 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-722d80a5-cbb1-4fde-973e-922ffa77611f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:37.400902 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-722d80a5-cbb1-4fde-973e-922ffa77611f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:37.469885 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 991/2004] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:37.474992 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38121823-d6cc-4a4e-995b-16bd53fd709b None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:37.475315 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38121823-d6cc-4a4e-995b-16bd53fd709b None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:37.475595 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38121823-d6cc-4a4e-995b-16bd53fd709b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:37.495933 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-38121823-d6cc-4a4e-995b-16bd53fd709b None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:37.497467 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-38121823-d6cc-4a4e-995b-16bd53fd709b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:37.505784 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1014/2005] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:37.510704 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d80a5-cbb1-4fde-973e-922ffa77611f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:37.520070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d80a5-cbb1-4fde-973e-922ffa77611f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:37.524832 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8190a-df86-4f08-b10b-d01d112f4e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:37.525472 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8190a-df86-4f08-b10b-d01d112f4e38 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:37.525821 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8190a-df86-4f08-b10b-d01d112f4e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:37.526092 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8190a-df86-4f08-b10b-d01d112f4e38 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:37.526888 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8190a-df86-4f08-b10b-d01d112f4e38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:34:37.527189 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8190a-df86-4f08-b10b-d01d112f4e38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:37.528795 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8190a-df86-4f08-b10b-d01d112f4e38 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:37.539942 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 992/2006] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:34:37.544294 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38121823-d6cc-4a4e-995b-16bd53fd709b None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:37.554658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38121823-d6cc-4a4e-995b-16bd53fd709b None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:37.559845 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a62ba9-e744-4f5a-a4b7-b54c62f5b6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:37.560500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a62ba9-e744-4f5a-a4b7-b54c62f5b6dc admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:37.560928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a62ba9-e744-4f5a-a4b7-b54c62f5b6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:37.561203 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a62ba9-e744-4f5a-a4b7-b54c62f5b6dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:37.561904 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a62ba9-e744-4f5a-a4b7-b54c62f5b6dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:37.563824 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a62ba9-e744-4f5a-a4b7-b54c62f5b6dc admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:37.589989 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1015/2007] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:34:37 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:37.593934 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8190a-df86-4f08-b10b-d01d112f4e38 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:37.605367 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8190a-df86-4f08-b10b-d01d112f4e38 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:37.660443 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102adba6-b9e5-4d05-8212-61d887d1eadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:37.661162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102adba6-b9e5-4d05-8212-61d887d1eadd admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:37.661438 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102adba6-b9e5-4d05-8212-61d887d1eadd admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:37.661711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102adba6-b9e5-4d05-8212-61d887d1eadd admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:37.663089 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102adba6-b9e5-4d05-8212-61d887d1eadd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:37.665052 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102adba6-b9e5-4d05-8212-61d887d1eadd admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:37.693275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 993/2008] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:34:37 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:34:37.697971 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a62ba9-e744-4f5a-a4b7-b54c62f5b6dc admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:37.708895 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a62ba9-e744-4f5a-a4b7-b54c62f5b6dc admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:37.713581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4fdbf-04c2-4398-8ab5-649fc8bdd149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:37.714243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4fdbf-04c2-4398-8ab5-649fc8bdd149 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:37.714520 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4fdbf-04c2-4398-8ab5-649fc8bdd149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:37.715218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4fdbf-04c2-4398-8ab5-649fc8bdd149 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:37.715511 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4fdbf-04c2-4398-8ab5-649fc8bdd149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:37.717137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4fdbf-04c2-4398-8ab5-649fc8bdd149 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:37.729535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1016/2009] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:37.733746 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102adba6-b9e5-4d05-8212-61d887d1eadd admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:37.744529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102adba6-b9e5-4d05-8212-61d887d1eadd admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:37.749124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ebcd0-fdad-413d-a01b-cf35d91c85b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:37.749772 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ebcd0-fdad-413d-a01b-cf35d91c85b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:37.750049 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ebcd0-fdad-413d-a01b-cf35d91c85b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:37.750316 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ebcd0-fdad-413d-a01b-cf35d91c85b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:37.751030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ebcd0-fdad-413d-a01b-cf35d91c85b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:37.752665 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ebcd0-fdad-413d-a01b-cf35d91c85b7 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:37.762233 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 994/2010] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:34:37.766241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4fdbf-04c2-4398-8ab5-649fc8bdd149 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:37.775821 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4fdbf-04c2-4398-8ab5-649fc8bdd149 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:37.780313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b186a-0e53-4b4d-a2c8-a263eb6e68f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:37.781201 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b186a-0e53-4b4d-a2c8-a263eb6e68f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:37.781475 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b186a-0e53-4b4d-a2c8-a263eb6e68f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:37.781745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b186a-0e53-4b4d-a2c8-a263eb6e68f1 admin admin] PATH_INFO: `/v3/projects/b6c4feb57d7f40b99cbf12b6a499683d/users/8808e6b6e23d4ea6a842695b5f8212bb/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:37.796057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b186a-0e53-4b4d-a2c8-a263eb6e68f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c4feb57d7f40b99cbf12b6a499683d, user_id=8808e6b6e23d4ea6a842695b5f8212bb, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:37.798755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b186a-0e53-4b4d-a2c8-a263eb6e68f1 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:37.812192 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1017/2011] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:37 2022] PUT /identity/v3/projects/b6c4feb57d7f40b99cbf12b6a499683d/users/8808e6b6e23d4ea6a842695b5f8212bb/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:34:37.822380 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9e054-05d3-4938-b65c-f2fe643b5ff8 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:37.822664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9e054-05d3-4938-b65c-f2fe643b5ff8 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:37.822966 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9e054-05d3-4938-b65c-f2fe643b5ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:37.849039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-fba9e054-05d3-4938-b65c-f2fe643b5ff8 None None] MFA Rules not processed for user `8808e6b6e23d4ea6a842695b5f8212bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:37.850782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-fba9e054-05d3-4938-b65c-f2fe643b5ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:37.915136 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 995/2012] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:37.919598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b186a-0e53-4b4d-a2c8-a263eb6e68f1 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:37.979255 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b186a-0e53-4b4d-a2c8-a263eb6e68f1 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:37.983866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517ee6f-f914-45bf-b26c-742ce3939dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:37.984516 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517ee6f-f914-45bf-b26c-742ce3939dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:37.984832 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517ee6f-f914-45bf-b26c-742ce3939dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:37.985107 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517ee6f-f914-45bf-b26c-742ce3939dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:37.985809 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517ee6f-f914-45bf-b26c-742ce3939dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:37.987716 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517ee6f-f914-45bf-b26c-742ce3939dc8 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:38.012762 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1018/2013] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:34:37 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:38.016819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9e054-05d3-4938-b65c-f2fe643b5ff8 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:38.028039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9e054-05d3-4938-b65c-f2fe643b5ff8 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:38.087767 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a38c5-8e15-4105-ba49-7c4f2204fd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:38.088426 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a38c5-8e15-4105-ba49-7c4f2204fd22 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:38.088730 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a38c5-8e15-4105-ba49-7c4f2204fd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:38.089002 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a38c5-8e15-4105-ba49-7c4f2204fd22 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:38.089688 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a38c5-8e15-4105-ba49-7c4f2204fd22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:38.091591 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a38c5-8e15-4105-ba49-7c4f2204fd22 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:38.111712 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 996/2014] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:34:38 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:38.115676 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517ee6f-f914-45bf-b26c-742ce3939dc8 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:38.125739 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517ee6f-f914-45bf-b26c-742ce3939dc8 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:38.130396 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e536e98-a18b-4152-a173-e697ae2e77fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:38.131040 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e536e98-a18b-4152-a173-e697ae2e77fa admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:38.131356 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e536e98-a18b-4152-a173-e697ae2e77fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:38.131631 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e536e98-a18b-4152-a173-e697ae2e77fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:38.132430 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e536e98-a18b-4152-a173-e697ae2e77fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:38.134059 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e536e98-a18b-4152-a173-e697ae2e77fa admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:38.144204 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1019/2015] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:38.148628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a38c5-8e15-4105-ba49-7c4f2204fd22 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:38.158314 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a38c5-8e15-4105-ba49-7c4f2204fd22 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:38.163599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06f902-2b06-48c7-87fd-529d95577a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:38.164462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06f902-2b06-48c7-87fd-529d95577a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:38.164774 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06f902-2b06-48c7-87fd-529d95577a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:38.165053 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06f902-2b06-48c7-87fd-529d95577a20 admin admin] PATH_INFO: `/v3/projects/e644bea1fe9d433a9808d1b0e858e7f9/users/fc252716d5784badb5e4318f53641f04/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:38.179148 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06f902-2b06-48c7-87fd-529d95577a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e644bea1fe9d433a9808d1b0e858e7f9, user_id=fc252716d5784badb5e4318f53641f04, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:38.181788 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06f902-2b06-48c7-87fd-529d95577a20 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:38.194078 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 997/2016] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:38 2022] PUT /identity/v3/projects/e644bea1fe9d433a9808d1b0e858e7f9/users/fc252716d5784badb5e4318f53641f04/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:38.197930 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e536e98-a18b-4152-a173-e697ae2e77fa admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:38.207630 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e536e98-a18b-4152-a173-e697ae2e77fa admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:38.261806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7cff2-60cf-4a1f-a487-8e07cbb7581b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:38.262471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7cff2-60cf-4a1f-a487-8e07cbb7581b admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:38.262749 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7cff2-60cf-4a1f-a487-8e07cbb7581b admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:38.263019 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7cff2-60cf-4a1f-a487-8e07cbb7581b admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:38.263743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7cff2-60cf-4a1f-a487-8e07cbb7581b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:38.265365 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7cff2-60cf-4a1f-a487-8e07cbb7581b admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:38.275499 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1020/2017] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:38.279743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06f902-2b06-48c7-87fd-529d95577a20 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:38.290705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06f902-2b06-48c7-87fd-529d95577a20 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:38.295402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d54ef-71c0-40ae-8106-53161b015ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:38.296277 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d54ef-71c0-40ae-8106-53161b015ce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:38.296580 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d54ef-71c0-40ae-8106-53161b015ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:38.296859 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d54ef-71c0-40ae-8106-53161b015ce8 admin admin] PATH_INFO: `/v3/projects/e644bea1fe9d433a9808d1b0e858e7f9/users/fc252716d5784badb5e4318f53641f04/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:38.298841 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d54ef-71c0-40ae-8106-53161b015ce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e644bea1fe9d433a9808d1b0e858e7f9, user_id=fc252716d5784badb5e4318f53641f04, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:38.301597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d54ef-71c0-40ae-8106-53161b015ce8 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:38.311703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 998/2018] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:38 2022] PUT /identity/v3/projects/e644bea1fe9d433a9808d1b0e858e7f9/users/fc252716d5784badb5e4318f53641f04/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:38.322885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8202c5-2656-4ae4-b09b-40e1989e7665 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:38.323174 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8202c5-2656-4ae4-b09b-40e1989e7665 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:38.323446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8202c5-2656-4ae4-b09b-40e1989e7665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:38.352957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-6a8202c5-2656-4ae4-b09b-40e1989e7665 None None] MFA Rules not processed for user `fc252716d5784badb5e4318f53641f04`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:38.354661 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-6a8202c5-2656-4ae4-b09b-40e1989e7665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:38.427140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1021/2019] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:38.439092 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d54ef-71c0-40ae-8106-53161b015ce8 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:38.440830 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-d20d54ef-71c0-40ae-8106-53161b015ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:38.498290 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8202c5-2656-4ae4-b09b-40e1989e7665 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:38.499839 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-6a8202c5-2656-4ae4-b09b-40e1989e7665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:38.503295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d54ef-71c0-40ae-8106-53161b015ce8 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:38.507824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890e5df-097b-4099-b734-28be2c0a9885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:38.508704 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890e5df-097b-4099-b734-28be2c0a9885 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:38.508986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890e5df-097b-4099-b734-28be2c0a9885 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:38.509259 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890e5df-097b-4099-b734-28be2c0a9885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:38.512116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8202c5-2656-4ae4-b09b-40e1989e7665 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:38.516043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec0320-7a89-4f17-9e6a-f5b9eb5816e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:38.516829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec0320-7a89-4f17-9e6a-f5b9eb5816e5 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:38.517509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec0320-7a89-4f17-9e6a-f5b9eb5816e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:38.517509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec0320-7a89-4f17-9e6a-f5b9eb5816e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:38.519190 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c2ec0320-7a89-4f17-9e6a-f5b9eb5816e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:38.519612 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890e5df-097b-4099-b734-28be2c0a9885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:38.521117 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890e5df-097b-4099-b734-28be2c0a9885 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:38.530561 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 999/2020] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:34:38.594649 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec0320-7a89-4f17-9e6a-f5b9eb5816e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:38.596206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec0320-7a89-4f17-9e6a-f5b9eb5816e5 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:38.608989 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890e5df-097b-4099-b734-28be2c0a9885 service cinder] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:38.613239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1022/2021] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:38 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:34:38.617964 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890e5df-097b-4099-b734-28be2c0a9885 service cinder] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:38.621723 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e972283-0eaf-4b5d-9d69-22b5f3387c67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:38.622380 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e972283-0eaf-4b5d-9d69-22b5f3387c67 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:38.622663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e972283-0eaf-4b5d-9d69-22b5f3387c67 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:38.622934 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e972283-0eaf-4b5d-9d69-22b5f3387c67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:38.685726 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e972283-0eaf-4b5d-9d69-22b5f3387c67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:38.687229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e972283-0eaf-4b5d-9d69-22b5f3387c67 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:38.696454 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1000/2022] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:34:52.983228 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec0320-7a89-4f17-9e6a-f5b9eb5816e5 service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:52.985352 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c2ec0320-7a89-4f17-9e6a-f5b9eb5816e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:53.054453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec0320-7a89-4f17-9e6a-f5b9eb5816e5 service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:53.060046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27923eaf-7bb0-48f6-a93a-755e5588b8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:53.060957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27923eaf-7bb0-48f6-a93a-755e5588b8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:53.061234 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27923eaf-7bb0-48f6-a93a-755e5588b8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:53.061508 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27923eaf-7bb0-48f6-a93a-755e5588b8f1 admin admin] PATH_INFO: `/v3/users/11786d75c3a442dc94d80dac65917309` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:53.064802 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27923eaf-7bb0-48f6-a93a-755e5588b8f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11786d75c3a442dc94d80dac65917309)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:53.064802 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27923eaf-7bb0-48f6-a93a-755e5588b8f1 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:53.137413 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-27923eaf-7bb0-48f6-a93a-755e5588b8f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11786d75c3a442dc94d80dac65917309'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:53.144563 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-27923eaf-7bb0-48f6-a93a-755e5588b8f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11786d75c3a442dc94d80dac65917309'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:53.145267 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-27923eaf-7bb0-48f6-a93a-755e5588b8f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11786d75c3a442dc94d80dac65917309'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:53.153954 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-27923eaf-7bb0-48f6-a93a-755e5588b8f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11786d75c3a442dc94d80dac65917309'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:53.154942 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-27923eaf-7bb0-48f6-a93a-755e5588b8f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11786d75c3a442dc94d80dac65917309'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:53.175238 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1023/2023] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:34:52 2022] DELETE /identity/v3/users/11786d75c3a442dc94d80dac65917309 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:53.180150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9df8a-a217-4d79-9295-f9358678ac99 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:53.180662 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9df8a-a217-4d79-9295-f9358678ac99 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:53.180939 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9df8a-a217-4d79-9295-f9358678ac99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:53.241030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-90e9df8a-a217-4d79-9295-f9358678ac99 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:53.242264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-90e9df8a-a217-4d79-9295-f9358678ac99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:53.335816 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1001/2024] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:34:53.346785 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27923eaf-7bb0-48f6-a93a-755e5588b8f1 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:53.351067 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-27923eaf-7bb0-48f6-a93a-755e5588b8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:53.418562 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27923eaf-7bb0-48f6-a93a-755e5588b8f1 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:53.423312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5249b-ed79-4549-825c-1a26c06317d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:53.424127 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5249b-ed79-4549-825c-1a26c06317d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:53.424398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5249b-ed79-4549-825c-1a26c06317d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:53.424750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5249b-ed79-4549-825c-1a26c06317d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:53.435328 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5249b-ed79-4549-825c-1a26c06317d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:53.436770 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5249b-ed79-4549-825c-1a26c06317d1 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:53.449876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1024/2025] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:34:53.750422 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9df8a-a217-4d79-9295-f9358678ac99 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:53.751955 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-90e9df8a-a217-4d79-9295-f9358678ac99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:53.767068 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9df8a-a217-4d79-9295-f9358678ac99 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:53.771969 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15067c5f-95f3-4707-850e-84b3a3358621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:53.772875 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15067c5f-95f3-4707-850e-84b3a3358621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:53.773157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15067c5f-95f3-4707-850e-84b3a3358621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:53.773431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15067c5f-95f3-4707-850e-84b3a3358621 admin admin] PATH_INFO: `/v3/projects/80dcf451975b4afb9e1dc9b7793c4027` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:53.774632 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15067c5f-95f3-4707-850e-84b3a3358621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80dcf451975b4afb9e1dc9b7793c4027)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:53.776566 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15067c5f-95f3-4707-850e-84b3a3358621 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:53.822975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-15067c5f-95f3-4707-850e-84b3a3358621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80dcf451975b4afb9e1dc9b7793c4027', 'request_id': 'req-15067c5f-95f3-4707-850e-84b3a3358621'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:53.829497 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-15067c5f-95f3-4707-850e-84b3a3358621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80dcf451975b4afb9e1dc9b7793c4027', 'request_id': 'req-15067c5f-95f3-4707-850e-84b3a3358621'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:53.835324 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-15067c5f-95f3-4707-850e-84b3a3358621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80dcf451975b4afb9e1dc9b7793c4027', 'request_id': 'req-15067c5f-95f3-4707-850e-84b3a3358621'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:53.848145 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-15067c5f-95f3-4707-850e-84b3a3358621 admin admin] The token cache is being invalidate because project 80dcf451975b4afb9e1dc9b7793c4027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:34:53.848438 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-15067c5f-95f3-4707-850e-84b3a3358621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:53.849120 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-15067c5f-95f3-4707-850e-84b3a3358621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:53.850727 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1002/2026] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:34:53 2022] DELETE /identity/v3/projects/80dcf451975b4afb9e1dc9b7793c4027 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:53.855534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790e063-0c9f-461b-ac37-aef96f107535 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:53.855820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790e063-0c9f-461b-ac37-aef96f107535 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:53.856154 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790e063-0c9f-461b-ac37-aef96f107535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:53.873961 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-6790e063-0c9f-461b-ac37-aef96f107535 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:53.875124 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-6790e063-0c9f-461b-ac37-aef96f107535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:53.932058 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1025/2027] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:53.940283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b1675-a172-417d-85bf-e8c769378d09 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:53.940597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b1675-a172-417d-85bf-e8c769378d09 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:53.940877 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b1675-a172-417d-85bf-e8c769378d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:53.959711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-7e2b1675-a172-417d-85bf-e8c769378d09 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:53.960854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-7e2b1675-a172-417d-85bf-e8c769378d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:53.969103 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1003/2028] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:53.973427 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790e063-0c9f-461b-ac37-aef96f107535 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:53.983306 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790e063-0c9f-461b-ac37-aef96f107535 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:53.987819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a5686-7417-4f18-9026-22be0910c9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:53.988970 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a5686-7417-4f18-9026-22be0910c9da admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:53.989245 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a5686-7417-4f18-9026-22be0910c9da admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:53.989507 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a5686-7417-4f18-9026-22be0910c9da admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:53.990241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a5686-7417-4f18-9026-22be0910c9da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:34:53.990542 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a5686-7417-4f18-9026-22be0910c9da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:53.992365 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a5686-7417-4f18-9026-22be0910c9da admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:54.004236 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1026/2029] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:34:54.008309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b1675-a172-417d-85bf-e8c769378d09 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:54.017686 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b1675-a172-417d-85bf-e8c769378d09 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:54.023116 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644035a3-45d6-4324-a51b-e3e6b78e9fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:54.023766 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644035a3-45d6-4324-a51b-e3e6b78e9fdd admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:54.024044 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644035a3-45d6-4324-a51b-e3e6b78e9fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:54.024318 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644035a3-45d6-4324-a51b-e3e6b78e9fdd admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:54.025073 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644035a3-45d6-4324-a51b-e3e6b78e9fdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:54.027011 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644035a3-45d6-4324-a51b-e3e6b78e9fdd admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:54.051541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1004/2030] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:34:54 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:34:54.056269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a5686-7417-4f18-9026-22be0910c9da admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:54.066114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a5686-7417-4f18-9026-22be0910c9da admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:54.120098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59402d94-e944-4767-aa50-d140f46743bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:54.120839 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59402d94-e944-4767-aa50-d140f46743bc admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:54.121143 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59402d94-e944-4767-aa50-d140f46743bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:54.121443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59402d94-e944-4767-aa50-d140f46743bc admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:54.122149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59402d94-e944-4767-aa50-d140f46743bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:54.124070 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59402d94-e944-4767-aa50-d140f46743bc admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:54.144188 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1027/2031] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:34:54 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:54.148297 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644035a3-45d6-4324-a51b-e3e6b78e9fdd admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:54.158230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644035a3-45d6-4324-a51b-e3e6b78e9fdd admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:54.163402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8f234-3f29-468c-bba5-7fc02aa7953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:54.164043 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8f234-3f29-468c-bba5-7fc02aa7953e admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:54.164324 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8f234-3f29-468c-bba5-7fc02aa7953e admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:54.164631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8f234-3f29-468c-bba5-7fc02aa7953e admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:54.165351 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8f234-3f29-468c-bba5-7fc02aa7953e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:54.166953 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8f234-3f29-468c-bba5-7fc02aa7953e admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:54.176934 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1005/2032] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:54.181178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59402d94-e944-4767-aa50-d140f46743bc admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:54.190814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59402d94-e944-4767-aa50-d140f46743bc admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:54.195579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a3761-27c3-4e4a-9f62-049f110129cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:54.196256 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a3761-27c3-4e4a-9f62-049f110129cd admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:54.196589 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a3761-27c3-4e4a-9f62-049f110129cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:54.196895 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a3761-27c3-4e4a-9f62-049f110129cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:54.197684 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a3761-27c3-4e4a-9f62-049f110129cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:54.199420 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a3761-27c3-4e4a-9f62-049f110129cd admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:54.209035 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1028/2033] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:54.213084 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8f234-3f29-468c-bba5-7fc02aa7953e admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:54.222649 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8f234-3f29-468c-bba5-7fc02aa7953e admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:54.228189 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03626e50-ba72-4fae-8e61-80e9175add8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:54.229083 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03626e50-ba72-4fae-8e61-80e9175add8a admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:54.229365 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03626e50-ba72-4fae-8e61-80e9175add8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:54.229640 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03626e50-ba72-4fae-8e61-80e9175add8a admin admin] PATH_INFO: `/v3/projects/cadc03031e9b43de84bed5e155652e34/users/9c6f642083a74e47bf1b984e150a11c4/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:54.246387 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03626e50-ba72-4fae-8e61-80e9175add8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cadc03031e9b43de84bed5e155652e34, user_id=9c6f642083a74e47bf1b984e150a11c4, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:54.249090 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03626e50-ba72-4fae-8e61-80e9175add8a admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:54.261109 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1006/2034] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:54 2022] PUT /identity/v3/projects/cadc03031e9b43de84bed5e155652e34/users/9c6f642083a74e47bf1b984e150a11c4/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:54.271401 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14629f-57e5-425e-b595-e17d19da0ae1 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:54.271688 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14629f-57e5-425e-b595-e17d19da0ae1 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:54.271964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14629f-57e5-425e-b595-e17d19da0ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:54.299366 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-ce14629f-57e5-425e-b595-e17d19da0ae1 None None] MFA Rules not processed for user `9c6f642083a74e47bf1b984e150a11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:54.300664 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-ce14629f-57e5-425e-b595-e17d19da0ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:54.403591 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1029/2035] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:54.423448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03626e50-ba72-4fae-8e61-80e9175add8a admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:54.425809 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-03626e50-ba72-4fae-8e61-80e9175add8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:54.507449 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03626e50-ba72-4fae-8e61-80e9175add8a admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:54.511174 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532158a-3059-4aa2-bf1a-e75b713e3c09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:54.511807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532158a-3059-4aa2-bf1a-e75b713e3c09 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:54.512088 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532158a-3059-4aa2-bf1a-e75b713e3c09 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:54.512356 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532158a-3059-4aa2-bf1a-e75b713e3c09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:54.528966 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532158a-3059-4aa2-bf1a-e75b713e3c09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:54.530705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532158a-3059-4aa2-bf1a-e75b713e3c09 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:54.545690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1007/2036] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:34:54.573783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14629f-57e5-425e-b595-e17d19da0ae1 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:54.660986 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14629f-57e5-425e-b595-e17d19da0ae1 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:54.668429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a09afc-c27e-4c40-9458-d641db86efe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:54.669399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a09afc-c27e-4c40-9458-d641db86efe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:54.669683 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a09afc-c27e-4c40-9458-d641db86efe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:54.669961 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a09afc-c27e-4c40-9458-d641db86efe6 admin admin] PATH_INFO: `/v3/users/9c6f642083a74e47bf1b984e150a11c4` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:54.671269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a09afc-c27e-4c40-9458-d641db86efe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c6f642083a74e47bf1b984e150a11c4)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:54.673325 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a09afc-c27e-4c40-9458-d641db86efe6 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:54.768301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-28a09afc-c27e-4c40-9458-d641db86efe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c6f642083a74e47bf1b984e150a11c4'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:54.789229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-28a09afc-c27e-4c40-9458-d641db86efe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c6f642083a74e47bf1b984e150a11c4'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:54.796258 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-28a09afc-c27e-4c40-9458-d641db86efe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c6f642083a74e47bf1b984e150a11c4'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:54.813405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-28a09afc-c27e-4c40-9458-d641db86efe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c6f642083a74e47bf1b984e150a11c4'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:54.814051 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-28a09afc-c27e-4c40-9458-d641db86efe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c6f642083a74e47bf1b984e150a11c4'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:54.863795 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1030/2037] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:34:54 2022] DELETE /identity/v3/users/9c6f642083a74e47bf1b984e150a11c4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:54.869452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42bd9f-f7e5-44ee-8306-1c335738567a None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:54.869765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42bd9f-f7e5-44ee-8306-1c335738567a None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:54.870216 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42bd9f-f7e5-44ee-8306-1c335738567a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:54.898926 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-ab42bd9f-f7e5-44ee-8306-1c335738567a None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:54.899256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-ab42bd9f-f7e5-44ee-8306-1c335738567a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:55.010741 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1008/2038] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:55.022608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a09afc-c27e-4c40-9458-d641db86efe6 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:55.025017 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-28a09afc-c27e-4c40-9458-d641db86efe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:55.138817 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a09afc-c27e-4c40-9458-d641db86efe6 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:55.146318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbabe2a-3bd9-4061-b96f-8349a02be37e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:55.147700 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbabe2a-3bd9-4061-b96f-8349a02be37e service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:55.148550 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbabe2a-3bd9-4061-b96f-8349a02be37e service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:55.149310 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbabe2a-3bd9-4061-b96f-8349a02be37e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:55.196156 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbabe2a-3bd9-4061-b96f-8349a02be37e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:55.199630 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbabe2a-3bd9-4061-b96f-8349a02be37e service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:55.225136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1031/2039] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:34:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:34:55.682810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42bd9f-f7e5-44ee-8306-1c335738567a None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:55.684416 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-ab42bd9f-f7e5-44ee-8306-1c335738567a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:55.696900 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42bd9f-f7e5-44ee-8306-1c335738567a None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:55.701590 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a6dba-52c5-4ce5-bf0f-e2a665b6df07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:55.702555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6dba-52c5-4ce5-bf0f-e2a665b6df07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:55.702892 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6dba-52c5-4ce5-bf0f-e2a665b6df07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:55.703227 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6dba-52c5-4ce5-bf0f-e2a665b6df07 admin admin] PATH_INFO: `/v3/projects/cadc03031e9b43de84bed5e155652e34` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:55.704497 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a6dba-52c5-4ce5-bf0f-e2a665b6df07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cadc03031e9b43de84bed5e155652e34)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:55.706495 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a6dba-52c5-4ce5-bf0f-e2a665b6df07 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:55.768196 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-312a6dba-52c5-4ce5-bf0f-e2a665b6df07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cadc03031e9b43de84bed5e155652e34', 'request_id': 'req-312a6dba-52c5-4ce5-bf0f-e2a665b6df07'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:55.774791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-312a6dba-52c5-4ce5-bf0f-e2a665b6df07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cadc03031e9b43de84bed5e155652e34', 'request_id': 'req-312a6dba-52c5-4ce5-bf0f-e2a665b6df07'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:55.780032 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-312a6dba-52c5-4ce5-bf0f-e2a665b6df07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cadc03031e9b43de84bed5e155652e34', 'request_id': 'req-312a6dba-52c5-4ce5-bf0f-e2a665b6df07'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:55.792642 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-312a6dba-52c5-4ce5-bf0f-e2a665b6df07 admin admin] The token cache is being invalidate because project cadc03031e9b43de84bed5e155652e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:34:55.792939 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-312a6dba-52c5-4ce5-bf0f-e2a665b6df07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:55.793583 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-312a6dba-52c5-4ce5-bf0f-e2a665b6df07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:55.795344 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1009/2040] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:34:55 2022] DELETE /identity/v3/projects/cadc03031e9b43de84bed5e155652e34 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:56.696047 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7bcb7-f726-4d66-8ac3-a63d884d5675 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:56.696723 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7bcb7-f726-4d66-8ac3-a63d884d5675 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:56.696723 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7bcb7-f726-4d66-8ac3-a63d884d5675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:56.725652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-39a7bcb7-f726-4d66-8ac3-a63d884d5675 None None] MFA Rules not processed for user `f7fe55e67014453f87f47418493e0b92`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:56.727049 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-39a7bcb7-f726-4d66-8ac3-a63d884d5675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:56.789873 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1032/2041] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:57.576695 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a6dba-52c5-4ce5-bf0f-e2a665b6df07 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:57.578300 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-312a6dba-52c5-4ce5-bf0f-e2a665b6df07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:57.645429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a6dba-52c5-4ce5-bf0f-e2a665b6df07 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:57.651078 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d01223-63b3-43f9-ba9b-040fbc4c2384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:57.651995 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d01223-63b3-43f9-ba9b-040fbc4c2384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:57.652280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d01223-63b3-43f9-ba9b-040fbc4c2384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:57.652586 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d01223-63b3-43f9-ba9b-040fbc4c2384 admin admin] PATH_INFO: `/v3/users/be9c5a7977774f55a0bfc3e93c3e7df3` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:57.653829 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d01223-63b3-43f9-ba9b-040fbc4c2384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be9c5a7977774f55a0bfc3e93c3e7df3)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:57.655951 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d01223-63b3-43f9-ba9b-040fbc4c2384 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:57.704622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b6d01223-63b3-43f9-ba9b-040fbc4c2384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be9c5a7977774f55a0bfc3e93c3e7df3'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:57.712083 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b6d01223-63b3-43f9-ba9b-040fbc4c2384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be9c5a7977774f55a0bfc3e93c3e7df3'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:57.719819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b6d01223-63b3-43f9-ba9b-040fbc4c2384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be9c5a7977774f55a0bfc3e93c3e7df3'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:57.721223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b6d01223-63b3-43f9-ba9b-040fbc4c2384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be9c5a7977774f55a0bfc3e93c3e7df3'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:57.721975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b6d01223-63b3-43f9-ba9b-040fbc4c2384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be9c5a7977774f55a0bfc3e93c3e7df3'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:57.745767 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1010/2042] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:34:57 2022] DELETE /identity/v3/users/be9c5a7977774f55a0bfc3e93c3e7df3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:58.009739 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7bcb7-f726-4d66-8ac3-a63d884d5675 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:58.020268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7bcb7-f726-4d66-8ac3-a63d884d5675 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:58.074607 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66120099-2055-4740-b07f-8115e3664f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:58.075461 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66120099-2055-4740-b07f-8115e3664f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:58.075744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66120099-2055-4740-b07f-8115e3664f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:58.076021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66120099-2055-4740-b07f-8115e3664f26 admin admin] PATH_INFO: `/v3/projects/bb430890341e42d3a99202c4291b6b67` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:58.077219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66120099-2055-4740-b07f-8115e3664f26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb430890341e42d3a99202c4291b6b67)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:58.079126 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66120099-2055-4740-b07f-8115e3664f26 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:58.123955 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-66120099-2055-4740-b07f-8115e3664f26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb430890341e42d3a99202c4291b6b67', 'request_id': 'req-66120099-2055-4740-b07f-8115e3664f26'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:58.130000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-66120099-2055-4740-b07f-8115e3664f26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb430890341e42d3a99202c4291b6b67', 'request_id': 'req-66120099-2055-4740-b07f-8115e3664f26'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:58.136182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-66120099-2055-4740-b07f-8115e3664f26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb430890341e42d3a99202c4291b6b67', 'request_id': 'req-66120099-2055-4740-b07f-8115e3664f26'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:58.147490 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-66120099-2055-4740-b07f-8115e3664f26 admin admin] The token cache is being invalidate because project bb430890341e42d3a99202c4291b6b67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:34:58.147768 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-66120099-2055-4740-b07f-8115e3664f26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:58.148371 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-66120099-2055-4740-b07f-8115e3664f26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:58.149914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1033/2043] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:34:58 2022] DELETE /identity/v3/projects/bb430890341e42d3a99202c4291b6b67 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:58.153894 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d01223-63b3-43f9-ba9b-040fbc4c2384 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:58.155251 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-b6d01223-63b3-43f9-ba9b-040fbc4c2384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:58.167557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d01223-63b3-43f9-ba9b-040fbc4c2384 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:58.222068 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5a061-709f-4bb2-92e1-48446e39fced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:58.223208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5a061-709f-4bb2-92e1-48446e39fced admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:58.223625 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5a061-709f-4bb2-92e1-48446e39fced admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:58.223910 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5a061-709f-4bb2-92e1-48446e39fced admin admin] PATH_INFO: `/v3/users/bde86c415e7d4b97ab92ee8f9e398531` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:58.225146 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5a061-709f-4bb2-92e1-48446e39fced admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde86c415e7d4b97ab92ee8f9e398531)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:58.227146 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5a061-709f-4bb2-92e1-48446e39fced admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:58.272951 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d3d5a061-709f-4bb2-92e1-48446e39fced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde86c415e7d4b97ab92ee8f9e398531'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:58.281835 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d3d5a061-709f-4bb2-92e1-48446e39fced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde86c415e7d4b97ab92ee8f9e398531'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:58.290149 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d3d5a061-709f-4bb2-92e1-48446e39fced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde86c415e7d4b97ab92ee8f9e398531'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:58.290783 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d3d5a061-709f-4bb2-92e1-48446e39fced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde86c415e7d4b97ab92ee8f9e398531'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:58.291456 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d3d5a061-709f-4bb2-92e1-48446e39fced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde86c415e7d4b97ab92ee8f9e398531'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:58.311749 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1011/2044] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:34:58 2022] DELETE /identity/v3/users/bde86c415e7d4b97ab92ee8f9e398531 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:34:58.623995 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66120099-2055-4740-b07f-8115e3664f26 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:58.625652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-66120099-2055-4740-b07f-8115e3664f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:58.646043 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66120099-2055-4740-b07f-8115e3664f26 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:58.702279 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a157a-9e71-4afa-b71f-5ee1f3d7eb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:58.703842 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a157a-9e71-4afa-b71f-5ee1f3d7eb14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:58.703842 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a157a-9e71-4afa-b71f-5ee1f3d7eb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:58.703842 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a157a-9e71-4afa-b71f-5ee1f3d7eb14 admin admin] PATH_INFO: `/v3/projects/941f9c0bac1e462b86fbdc5842af3d7e` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:58.704838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a157a-9e71-4afa-b71f-5ee1f3d7eb14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=941f9c0bac1e462b86fbdc5842af3d7e)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:58.706758 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a157a-9e71-4afa-b71f-5ee1f3d7eb14 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:58.753087 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ac8a157a-9e71-4afa-b71f-5ee1f3d7eb14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '941f9c0bac1e462b86fbdc5842af3d7e', 'request_id': 'req-ac8a157a-9e71-4afa-b71f-5ee1f3d7eb14'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:58.759284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ac8a157a-9e71-4afa-b71f-5ee1f3d7eb14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '941f9c0bac1e462b86fbdc5842af3d7e', 'request_id': 'req-ac8a157a-9e71-4afa-b71f-5ee1f3d7eb14'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:58.765022 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ac8a157a-9e71-4afa-b71f-5ee1f3d7eb14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '941f9c0bac1e462b86fbdc5842af3d7e', 'request_id': 'req-ac8a157a-9e71-4afa-b71f-5ee1f3d7eb14'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:58.777102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ac8a157a-9e71-4afa-b71f-5ee1f3d7eb14 admin admin] The token cache is being invalidate because project 941f9c0bac1e462b86fbdc5842af3d7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:34:58.777384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ac8a157a-9e71-4afa-b71f-5ee1f3d7eb14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:58.778010 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ac8a157a-9e71-4afa-b71f-5ee1f3d7eb14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:34:58.779577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1034/2045] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:34:58 2022] DELETE /identity/v3/projects/941f9c0bac1e462b86fbdc5842af3d7e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:58.784421 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d60e1-43a3-4f0d-9800-6093f865694d None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:58.784934 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d60e1-43a3-4f0d-9800-6093f865694d None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:58.785021 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d60e1-43a3-4f0d-9800-6093f865694d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:58.803754 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-673d60e1-43a3-4f0d-9800-6093f865694d None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:58.804990 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-673d60e1-43a3-4f0d-9800-6093f865694d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:58.874719 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1012/2046] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:58.883463 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da813ea-65cf-4e4d-9514-4f01b9457baa None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:58.883815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da813ea-65cf-4e4d-9514-4f01b9457baa None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:58.884097 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da813ea-65cf-4e4d-9514-4f01b9457baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:58.902213 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-0da813ea-65cf-4e4d-9514-4f01b9457baa None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:58.903417 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-0da813ea-65cf-4e4d-9514-4f01b9457baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:58.912613 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1035/2047] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:34:58.916754 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d60e1-43a3-4f0d-9800-6093f865694d None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:58.926304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d60e1-43a3-4f0d-9800-6093f865694d None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:58.931644 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af46a0-8068-4e9f-ba93-6ba474793785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:58.933227 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af46a0-8068-4e9f-ba93-6ba474793785 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:58.933227 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af46a0-8068-4e9f-ba93-6ba474793785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:58.933227 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af46a0-8068-4e9f-ba93-6ba474793785 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:58.933915 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af46a0-8068-4e9f-ba93-6ba474793785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:34:58.934310 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af46a0-8068-4e9f-ba93-6ba474793785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:58.935927 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af46a0-8068-4e9f-ba93-6ba474793785 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:58.957082 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1013/2048] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:34:58.958245 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da813ea-65cf-4e4d-9514-4f01b9457baa None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:58.971019 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da813ea-65cf-4e4d-9514-4f01b9457baa None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:58.976793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2528e29-b230-4f0a-a1b7-1126134a18b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:58.977849 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2528e29-b230-4f0a-a1b7-1126134a18b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:58.978290 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2528e29-b230-4f0a-a1b7-1126134a18b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:58.978715 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2528e29-b230-4f0a-a1b7-1126134a18b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:58.979550 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2528e29-b230-4f0a-a1b7-1126134a18b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:58.981646 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2528e29-b230-4f0a-a1b7-1126134a18b6 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:59.017264 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1036/2049] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:34:58 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:59.022174 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af46a0-8068-4e9f-ba93-6ba474793785 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:59.034633 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af46a0-8068-4e9f-ba93-6ba474793785 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:59.113670 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5005c7-d4c3-4605-b7a6-eb43517ad38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:59.114456 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5005c7-d4c3-4605-b7a6-eb43517ad38e admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:59.114741 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5005c7-d4c3-4605-b7a6-eb43517ad38e admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:59.115013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5005c7-d4c3-4605-b7a6-eb43517ad38e admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:59.116244 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5005c7-d4c3-4605-b7a6-eb43517ad38e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:59.118302 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5005c7-d4c3-4605-b7a6-eb43517ad38e admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:59.145867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1014/2050] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:34:59 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:59.149766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2528e29-b230-4f0a-a1b7-1126134a18b6 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:59.160661 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2528e29-b230-4f0a-a1b7-1126134a18b6 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:59.165994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0db31-a8d0-47d6-912c-64bfff7d2b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:59.166657 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0db31-a8d0-47d6-912c-64bfff7d2b9d admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:59.166938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0db31-a8d0-47d6-912c-64bfff7d2b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:59.167213 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0db31-a8d0-47d6-912c-64bfff7d2b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:59.167938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0db31-a8d0-47d6-912c-64bfff7d2b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:59.169574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0db31-a8d0-47d6-912c-64bfff7d2b9d admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:59.183037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1037/2051] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:59.184700 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5005c7-d4c3-4605-b7a6-eb43517ad38e admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:59.194845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5005c7-d4c3-4605-b7a6-eb43517ad38e admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:59.199508 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a9295-c8fe-48d2-86ef-05b4ac7bee5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:59.200189 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a9295-c8fe-48d2-86ef-05b4ac7bee5d admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:59.200471 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a9295-c8fe-48d2-86ef-05b4ac7bee5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:59.200778 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a9295-c8fe-48d2-86ef-05b4ac7bee5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:59.201541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a9295-c8fe-48d2-86ef-05b4ac7bee5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:59.203167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a9295-c8fe-48d2-86ef-05b4ac7bee5d admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:59.221655 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1015/2052] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:59.225093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0db31-a8d0-47d6-912c-64bfff7d2b9d admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:59.237130 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0db31-a8d0-47d6-912c-64bfff7d2b9d admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:59.241993 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f2b40-095f-4af5-8010-6f1a8b7a041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:59.242879 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f2b40-095f-4af5-8010-6f1a8b7a041a admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:59.243160 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f2b40-095f-4af5-8010-6f1a8b7a041a admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:59.243440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f2b40-095f-4af5-8010-6f1a8b7a041a admin admin] PATH_INFO: `/v3/projects/eb449b2dcffd4cc6aa9af05dabc0a2e0/users/a5a46ea7e01e46d59ade5d9af8b4ccf9/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:59.258096 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f2b40-095f-4af5-8010-6f1a8b7a041a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb449b2dcffd4cc6aa9af05dabc0a2e0, user_id=a5a46ea7e01e46d59ade5d9af8b4ccf9, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:59.260819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f2b40-095f-4af5-8010-6f1a8b7a041a admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:59.273855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1038/2053] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:59 2022] PUT /identity/v3/projects/eb449b2dcffd4cc6aa9af05dabc0a2e0/users/a5a46ea7e01e46d59ade5d9af8b4ccf9/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:59.283943 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f85df-c59a-4933-8bbf-89eb6ce3e927 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:59.284234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f85df-c59a-4933-8bbf-89eb6ce3e927 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:59.284665 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f85df-c59a-4933-8bbf-89eb6ce3e927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:59.311044 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-481f85df-c59a-4933-8bbf-89eb6ce3e927 None None] MFA Rules not processed for user `a5a46ea7e01e46d59ade5d9af8b4ccf9`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:59.312290 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-481f85df-c59a-4933-8bbf-89eb6ce3e927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:59.379397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1016/2054] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:59.384473 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f2b40-095f-4af5-8010-6f1a8b7a041a admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:59.444959 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f2b40-095f-4af5-8010-6f1a8b7a041a admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:59.449800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c0e38-fba7-4f01-b9a5-67a2479b2b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:59.450455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c0e38-fba7-4f01-b9a5-67a2479b2b68 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:59.450740 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c0e38-fba7-4f01-b9a5-67a2479b2b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:59.451015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c0e38-fba7-4f01-b9a5-67a2479b2b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:59.451705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c0e38-fba7-4f01-b9a5-67a2479b2b68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:59.453963 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c0e38-fba7-4f01-b9a5-67a2479b2b68 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:59.481701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1039/2055] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:34:59 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:34:59.482878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f85df-c59a-4933-8bbf-89eb6ce3e927 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:59.493940 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f85df-c59a-4933-8bbf-89eb6ce3e927 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:59.554641 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab095d7-748c-4fa9-ad30-a41f99b5ac42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:59.555456 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab095d7-748c-4fa9-ad30-a41f99b5ac42 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:59.555574 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab095d7-748c-4fa9-ad30-a41f99b5ac42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:59.555851 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab095d7-748c-4fa9-ad30-a41f99b5ac42 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:59.556704 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab095d7-748c-4fa9-ad30-a41f99b5ac42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:59.558743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab095d7-748c-4fa9-ad30-a41f99b5ac42 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:59.583741 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1017/2056] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:34:59 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:34:59.587597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c0e38-fba7-4f01-b9a5-67a2479b2b68 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:59.598779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c0e38-fba7-4f01-b9a5-67a2479b2b68 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:59.608206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024762b-76a2-473e-a0ec-c6ce02b61f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:59.608974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024762b-76a2-473e-a0ec-c6ce02b61f86 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:59.609255 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024762b-76a2-473e-a0ec-c6ce02b61f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:59.609533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024762b-76a2-473e-a0ec-c6ce02b61f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:59.610269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024762b-76a2-473e-a0ec-c6ce02b61f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:59.611868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024762b-76a2-473e-a0ec-c6ce02b61f86 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:59.623620 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1040/2057] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:59.628207 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab095d7-748c-4fa9-ad30-a41f99b5ac42 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:59.639069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab095d7-748c-4fa9-ad30-a41f99b5ac42 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:59.643770 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8051d-afb5-4348-abe9-3a6a04b3eb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:59.644430 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8051d-afb5-4348-abe9-3a6a04b3eb40 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:59.644750 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8051d-afb5-4348-abe9-3a6a04b3eb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:59.645027 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8051d-afb5-4348-abe9-3a6a04b3eb40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:59.645784 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8051d-afb5-4348-abe9-3a6a04b3eb40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:59.647988 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8051d-afb5-4348-abe9-3a6a04b3eb40 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:59.658066 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1018/2058] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:34:59.662795 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024762b-76a2-473e-a0ec-c6ce02b61f86 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:59.672750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024762b-76a2-473e-a0ec-c6ce02b61f86 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:59.678199 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f8b46-5e9c-48bf-b594-6119023dfc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:59.679083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f8b46-5e9c-48bf-b594-6119023dfc9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:59.679361 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f8b46-5e9c-48bf-b594-6119023dfc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:59.679636 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f8b46-5e9c-48bf-b594-6119023dfc9e admin admin] PATH_INFO: `/v3/projects/0ce11fb852304fbaae8814f00dc7692d/users/0204b2969aaa4b35bac9e5b081255b49/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:59.695533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f8b46-5e9c-48bf-b594-6119023dfc9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce11fb852304fbaae8814f00dc7692d, user_id=0204b2969aaa4b35bac9e5b081255b49, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:59.698163 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f8b46-5e9c-48bf-b594-6119023dfc9e admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:59.712002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1041/2059] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:34:59 2022] PUT /identity/v3/projects/0ce11fb852304fbaae8814f00dc7692d/users/0204b2969aaa4b35bac9e5b081255b49/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:34:59.723493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80631f1-c3d1-49a5-9a21-b7d43b7876b6 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:59.723781 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80631f1-c3d1-49a5-9a21-b7d43b7876b6 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:59.724058 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80631f1-c3d1-49a5-9a21-b7d43b7876b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:59.750367 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-d80631f1-c3d1-49a5-9a21-b7d43b7876b6 None None] MFA Rules not processed for user `0204b2969aaa4b35bac9e5b081255b49`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:34:59.751576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-d80631f1-c3d1-49a5-9a21-b7d43b7876b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:34:59.815232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1019/2060] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:34:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:34:59.822451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f8b46-5e9c-48bf-b594-6119023dfc9e admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:59.903101 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f8b46-5e9c-48bf-b594-6119023dfc9e admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:34:59.907963 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeee4d2-5be5-4fde-8493-ba0703260ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:34:59.908744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeee4d2-5be5-4fde-8493-ba0703260ace admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:34:59.909109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeee4d2-5be5-4fde-8493-ba0703260ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:34:59.909438 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeee4d2-5be5-4fde-8493-ba0703260ace admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:34:59.910207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeee4d2-5be5-4fde-8493-ba0703260ace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:34:59.913092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeee4d2-5be5-4fde-8493-ba0703260ace admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:34:59.940124 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1042/2061] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:34:59 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:34:59.944058 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80631f1-c3d1-49a5-9a21-b7d43b7876b6 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:34:59.954500 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80631f1-c3d1-49a5-9a21-b7d43b7876b6 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:00.010022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d194748-4b89-4b76-ac27-c7bcfd38e131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:00.010696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d194748-4b89-4b76-ac27-c7bcfd38e131 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:00.010977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d194748-4b89-4b76-ac27-c7bcfd38e131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:00.011256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d194748-4b89-4b76-ac27-c7bcfd38e131 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:00.011953 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d194748-4b89-4b76-ac27-c7bcfd38e131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:00.013915 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d194748-4b89-4b76-ac27-c7bcfd38e131 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:00.035910 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1020/2062] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:34:59 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:35:00.040354 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeee4d2-5be5-4fde-8493-ba0703260ace admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:00.050410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeee4d2-5be5-4fde-8493-ba0703260ace admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:00.057518 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e77eb-c969-4d42-8464-a1c787779bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:00.058174 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e77eb-c969-4d42-8464-a1c787779bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:00.058461 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e77eb-c969-4d42-8464-a1c787779bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:00.058738 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e77eb-c969-4d42-8464-a1c787779bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:00.059465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e77eb-c969-4d42-8464-a1c787779bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:00.061103 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e77eb-c969-4d42-8464-a1c787779bc9 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:00.072126 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1043/2063] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:35:00.076269 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d194748-4b89-4b76-ac27-c7bcfd38e131 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:00.086410 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d194748-4b89-4b76-ac27-c7bcfd38e131 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:00.091198 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7608c8-6a76-46c7-8da6-7e2685392621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:00.092057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7608c8-6a76-46c7-8da6-7e2685392621 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:00.092334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7608c8-6a76-46c7-8da6-7e2685392621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:00.092633 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7608c8-6a76-46c7-8da6-7e2685392621 admin admin] PATH_INFO: `/v3/projects/08444db8ac8c4b40b8a98c184c9bda0b/users/62122ed66ab445ae9179bc0fee775dab/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:00.108033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7608c8-6a76-46c7-8da6-7e2685392621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08444db8ac8c4b40b8a98c184c9bda0b, user_id=62122ed66ab445ae9179bc0fee775dab, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:00.110729 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7608c8-6a76-46c7-8da6-7e2685392621 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:00.129201 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1021/2064] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:35:00 2022] PUT /identity/v3/projects/08444db8ac8c4b40b8a98c184c9bda0b/users/62122ed66ab445ae9179bc0fee775dab/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:35:00.133775 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e77eb-c969-4d42-8464-a1c787779bc9 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:00.149516 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e77eb-c969-4d42-8464-a1c787779bc9 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:00.221137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b6fdb-aab6-4c97-becc-ffac0cf6bc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:00.221833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b6fdb-aab6-4c97-becc-ffac0cf6bc51 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:00.222144 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b6fdb-aab6-4c97-becc-ffac0cf6bc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:00.222414 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b6fdb-aab6-4c97-becc-ffac0cf6bc51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:00.223739 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b6fdb-aab6-4c97-becc-ffac0cf6bc51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:00.225263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b6fdb-aab6-4c97-becc-ffac0cf6bc51 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:00.236271 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1044/2065] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:35:00.240285 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7608c8-6a76-46c7-8da6-7e2685392621 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:00.250537 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7608c8-6a76-46c7-8da6-7e2685392621 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:00.256620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a224a2d-b669-4fb6-86da-d232e534467e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:00.257536 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a224a2d-b669-4fb6-86da-d232e534467e admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:00.257814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a224a2d-b669-4fb6-86da-d232e534467e admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:00.258084 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a224a2d-b669-4fb6-86da-d232e534467e admin admin] PATH_INFO: `/v3/projects/08444db8ac8c4b40b8a98c184c9bda0b/users/62122ed66ab445ae9179bc0fee775dab/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:00.260152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a224a2d-b669-4fb6-86da-d232e534467e admin admin] RBAC: Authorizing `identity:create_grant(project_id=08444db8ac8c4b40b8a98c184c9bda0b, user_id=62122ed66ab445ae9179bc0fee775dab, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:00.262791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a224a2d-b669-4fb6-86da-d232e534467e admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:00.275762 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1022/2066] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:35:00 2022] PUT /identity/v3/projects/08444db8ac8c4b40b8a98c184c9bda0b/users/62122ed66ab445ae9179bc0fee775dab/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:35:00.285907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c0690-880b-4c30-aebd-d0fd9930757f None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:00.286279 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c0690-880b-4c30-aebd-d0fd9930757f None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:00.286563 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c0690-880b-4c30-aebd-d0fd9930757f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:00.313355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-728c0690-880b-4c30-aebd-d0fd9930757f None None] MFA Rules not processed for user `62122ed66ab445ae9179bc0fee775dab`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:00.314600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-728c0690-880b-4c30-aebd-d0fd9930757f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:00.390638 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1045/2067] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:00.402073 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a224a2d-b669-4fb6-86da-d232e534467e admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:00.403794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-8a224a2d-b669-4fb6-86da-d232e534467e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:00.470970 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a224a2d-b669-4fb6-86da-d232e534467e admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:00.475127 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9afd1-ca14-42b3-9304-b39a3ef0652f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:00.476247 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9afd1-ca14-42b3-9304-b39a3ef0652f service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:00.476805 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9afd1-ca14-42b3-9304-b39a3ef0652f service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:00.477311 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9afd1-ca14-42b3-9304-b39a3ef0652f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:00.531470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9afd1-ca14-42b3-9304-b39a3ef0652f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:00.532920 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9afd1-ca14-42b3-9304-b39a3ef0652f service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:00.541548 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1023/2068] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:35:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:35:02.020887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c0690-880b-4c30-aebd-d0fd9930757f None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:02.030520 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c0690-880b-4c30-aebd-d0fd9930757f None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:02.034339 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b5f02-00f5-4d33-8437-a8201c9d83d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:02.034990 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b5f02-00f5-4d33-8437-a8201c9d83d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:02.035270 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b5f02-00f5-4d33-8437-a8201c9d83d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:02.035542 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b5f02-00f5-4d33-8437-a8201c9d83d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:02.091574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b5f02-00f5-4d33-8437-a8201c9d83d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:02.093094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b5f02-00f5-4d33-8437-a8201c9d83d2 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:02.102262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1046/2069] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:35:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:35:02.602945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9afd1-ca14-42b3-9304-b39a3ef0652f service cinder] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:02.612295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9afd1-ca14-42b3-9304-b39a3ef0652f service cinder] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:02.617381 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af05a9-4762-4c7a-ad09-7d890c884dc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:02.618037 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af05a9-4762-4c7a-ad09-7d890c884dc3 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:02.618318 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af05a9-4762-4c7a-ad09-7d890c884dc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:02.618592 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af05a9-4762-4c7a-ad09-7d890c884dc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:02.628904 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af05a9-4762-4c7a-ad09-7d890c884dc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:02.630444 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af05a9-4762-4c7a-ad09-7d890c884dc3 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:02.641257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1024/2070] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:35:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:35:10.653603 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b5f02-00f5-4d33-8437-a8201c9d83d2 service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:10.715928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b5f02-00f5-4d33-8437-a8201c9d83d2 service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:10.720709 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0ed00-3486-44e8-b0e7-106643db0c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:10.721576 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0ed00-3486-44e8-b0e7-106643db0c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:10.721854 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0ed00-3486-44e8-b0e7-106643db0c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:10.722126 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0ed00-3486-44e8-b0e7-106643db0c65 admin admin] PATH_INFO: `/v3/users/a5a46ea7e01e46d59ade5d9af8b4ccf9` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:10.723551 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0ed00-3486-44e8-b0e7-106643db0c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5a46ea7e01e46d59ade5d9af8b4ccf9)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:10.725541 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0ed00-3486-44e8-b0e7-106643db0c65 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:10.769519 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c1c0ed00-3486-44e8-b0e7-106643db0c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5a46ea7e01e46d59ade5d9af8b4ccf9'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:10.776655 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c1c0ed00-3486-44e8-b0e7-106643db0c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5a46ea7e01e46d59ade5d9af8b4ccf9'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:10.777310 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c1c0ed00-3486-44e8-b0e7-106643db0c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5a46ea7e01e46d59ade5d9af8b4ccf9'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:10.783998 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c1c0ed00-3486-44e8-b0e7-106643db0c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5a46ea7e01e46d59ade5d9af8b4ccf9'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:10.784639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c1c0ed00-3486-44e8-b0e7-106643db0c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5a46ea7e01e46d59ade5d9af8b4ccf9'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:10.800698 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1047/2071] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:35:10 2022] DELETE /identity/v3/users/a5a46ea7e01e46d59ade5d9af8b4ccf9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:10.805172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ef5f5-1ac6-416a-bd15-27210fe7b37c None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:10.805637 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ef5f5-1ac6-416a-bd15-27210fe7b37c None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:10.805734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ef5f5-1ac6-416a-bd15-27210fe7b37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:10.822594 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-af4ef5f5-1ac6-416a-bd15-27210fe7b37c None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:10.823785 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-af4ef5f5-1ac6-416a-bd15-27210fe7b37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:10.881030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1025/2072] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:10.890583 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0ed00-3486-44e8-b0e7-106643db0c65 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:10.891969 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c1c0ed00-3486-44e8-b0e7-106643db0c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:10.946437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0ed00-3486-44e8-b0e7-106643db0c65 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:10.950058 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5868ec3-2510-465a-b690-969da0fd0327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:10.950690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5868ec3-2510-465a-b690-969da0fd0327 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:10.950971 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5868ec3-2510-465a-b690-969da0fd0327 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:10.951246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5868ec3-2510-465a-b690-969da0fd0327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:10.960868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5868ec3-2510-465a-b690-969da0fd0327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:10.962287 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5868ec3-2510-465a-b690-969da0fd0327 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:10.971534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1048/2073] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:35:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:35:11.281981 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ef5f5-1ac6-416a-bd15-27210fe7b37c None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:11.283395 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-af4ef5f5-1ac6-416a-bd15-27210fe7b37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:11.297397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ef5f5-1ac6-416a-bd15-27210fe7b37c None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:11.304090 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de6e4d-dd94-4610-bfea-63822da8de57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:11.305121 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de6e4d-dd94-4610-bfea-63822da8de57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:11.305409 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de6e4d-dd94-4610-bfea-63822da8de57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:11.305685 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de6e4d-dd94-4610-bfea-63822da8de57 admin admin] PATH_INFO: `/v3/projects/eb449b2dcffd4cc6aa9af05dabc0a2e0` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:11.306986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de6e4d-dd94-4610-bfea-63822da8de57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb449b2dcffd4cc6aa9af05dabc0a2e0)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:11.309352 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de6e4d-dd94-4610-bfea-63822da8de57 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:11.369597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d9de6e4d-dd94-4610-bfea-63822da8de57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb449b2dcffd4cc6aa9af05dabc0a2e0', 'request_id': 'req-d9de6e4d-dd94-4610-bfea-63822da8de57'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:11.377075 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d9de6e4d-dd94-4610-bfea-63822da8de57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb449b2dcffd4cc6aa9af05dabc0a2e0', 'request_id': 'req-d9de6e4d-dd94-4610-bfea-63822da8de57'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:11.386385 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d9de6e4d-dd94-4610-bfea-63822da8de57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb449b2dcffd4cc6aa9af05dabc0a2e0', 'request_id': 'req-d9de6e4d-dd94-4610-bfea-63822da8de57'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:11.414114 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d9de6e4d-dd94-4610-bfea-63822da8de57 admin admin] The token cache is being invalidate because project eb449b2dcffd4cc6aa9af05dabc0a2e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:35:11.414407 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d9de6e4d-dd94-4610-bfea-63822da8de57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:11.415050 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d9de6e4d-dd94-4610-bfea-63822da8de57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:11.416855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1026/2074] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:35:11 2022] DELETE /identity/v3/projects/eb449b2dcffd4cc6aa9af05dabc0a2e0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:11.421212 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5868ec3-2510-465a-b690-969da0fd0327 service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:11.432272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5868ec3-2510-465a-b690-969da0fd0327 service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:11.504240 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6b807-abfb-44cc-85a3-0ba44e9e3e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:11.505301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6b807-abfb-44cc-85a3-0ba44e9e3e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:11.505668 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6b807-abfb-44cc-85a3-0ba44e9e3e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:11.505946 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6b807-abfb-44cc-85a3-0ba44e9e3e6c admin admin] PATH_INFO: `/v3/users/0204b2969aaa4b35bac9e5b081255b49` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:11.507225 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6b807-abfb-44cc-85a3-0ba44e9e3e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0204b2969aaa4b35bac9e5b081255b49)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:11.513665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6b807-abfb-44cc-85a3-0ba44e9e3e6c admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:11.561341 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-06f6b807-abfb-44cc-85a3-0ba44e9e3e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0204b2969aaa4b35bac9e5b081255b49'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:11.568479 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-06f6b807-abfb-44cc-85a3-0ba44e9e3e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0204b2969aaa4b35bac9e5b081255b49'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:11.569176 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-06f6b807-abfb-44cc-85a3-0ba44e9e3e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0204b2969aaa4b35bac9e5b081255b49'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:11.577451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-06f6b807-abfb-44cc-85a3-0ba44e9e3e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0204b2969aaa4b35bac9e5b081255b49'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:11.578079 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-06f6b807-abfb-44cc-85a3-0ba44e9e3e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0204b2969aaa4b35bac9e5b081255b49'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:11.596740 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1049/2075] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:35:11 2022] DELETE /identity/v3/users/0204b2969aaa4b35bac9e5b081255b49 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:11.862290 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de6e4d-dd94-4610-bfea-63822da8de57 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:11.864058 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-d9de6e4d-dd94-4610-bfea-63822da8de57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:11.877083 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de6e4d-dd94-4610-bfea-63822da8de57 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:11.939159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef9cf8-8616-4885-a871-cc82e3c74f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:11.940370 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef9cf8-8616-4885-a871-cc82e3c74f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:11.940718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef9cf8-8616-4885-a871-cc82e3c74f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:11.941041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef9cf8-8616-4885-a871-cc82e3c74f4d admin admin] PATH_INFO: `/v3/projects/0ce11fb852304fbaae8814f00dc7692d` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:11.942400 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef9cf8-8616-4885-a871-cc82e3c74f4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce11fb852304fbaae8814f00dc7692d)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:11.944345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef9cf8-8616-4885-a871-cc82e3c74f4d admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:11.990067 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-ebef9cf8-8616-4885-a871-cc82e3c74f4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce11fb852304fbaae8814f00dc7692d', 'request_id': 'req-ebef9cf8-8616-4885-a871-cc82e3c74f4d'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:11.996412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-ebef9cf8-8616-4885-a871-cc82e3c74f4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce11fb852304fbaae8814f00dc7692d', 'request_id': 'req-ebef9cf8-8616-4885-a871-cc82e3c74f4d'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:12.001867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-ebef9cf8-8616-4885-a871-cc82e3c74f4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce11fb852304fbaae8814f00dc7692d', 'request_id': 'req-ebef9cf8-8616-4885-a871-cc82e3c74f4d'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:12.012719 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-ebef9cf8-8616-4885-a871-cc82e3c74f4d admin admin] The token cache is being invalidate because project 0ce11fb852304fbaae8814f00dc7692d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:35:12.012999 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-ebef9cf8-8616-4885-a871-cc82e3c74f4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:12.013601 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-ebef9cf8-8616-4885-a871-cc82e3c74f4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:12.015109 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1027/2076] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:35:11 2022] DELETE /identity/v3/projects/0ce11fb852304fbaae8814f00dc7692d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:12.019057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6b807-abfb-44cc-85a3-0ba44e9e3e6c admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:12.020821 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-06f6b807-abfb-44cc-85a3-0ba44e9e3e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:12.033948 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6b807-abfb-44cc-85a3-0ba44e9e3e6c admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:12.091494 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39175a47-9e98-471b-ae52-90f73c4cde04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:12.092356 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39175a47-9e98-471b-ae52-90f73c4cde04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:12.092689 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39175a47-9e98-471b-ae52-90f73c4cde04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:12.092966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39175a47-9e98-471b-ae52-90f73c4cde04 admin admin] PATH_INFO: `/v3/users/62122ed66ab445ae9179bc0fee775dab` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:12.094138 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39175a47-9e98-471b-ae52-90f73c4cde04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62122ed66ab445ae9179bc0fee775dab)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:12.096045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39175a47-9e98-471b-ae52-90f73c4cde04 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:12.141026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-39175a47-9e98-471b-ae52-90f73c4cde04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62122ed66ab445ae9179bc0fee775dab'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:12.147765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-39175a47-9e98-471b-ae52-90f73c4cde04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62122ed66ab445ae9179bc0fee775dab'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:12.149220 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-39175a47-9e98-471b-ae52-90f73c4cde04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62122ed66ab445ae9179bc0fee775dab'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:12.158625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-39175a47-9e98-471b-ae52-90f73c4cde04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62122ed66ab445ae9179bc0fee775dab'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:12.159254 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-39175a47-9e98-471b-ae52-90f73c4cde04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62122ed66ab445ae9179bc0fee775dab'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:12.176366 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1050/2077] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:35:12 2022] DELETE /identity/v3/users/62122ed66ab445ae9179bc0fee775dab => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:35:12.536496 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef9cf8-8616-4885-a871-cc82e3c74f4d admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:12.537940 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-ebef9cf8-8616-4885-a871-cc82e3c74f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:12.550975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef9cf8-8616-4885-a871-cc82e3c74f4d admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:12.614231 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea73b71-244c-47c2-b60e-6f0d38558d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:12.615898 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea73b71-244c-47c2-b60e-6f0d38558d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:12.616296 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea73b71-244c-47c2-b60e-6f0d38558d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:12.616705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea73b71-244c-47c2-b60e-6f0d38558d48 admin admin] PATH_INFO: `/v3/projects/08444db8ac8c4b40b8a98c184c9bda0b` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:12.618063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea73b71-244c-47c2-b60e-6f0d38558d48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08444db8ac8c4b40b8a98c184c9bda0b)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:12.620122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea73b71-244c-47c2-b60e-6f0d38558d48 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:12.671560 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-dea73b71-244c-47c2-b60e-6f0d38558d48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08444db8ac8c4b40b8a98c184c9bda0b', 'request_id': 'req-dea73b71-244c-47c2-b60e-6f0d38558d48'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:12.679267 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-dea73b71-244c-47c2-b60e-6f0d38558d48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08444db8ac8c4b40b8a98c184c9bda0b', 'request_id': 'req-dea73b71-244c-47c2-b60e-6f0d38558d48'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:12.686294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-dea73b71-244c-47c2-b60e-6f0d38558d48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08444db8ac8c4b40b8a98c184c9bda0b', 'request_id': 'req-dea73b71-244c-47c2-b60e-6f0d38558d48'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:12.699937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-dea73b71-244c-47c2-b60e-6f0d38558d48 admin admin] The token cache is being invalidate because project 08444db8ac8c4b40b8a98c184c9bda0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:35:12.700453 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-dea73b71-244c-47c2-b60e-6f0d38558d48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:12.701093 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-dea73b71-244c-47c2-b60e-6f0d38558d48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:12.702976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1028/2078] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:35:12 2022] DELETE /identity/v3/projects/08444db8ac8c4b40b8a98c184c9bda0b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:12.709736 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3e1b8-8742-40b9-99e1-fde3a02d4d59 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:12.710100 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3e1b8-8742-40b9-99e1-fde3a02d4d59 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:12.710478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3e1b8-8742-40b9-99e1-fde3a02d4d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:12.730903 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-0de3e1b8-8742-40b9-99e1-fde3a02d4d59 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:12.732208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-0de3e1b8-8742-40b9-99e1-fde3a02d4d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:12.795885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1051/2079] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:12.804480 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc3b9e-98ae-44b1-b89a-9e3db7b54343 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:12.804799 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc3b9e-98ae-44b1-b89a-9e3db7b54343 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:12.805082 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc3b9e-98ae-44b1-b89a-9e3db7b54343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:12.826055 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-becc3b9e-98ae-44b1-b89a-9e3db7b54343 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:12.827291 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-becc3b9e-98ae-44b1-b89a-9e3db7b54343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:12.838434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1029/2080] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:12.844789 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3e1b8-8742-40b9-99e1-fde3a02d4d59 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:12.857922 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3e1b8-8742-40b9-99e1-fde3a02d4d59 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:12.863477 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aae6a-19cf-42a0-af14-9710dfa47d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:12.864179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aae6a-19cf-42a0-af14-9710dfa47d47 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:12.864451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aae6a-19cf-42a0-af14-9710dfa47d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:12.864812 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aae6a-19cf-42a0-af14-9710dfa47d47 admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:12.865647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4aae6a-19cf-42a0-af14-9710dfa47d47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:35:12.865860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4aae6a-19cf-42a0-af14-9710dfa47d47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:12.867475 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4aae6a-19cf-42a0-af14-9710dfa47d47 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:12.885578 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc3b9e-98ae-44b1-b89a-9e3db7b54343 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:12.888814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1052/2081] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:35:12.896905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc3b9e-98ae-44b1-b89a-9e3db7b54343 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:12.902694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597acf59-01d4-4043-b3d8-dbe7f4889f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:12.903351 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597acf59-01d4-4043-b3d8-dbe7f4889f94 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:12.903628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597acf59-01d4-4043-b3d8-dbe7f4889f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:12.903900 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597acf59-01d4-4043-b3d8-dbe7f4889f94 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:12.904659 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597acf59-01d4-4043-b3d8-dbe7f4889f94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:12.906517 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597acf59-01d4-4043-b3d8-dbe7f4889f94 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:12.935758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1030/2082] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:35:12 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:35:12.937116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aae6a-19cf-42a0-af14-9710dfa47d47 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:12.948169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aae6a-19cf-42a0-af14-9710dfa47d47 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:13.006688 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b6d8d-bed8-464c-afc4-0388f57140fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:13.007384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b6d8d-bed8-464c-afc4-0388f57140fa admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:13.007670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b6d8d-bed8-464c-afc4-0388f57140fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:13.007947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b6d8d-bed8-464c-afc4-0388f57140fa admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:13.008683 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b6d8d-bed8-464c-afc4-0388f57140fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:13.010622 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b6d8d-bed8-464c-afc4-0388f57140fa admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:13.029853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1053/2083] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:35:12 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:35:13.034073 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597acf59-01d4-4043-b3d8-dbe7f4889f94 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:13.045347 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597acf59-01d4-4043-b3d8-dbe7f4889f94 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:13.050256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472fdd3-2b1a-4720-b795-ec2beeaf8cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:13.051446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472fdd3-2b1a-4720-b795-ec2beeaf8cee admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:13.051703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472fdd3-2b1a-4720-b795-ec2beeaf8cee admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:13.052149 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472fdd3-2b1a-4720-b795-ec2beeaf8cee admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:13.053602 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472fdd3-2b1a-4720-b795-ec2beeaf8cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:13.055693 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472fdd3-2b1a-4720-b795-ec2beeaf8cee admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:13.066289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1031/2084] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:35:13.070365 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b6d8d-bed8-464c-afc4-0388f57140fa admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:13.080508 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b6d8d-bed8-464c-afc4-0388f57140fa admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:13.085768 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65b4ad-d58e-4919-af06-4c32aaa645ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:13.086425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65b4ad-d58e-4919-af06-4c32aaa645ea admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:13.086709 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65b4ad-d58e-4919-af06-4c32aaa645ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:13.086983 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65b4ad-d58e-4919-af06-4c32aaa645ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:13.087718 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65b4ad-d58e-4919-af06-4c32aaa645ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:13.090353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65b4ad-d58e-4919-af06-4c32aaa645ea admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:13.101533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1054/2085] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:35:13.105585 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472fdd3-2b1a-4720-b795-ec2beeaf8cee admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:13.116083 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472fdd3-2b1a-4720-b795-ec2beeaf8cee admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:13.120583 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586c49d-c636-45b0-84fe-a77a6726bc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:13.121451 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586c49d-c636-45b0-84fe-a77a6726bc95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:13.121730 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586c49d-c636-45b0-84fe-a77a6726bc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:13.122001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586c49d-c636-45b0-84fe-a77a6726bc95 admin admin] PATH_INFO: `/v3/projects/fa604de18da04c76bd6932bc44d8547f/users/ae0b2bc8ab624995a0da0e93c5c34de7/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:13.136413 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586c49d-c636-45b0-84fe-a77a6726bc95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa604de18da04c76bd6932bc44d8547f, user_id=ae0b2bc8ab624995a0da0e93c5c34de7, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:13.139150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586c49d-c636-45b0-84fe-a77a6726bc95 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:13.152422 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1032/2086] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:35:13 2022] PUT /identity/v3/projects/fa604de18da04c76bd6932bc44d8547f/users/ae0b2bc8ab624995a0da0e93c5c34de7/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:35:13.163898 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ade7f8-0acc-45f1-b3bf-170a1df65c42 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:13.164184 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ade7f8-0acc-45f1-b3bf-170a1df65c42 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:13.164461 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ade7f8-0acc-45f1-b3bf-170a1df65c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:13.190428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-26ade7f8-0acc-45f1-b3bf-170a1df65c42 None None] MFA Rules not processed for user `ae0b2bc8ab624995a0da0e93c5c34de7`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:13.191688 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-26ade7f8-0acc-45f1-b3bf-170a1df65c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:13.261310 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1055/2087] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:35:13.292250 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586c49d-c636-45b0-84fe-a77a6726bc95 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:13.294176 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e586c49d-c636-45b0-84fe-a77a6726bc95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:13.351271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586c49d-c636-45b0-84fe-a77a6726bc95 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:13.355706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35916b9-0c0f-4234-ac91-6c4e490edcae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:13.356664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35916b9-0c0f-4234-ac91-6c4e490edcae service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:13.356868 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35916b9-0c0f-4234-ac91-6c4e490edcae service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:13.357159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35916b9-0c0f-4234-ac91-6c4e490edcae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:13.366429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35916b9-0c0f-4234-ac91-6c4e490edcae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:13.367857 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35916b9-0c0f-4234-ac91-6c4e490edcae service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:13.376991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1033/2088] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:35:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:35:14.724846 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f4199-ff76-44c8-8be8-f6bd186b60aa None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:14.725351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f4199-ff76-44c8-8be8-f6bd186b60aa None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:14.725545 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f4199-ff76-44c8-8be8-f6bd186b60aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:14.742840 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-5b7f4199-ff76-44c8-8be8-f6bd186b60aa None None] MFA Rules not processed for user `ae0b2bc8ab624995a0da0e93c5c34de7`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:14.744022 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-5b7f4199-ff76-44c8-8be8-f6bd186b60aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:14.752478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1056/2089] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:22.885363 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35916b9-0c0f-4234-ac91-6c4e490edcae service cinder] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:22.887377 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-d35916b9-0c0f-4234-ac91-6c4e490edcae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:22.949815 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35916b9-0c0f-4234-ac91-6c4e490edcae service cinder] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:22.954390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ceb18-db49-48e3-a8fb-32553eee76c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:22.955248 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ceb18-db49-48e3-a8fb-32553eee76c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:22.955541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ceb18-db49-48e3-a8fb-32553eee76c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:22.955807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ceb18-db49-48e3-a8fb-32553eee76c4 admin admin] PATH_INFO: `/v3/users/8808e6b6e23d4ea6a842695b5f8212bb` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:22.957041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ceb18-db49-48e3-a8fb-32553eee76c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8808e6b6e23d4ea6a842695b5f8212bb)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:22.958994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ceb18-db49-48e3-a8fb-32553eee76c4 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:23.003398 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b12ceb18-db49-48e3-a8fb-32553eee76c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8808e6b6e23d4ea6a842695b5f8212bb'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:23.010027 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b12ceb18-db49-48e3-a8fb-32553eee76c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8808e6b6e23d4ea6a842695b5f8212bb'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:23.016882 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b12ceb18-db49-48e3-a8fb-32553eee76c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8808e6b6e23d4ea6a842695b5f8212bb'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:23.017567 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b12ceb18-db49-48e3-a8fb-32553eee76c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8808e6b6e23d4ea6a842695b5f8212bb'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:23.018208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b12ceb18-db49-48e3-a8fb-32553eee76c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8808e6b6e23d4ea6a842695b5f8212bb'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:23.034738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1034/2090] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:35:22 2022] DELETE /identity/v3/users/8808e6b6e23d4ea6a842695b5f8212bb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:35:23.039890 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d664d8-d7c4-470d-b62d-8a7e6f1e4b3d None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:23.040350 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d664d8-d7c4-470d-b62d-8a7e6f1e4b3d None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:23.040454 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d664d8-d7c4-470d-b62d-8a7e6f1e4b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:23.057428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-04d664d8-d7c4-470d-b62d-8a7e6f1e4b3d None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:23.058642 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-04d664d8-d7c4-470d-b62d-8a7e6f1e4b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:23.115736 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1057/2091] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:23.125122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ceb18-db49-48e3-a8fb-32553eee76c4 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:23.127138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-b12ceb18-db49-48e3-a8fb-32553eee76c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:23.194883 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ceb18-db49-48e3-a8fb-32553eee76c4 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:23.199509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f2765-02a3-4ec0-a4eb-0af2d62571e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:23.200215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f2765-02a3-4ec0-a4eb-0af2d62571e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:23.200706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f2765-02a3-4ec0-a4eb-0af2d62571e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:23.201032 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f2765-02a3-4ec0-a4eb-0af2d62571e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:23.212110 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f2765-02a3-4ec0-a4eb-0af2d62571e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:23.213638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f2765-02a3-4ec0-a4eb-0af2d62571e8 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:23.225850 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1035/2092] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:35:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:35:23.634843 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d664d8-d7c4-470d-b62d-8a7e6f1e4b3d None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:23.636329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-04d664d8-d7c4-470d-b62d-8a7e6f1e4b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:23.648525 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d664d8-d7c4-470d-b62d-8a7e6f1e4b3d None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:23.665931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a18936-3181-4e9b-b020-5d021659888d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:23.667561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a18936-3181-4e9b-b020-5d021659888d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:23.667980 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a18936-3181-4e9b-b020-5d021659888d admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:23.669812 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a18936-3181-4e9b-b020-5d021659888d admin admin] PATH_INFO: `/v3/projects/b6c4feb57d7f40b99cbf12b6a499683d` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:23.671117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a18936-3181-4e9b-b020-5d021659888d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c4feb57d7f40b99cbf12b6a499683d)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:23.674540 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a18936-3181-4e9b-b020-5d021659888d admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:23.729789 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c7a18936-3181-4e9b-b020-5d021659888d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c4feb57d7f40b99cbf12b6a499683d', 'request_id': 'req-c7a18936-3181-4e9b-b020-5d021659888d'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:23.737394 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c7a18936-3181-4e9b-b020-5d021659888d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c4feb57d7f40b99cbf12b6a499683d', 'request_id': 'req-c7a18936-3181-4e9b-b020-5d021659888d'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:23.743684 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c7a18936-3181-4e9b-b020-5d021659888d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c4feb57d7f40b99cbf12b6a499683d', 'request_id': 'req-c7a18936-3181-4e9b-b020-5d021659888d'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:23.757759 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c7a18936-3181-4e9b-b020-5d021659888d admin admin] The token cache is being invalidate because project b6c4feb57d7f40b99cbf12b6a499683d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:35:23.758036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c7a18936-3181-4e9b-b020-5d021659888d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:23.758833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c7a18936-3181-4e9b-b020-5d021659888d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:23.760561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1058/2093] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:35:23 2022] DELETE /identity/v3/projects/b6c4feb57d7f40b99cbf12b6a499683d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:23.764566 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f2765-02a3-4ec0-a4eb-0af2d62571e8 service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:23.775089 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f2765-02a3-4ec0-a4eb-0af2d62571e8 service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:23.838069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00f4d3-06c3-4370-a15b-c0739d9a45a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:23.839477 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f4d3-06c3-4370-a15b-c0739d9a45a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:23.839761 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f4d3-06c3-4370-a15b-c0739d9a45a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:23.840061 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f4d3-06c3-4370-a15b-c0739d9a45a4 admin admin] PATH_INFO: `/v3/users/fc252716d5784badb5e4318f53641f04` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:23.841613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00f4d3-06c3-4370-a15b-c0739d9a45a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc252716d5784badb5e4318f53641f04)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:23.843739 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00f4d3-06c3-4370-a15b-c0739d9a45a4 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:23.900664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-dc00f4d3-06c3-4370-a15b-c0739d9a45a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc252716d5784badb5e4318f53641f04'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:23.911209 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-dc00f4d3-06c3-4370-a15b-c0739d9a45a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc252716d5784badb5e4318f53641f04'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:23.920907 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-dc00f4d3-06c3-4370-a15b-c0739d9a45a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc252716d5784badb5e4318f53641f04'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:23.921807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-dc00f4d3-06c3-4370-a15b-c0739d9a45a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc252716d5784badb5e4318f53641f04'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:23.922475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-dc00f4d3-06c3-4370-a15b-c0739d9a45a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc252716d5784badb5e4318f53641f04'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:23.953385 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1036/2094] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:35:23 2022] DELETE /identity/v3/users/fc252716d5784badb5e4318f53641f04 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:24.233984 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a18936-3181-4e9b-b020-5d021659888d admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:24.235527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c7a18936-3181-4e9b-b020-5d021659888d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:24.250521 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a18936-3181-4e9b-b020-5d021659888d admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:24.311469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cd59b-596b-47dc-92bd-cf09b7095227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:24.312356 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cd59b-596b-47dc-92bd-cf09b7095227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:24.312663 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cd59b-596b-47dc-92bd-cf09b7095227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:24.312940 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cd59b-596b-47dc-92bd-cf09b7095227 admin admin] PATH_INFO: `/v3/projects/e644bea1fe9d433a9808d1b0e858e7f9` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:24.314127 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cd59b-596b-47dc-92bd-cf09b7095227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e644bea1fe9d433a9808d1b0e858e7f9)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:24.316039 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cd59b-596b-47dc-92bd-cf09b7095227 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:24.370519 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-310cd59b-596b-47dc-92bd-cf09b7095227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e644bea1fe9d433a9808d1b0e858e7f9', 'request_id': 'req-310cd59b-596b-47dc-92bd-cf09b7095227'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:24.378928 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-310cd59b-596b-47dc-92bd-cf09b7095227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e644bea1fe9d433a9808d1b0e858e7f9', 'request_id': 'req-310cd59b-596b-47dc-92bd-cf09b7095227'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:24.387572 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-310cd59b-596b-47dc-92bd-cf09b7095227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e644bea1fe9d433a9808d1b0e858e7f9', 'request_id': 'req-310cd59b-596b-47dc-92bd-cf09b7095227'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:24.401784 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-310cd59b-596b-47dc-92bd-cf09b7095227 admin admin] The token cache is being invalidate because project e644bea1fe9d433a9808d1b0e858e7f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:35:24.402074 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-310cd59b-596b-47dc-92bd-cf09b7095227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:24.402765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-310cd59b-596b-47dc-92bd-cf09b7095227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:24.408687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1059/2095] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:35:24 2022] DELETE /identity/v3/projects/e644bea1fe9d433a9808d1b0e858e7f9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:24.410155 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861472c2-7c48-42fc-b7d4-046295c65bd7 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:24.410508 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861472c2-7c48-42fc-b7d4-046295c65bd7 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:24.410852 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861472c2-7c48-42fc-b7d4-046295c65bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:24.429161 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-861472c2-7c48-42fc-b7d4-046295c65bd7 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:24.430588 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-861472c2-7c48-42fc-b7d4-046295c65bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:24.494202 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1037/2096] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:35:24.503062 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13fca3-9c7e-4891-86c2-ce48ccdd26fd None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:24.503462 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13fca3-9c7e-4891-86c2-ce48ccdd26fd None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:24.503842 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13fca3-9c7e-4891-86c2-ce48ccdd26fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:24.524085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-8b13fca3-9c7e-4891-86c2-ce48ccdd26fd None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:24.525441 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-8b13fca3-9c7e-4891-86c2-ce48ccdd26fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:24.535558 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1060/2097] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:24.540365 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861472c2-7c48-42fc-b7d4-046295c65bd7 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:24.550020 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861472c2-7c48-42fc-b7d4-046295c65bd7 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:24.556242 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a46dd4-09a6-44ed-8f43-30d0d6fc64cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:24.557466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a46dd4-09a6-44ed-8f43-30d0d6fc64cc admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:24.558033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a46dd4-09a6-44ed-8f43-30d0d6fc64cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:24.558595 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a46dd4-09a6-44ed-8f43-30d0d6fc64cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:24.559886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a46dd4-09a6-44ed-8f43-30d0d6fc64cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:35:24.560511 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a46dd4-09a6-44ed-8f43-30d0d6fc64cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:24.562862 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a46dd4-09a6-44ed-8f43-30d0d6fc64cc admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:24.576755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1038/2098] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:35:24.581126 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13fca3-9c7e-4891-86c2-ce48ccdd26fd None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:24.591756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13fca3-9c7e-4891-86c2-ce48ccdd26fd None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:24.596449 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffaaa3-6ead-4ca8-b171-4260e1a5764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:24.597507 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffaaa3-6ead-4ca8-b171-4260e1a5764d admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:24.597809 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffaaa3-6ead-4ca8-b171-4260e1a5764d admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:24.598083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffaaa3-6ead-4ca8-b171-4260e1a5764d admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:24.599033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffaaa3-6ead-4ca8-b171-4260e1a5764d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:24.601126 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffaaa3-6ead-4ca8-b171-4260e1a5764d admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:24.607077 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dceaea-bf4e-43d7-b173-447df40cd69e None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:24.607361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dceaea-bf4e-43d7-b173-447df40cd69e None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:24.607632 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dceaea-bf4e-43d7-b173-447df40cd69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:24.634700 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-47dceaea-bf4e-43d7-b173-447df40cd69e None None] MFA Rules not processed for user `70b7101dccda45d78d379ec512eea44f`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:24.635898 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-47dceaea-bf4e-43d7-b173-447df40cd69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:24.649449 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1061/2099] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:35:24 2022] POST /identity/v3/projects => generated 389 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:35:24.653515 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffaaa3-6ead-4ca8-b171-4260e1a5764d admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:24.693087 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1039/2100] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:35:24.755758 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffaaa3-6ead-4ca8-b171-4260e1a5764d admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:24.761092 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff3d72-2aa7-44f6-852d-30ff9d048216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:24.761783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff3d72-2aa7-44f6-852d-30ff9d048216 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:24.762064 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff3d72-2aa7-44f6-852d-30ff9d048216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:24.762339 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff3d72-2aa7-44f6-852d-30ff9d048216 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:24.763022 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff3d72-2aa7-44f6-852d-30ff9d048216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:24.765002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff3d72-2aa7-44f6-852d-30ff9d048216 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:24.784974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1062/2101] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:35:24 2022] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:35:24.789010 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dceaea-bf4e-43d7-b173-447df40cd69e None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:24.815635 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dceaea-bf4e-43d7-b173-447df40cd69e None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:24.820827 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b49b5-a5e5-469f-9174-40078beaeb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:24.821483 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b49b5-a5e5-469f-9174-40078beaeb40 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:24.821759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b49b5-a5e5-469f-9174-40078beaeb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:24.822029 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b49b5-a5e5-469f-9174-40078beaeb40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:24.822743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b49b5-a5e5-469f-9174-40078beaeb40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:24.828875 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b49b5-a5e5-469f-9174-40078beaeb40 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:24.836789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1040/2102] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:35:24.840711 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff3d72-2aa7-44f6-852d-30ff9d048216 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:24.851138 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff3d72-2aa7-44f6-852d-30ff9d048216 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:24.856153 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35202eba-0062-404d-b686-9a631942aa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:24.856896 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35202eba-0062-404d-b686-9a631942aa89 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:24.857179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35202eba-0062-404d-b686-9a631942aa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:24.857454 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35202eba-0062-404d-b686-9a631942aa89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:24.858187 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35202eba-0062-404d-b686-9a631942aa89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:24.859799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35202eba-0062-404d-b686-9a631942aa89 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:24.870638 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1063/2103] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:35:24.874731 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b49b5-a5e5-469f-9174-40078beaeb40 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:24.884907 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b49b5-a5e5-469f-9174-40078beaeb40 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:24.889787 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce966d6-8fed-4e31-9f89-29e2583b0fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:24.890666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce966d6-8fed-4e31-9f89-29e2583b0fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:24.890939 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce966d6-8fed-4e31-9f89-29e2583b0fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:24.891209 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce966d6-8fed-4e31-9f89-29e2583b0fa0 admin admin] PATH_INFO: `/v3/projects/4c44f37c5a27449db1c9a983cafbdce0/users/a20a1f0c6fbb4378ae0dbb45b9406732/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:24.905050 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce966d6-8fed-4e31-9f89-29e2583b0fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c44f37c5a27449db1c9a983cafbdce0, user_id=a20a1f0c6fbb4378ae0dbb45b9406732, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:24.907712 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce966d6-8fed-4e31-9f89-29e2583b0fa0 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:24.921509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1041/2104] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:35:24 2022] PUT /identity/v3/projects/4c44f37c5a27449db1c9a983cafbdce0/users/a20a1f0c6fbb4378ae0dbb45b9406732/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:24.932351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05529b9-f229-42a1-8700-03b2a175b7c0 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:24.932684 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05529b9-f229-42a1-8700-03b2a175b7c0 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:24.932963 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05529b9-f229-42a1-8700-03b2a175b7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:24.959177 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-e05529b9-f229-42a1-8700-03b2a175b7c0 None None] MFA Rules not processed for user `a20a1f0c6fbb4378ae0dbb45b9406732`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:24.960198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-e05529b9-f229-42a1-8700-03b2a175b7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:25.024188 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1064/2105] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:25.028423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce966d6-8fed-4e31-9f89-29e2583b0fa0 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:25.119175 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce966d6-8fed-4e31-9f89-29e2583b0fa0 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:25.124855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e061c8-bb1b-4848-ad4b-cc77fadd13d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:25.125659 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e061c8-bb1b-4848-ad4b-cc77fadd13d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:25.126034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e061c8-bb1b-4848-ad4b-cc77fadd13d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:25.126414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e061c8-bb1b-4848-ad4b-cc77fadd13d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:25.127351 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e061c8-bb1b-4848-ad4b-cc77fadd13d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:25.129552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e061c8-bb1b-4848-ad4b-cc77fadd13d9 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:25.157976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1042/2106] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:35:25 2022] POST /identity/v3/projects => generated 389 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:35:25.163627 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05529b9-f229-42a1-8700-03b2a175b7c0 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:25.183401 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05529b9-f229-42a1-8700-03b2a175b7c0 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:25.258763 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1cf8b-37c7-41d6-9517-9b3a3c2126c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:25.260143 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1cf8b-37c7-41d6-9517-9b3a3c2126c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:25.260423 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1cf8b-37c7-41d6-9517-9b3a3c2126c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:25.260879 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1cf8b-37c7-41d6-9517-9b3a3c2126c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:25.261715 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1cf8b-37c7-41d6-9517-9b3a3c2126c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:25.263779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1cf8b-37c7-41d6-9517-9b3a3c2126c9 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:25.287805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1065/2107] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:35:25 2022] POST /identity/v3/users => generated 301 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:35:25.292270 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e061c8-bb1b-4848-ad4b-cc77fadd13d9 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:25.309699 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e061c8-bb1b-4848-ad4b-cc77fadd13d9 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:25.322751 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444eacb9-db69-456f-9072-f79431f71d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:25.323726 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444eacb9-db69-456f-9072-f79431f71d51 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:25.324400 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444eacb9-db69-456f-9072-f79431f71d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:25.324795 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444eacb9-db69-456f-9072-f79431f71d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:25.326207 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444eacb9-db69-456f-9072-f79431f71d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:25.328832 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444eacb9-db69-456f-9072-f79431f71d51 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:25.343917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1043/2108] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:35:25.348017 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1cf8b-37c7-41d6-9517-9b3a3c2126c9 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:25.361792 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1cf8b-37c7-41d6-9517-9b3a3c2126c9 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:25.368688 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e066cd3-88c0-4d91-a8d4-b432831cb489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:25.369934 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e066cd3-88c0-4d91-a8d4-b432831cb489 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:25.370528 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e066cd3-88c0-4d91-a8d4-b432831cb489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:25.370953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e066cd3-88c0-4d91-a8d4-b432831cb489 admin admin] PATH_INFO: `/v3/projects/eb0c8942a6c843a591e0799369c453cc/users/80facc45bb4f4c6e842393a124c68b95/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:25.390610 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e066cd3-88c0-4d91-a8d4-b432831cb489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb0c8942a6c843a591e0799369c453cc, user_id=80facc45bb4f4c6e842393a124c68b95, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:25.393818 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e066cd3-88c0-4d91-a8d4-b432831cb489 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:25.414085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1066/2109] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:35:25 2022] PUT /identity/v3/projects/eb0c8942a6c843a591e0799369c453cc/users/80facc45bb4f4c6e842393a124c68b95/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:25.417715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444eacb9-db69-456f-9072-f79431f71d51 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:25.430304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444eacb9-db69-456f-9072-f79431f71d51 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:25.504854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4834045-589b-416b-b763-587c25cc8fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:25.506766 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4834045-589b-416b-b763-587c25cc8fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:25.507394 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4834045-589b-416b-b763-587c25cc8fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:25.508081 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4834045-589b-416b-b763-587c25cc8fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:25.510221 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4834045-589b-416b-b763-587c25cc8fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:25.513004 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4834045-589b-416b-b763-587c25cc8fd0 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:25.539946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1044/2110] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:35:25.543883 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e066cd3-88c0-4d91-a8d4-b432831cb489 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:25.562675 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e066cd3-88c0-4d91-a8d4-b432831cb489 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:25.583348 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd051b85-053d-4c97-bd5e-9f25ffa71611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:25.584449 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd051b85-053d-4c97-bd5e-9f25ffa71611 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:25.584756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd051b85-053d-4c97-bd5e-9f25ffa71611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:25.585033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd051b85-053d-4c97-bd5e-9f25ffa71611 admin admin] PATH_INFO: `/v3/projects/eb0c8942a6c843a591e0799369c453cc/users/80facc45bb4f4c6e842393a124c68b95/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:25.592832 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd051b85-053d-4c97-bd5e-9f25ffa71611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb0c8942a6c843a591e0799369c453cc, user_id=80facc45bb4f4c6e842393a124c68b95, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:25.595706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd051b85-053d-4c97-bd5e-9f25ffa71611 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:25.629440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1067/2111] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:35:25 2022] PUT /identity/v3/projects/eb0c8942a6c843a591e0799369c453cc/users/80facc45bb4f4c6e842393a124c68b95/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:35:25.634974 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4125d7a-8aac-45ce-98b9-d510836bafe2 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:25.635421 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4125d7a-8aac-45ce-98b9-d510836bafe2 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:25.635826 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4125d7a-8aac-45ce-98b9-d510836bafe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:25.693248 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-e4125d7a-8aac-45ce-98b9-d510836bafe2 None None] MFA Rules not processed for user `80facc45bb4f4c6e842393a124c68b95`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:25.694365 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e4125d7a-8aac-45ce-98b9-d510836bafe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:25.825345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1045/2112] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:35:25.847215 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd051b85-053d-4c97-bd5e-9f25ffa71611 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:25.852605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-fd051b85-053d-4c97-bd5e-9f25ffa71611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:25.996508 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd051b85-053d-4c97-bd5e-9f25ffa71611 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:26.000901 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e045fda-0827-49bb-8472-54b1709dc947 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:26.001967 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045fda-0827-49bb-8472-54b1709dc947 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:26.002311 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045fda-0827-49bb-8472-54b1709dc947 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:26.002664 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045fda-0827-49bb-8472-54b1709dc947 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:26.014132 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e045fda-0827-49bb-8472-54b1709dc947 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:26.015730 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e045fda-0827-49bb-8472-54b1709dc947 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:26.028721 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1068/2113] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:35:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:35:26.257995 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4125d7a-8aac-45ce-98b9-d510836bafe2 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:26.270177 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d096d-2bc2-49d2-bbc1-223cb739ca30 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:26.270688 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d096d-2bc2-49d2-bbc1-223cb739ca30 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:26.270770 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d096d-2bc2-49d2-bbc1-223cb739ca30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:26.294737 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-186d096d-2bc2-49d2-bbc1-223cb739ca30 None None] MFA Rules not processed for user `d211582f9fc34b0e815e27db081c50c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:26.295964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-186d096d-2bc2-49d2-bbc1-223cb739ca30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:26.336119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4125d7a-8aac-45ce-98b9-d510836bafe2 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:26.340951 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5f68f-2053-456b-bec0-b19bcd379701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:26.341815 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5f68f-2053-456b-bec0-b19bcd379701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:26.342099 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5f68f-2053-456b-bec0-b19bcd379701 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:26.342566 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5f68f-2053-456b-bec0-b19bcd379701 admin admin] PATH_INFO: `/v3/users/a20a1f0c6fbb4378ae0dbb45b9406732` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:26.343783 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5f68f-2053-456b-bec0-b19bcd379701 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a20a1f0c6fbb4378ae0dbb45b9406732)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:26.345735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5f68f-2053-456b-bec0-b19bcd379701 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:26.371906 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1069/2114] 10.222.0.60 () {58 vars in 1009 bytes} [Fri May 6 23:35:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:35:26.399014 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-0ee5f68f-2053-456b-bec0-b19bcd379701 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a20a1f0c6fbb4378ae0dbb45b9406732'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:26.406759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-0ee5f68f-2053-456b-bec0-b19bcd379701 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a20a1f0c6fbb4378ae0dbb45b9406732'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:26.415038 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-0ee5f68f-2053-456b-bec0-b19bcd379701 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a20a1f0c6fbb4378ae0dbb45b9406732'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:26.415804 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-0ee5f68f-2053-456b-bec0-b19bcd379701 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a20a1f0c6fbb4378ae0dbb45b9406732'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:26.416419 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-0ee5f68f-2053-456b-bec0-b19bcd379701 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a20a1f0c6fbb4378ae0dbb45b9406732'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:26.435877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d096d-2bc2-49d2-bbc1-223cb739ca30 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:26.436806 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1046/2115] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:35:26 2022] DELETE /identity/v3/users/a20a1f0c6fbb4378ae0dbb45b9406732 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:26.440155 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-186d096d-2bc2-49d2-bbc1-223cb739ca30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:26.441957 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c3f9-d3ed-497f-b2a6-c245330ea5bd None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:26.442420 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c3f9-d3ed-497f-b2a6-c245330ea5bd None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:26.442825 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c3f9-d3ed-497f-b2a6-c245330ea5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:26.476104 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-fad9c3f9-d3ed-497f-b2a6-c245330ea5bd None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:26.477359 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-fad9c3f9-d3ed-497f-b2a6-c245330ea5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:26.511090 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d096d-2bc2-49d2-bbc1-223cb739ca30 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:26.535329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1047/2116] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:26.544212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9c3f9-d3ed-497f-b2a6-c245330ea5bd None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:26.545598 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-fad9c3f9-d3ed-497f-b2a6-c245330ea5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:26.574347 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fb01b-a5ab-4792-a5f0-674790022fec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b3ec57aee94b87889d578e114fa0db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:26.575237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fb01b-a5ab-4792-a5f0-674790022fec service swift] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:26.576078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fb01b-a5ab-4792-a5f0-674790022fec service swift] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:26.576512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fb01b-a5ab-4792-a5f0-674790022fec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:26.578904 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-e03fb01b-a5ab-4792-a5f0-674790022fec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:26.622684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9c3f9-d3ed-497f-b2a6-c245330ea5bd None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:26.626448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b368d8-568a-4da5-b2ff-73224a1f22fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:26.627097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b368d8-568a-4da5-b2ff-73224a1f22fa service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:26.627393 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b368d8-568a-4da5-b2ff-73224a1f22fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:26.627650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b368d8-568a-4da5-b2ff-73224a1f22fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:26.638971 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fb01b-a5ab-4792-a5f0-674790022fec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:26.640783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fb01b-a5ab-4792-a5f0-674790022fec service swift] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:26.642597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b368d8-568a-4da5-b2ff-73224a1f22fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:26.644134 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b368d8-568a-4da5-b2ff-73224a1f22fa service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:26.649834 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1070/2117] 10.222.0.60 () {60 vars in 1384 bytes} [Fri May 6 23:35:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 06 23:35:26.655509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1048/2118] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:35:27.112162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fb01b-a5ab-4792-a5f0-674790022fec service swift] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:27.114003 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-e03fb01b-a5ab-4792-a5f0-674790022fec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:27.129307 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fb01b-a5ab-4792-a5f0-674790022fec service swift] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:27.135641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e5adf-a094-4d78-9c13-5a4e2c2b4f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:27.136640 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e5adf-a094-4d78-9c13-5a4e2c2b4f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:27.136988 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e5adf-a094-4d78-9c13-5a4e2c2b4f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:27.137327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e5adf-a094-4d78-9c13-5a4e2c2b4f77 admin admin] PATH_INFO: `/v3/projects/4c44f37c5a27449db1c9a983cafbdce0` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:27.138657 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e5adf-a094-4d78-9c13-5a4e2c2b4f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c44f37c5a27449db1c9a983cafbdce0)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:27.141093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e5adf-a094-4d78-9c13-5a4e2c2b4f77 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:27.219298 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-1a5e5adf-a094-4d78-9c13-5a4e2c2b4f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c44f37c5a27449db1c9a983cafbdce0', 'request_id': 'req-1a5e5adf-a094-4d78-9c13-5a4e2c2b4f77'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:27.227085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-1a5e5adf-a094-4d78-9c13-5a4e2c2b4f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c44f37c5a27449db1c9a983cafbdce0', 'request_id': 'req-1a5e5adf-a094-4d78-9c13-5a4e2c2b4f77'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:27.233305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-1a5e5adf-a094-4d78-9c13-5a4e2c2b4f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c44f37c5a27449db1c9a983cafbdce0', 'request_id': 'req-1a5e5adf-a094-4d78-9c13-5a4e2c2b4f77'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:27.247923 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-1a5e5adf-a094-4d78-9c13-5a4e2c2b4f77 admin admin] The token cache is being invalidate because project 4c44f37c5a27449db1c9a983cafbdce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:35:27.248516 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-1a5e5adf-a094-4d78-9c13-5a4e2c2b4f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:27.249337 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-1a5e5adf-a094-4d78-9c13-5a4e2c2b4f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:27.251385 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1071/2119] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:35:27 2022] DELETE /identity/v3/projects/4c44f37c5a27449db1c9a983cafbdce0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:27.255323 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b368d8-568a-4da5-b2ff-73224a1f22fa service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:27.269174 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b368d8-568a-4da5-b2ff-73224a1f22fa service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:27.345332 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed314a-899f-4739-9e7e-8cfee0e4fe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:27.346551 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed314a-899f-4739-9e7e-8cfee0e4fe06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:27.347038 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed314a-899f-4739-9e7e-8cfee0e4fe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:27.347534 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed314a-899f-4739-9e7e-8cfee0e4fe06 admin admin] PATH_INFO: `/v3/users/80facc45bb4f4c6e842393a124c68b95` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:27.350961 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed314a-899f-4739-9e7e-8cfee0e4fe06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80facc45bb4f4c6e842393a124c68b95)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:27.354152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed314a-899f-4739-9e7e-8cfee0e4fe06 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:27.459071 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-18ed314a-899f-4739-9e7e-8cfee0e4fe06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80facc45bb4f4c6e842393a124c68b95'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:27.467423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-18ed314a-899f-4739-9e7e-8cfee0e4fe06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80facc45bb4f4c6e842393a124c68b95'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:27.478648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-18ed314a-899f-4739-9e7e-8cfee0e4fe06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80facc45bb4f4c6e842393a124c68b95'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:27.479426 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-18ed314a-899f-4739-9e7e-8cfee0e4fe06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80facc45bb4f4c6e842393a124c68b95'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:27.480235 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-18ed314a-899f-4739-9e7e-8cfee0e4fe06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80facc45bb4f4c6e842393a124c68b95'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:27.508090 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1049/2120] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:35:27 2022] DELETE /identity/v3/users/80facc45bb4f4c6e842393a124c68b95 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:27.907828 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e5adf-a094-4d78-9c13-5a4e2c2b4f77 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:27.909434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-1a5e5adf-a094-4d78-9c13-5a4e2c2b4f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:27.925013 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e5adf-a094-4d78-9c13-5a4e2c2b4f77 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:28.033750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718f47e-8a48-45bb-8f49-666409301ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:28.035469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718f47e-8a48-45bb-8f49-666409301ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:28.036136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718f47e-8a48-45bb-8f49-666409301ced admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:28.036684 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718f47e-8a48-45bb-8f49-666409301ced admin admin] PATH_INFO: `/v3/projects/eb0c8942a6c843a591e0799369c453cc` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:28.039356 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718f47e-8a48-45bb-8f49-666409301ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb0c8942a6c843a591e0799369c453cc)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:28.041989 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718f47e-8a48-45bb-8f49-666409301ced admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:28.142198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6718f47e-8a48-45bb-8f49-666409301ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb0c8942a6c843a591e0799369c453cc', 'request_id': 'req-6718f47e-8a48-45bb-8f49-666409301ced'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:28.149841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6718f47e-8a48-45bb-8f49-666409301ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb0c8942a6c843a591e0799369c453cc', 'request_id': 'req-6718f47e-8a48-45bb-8f49-666409301ced'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:28.156415 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6718f47e-8a48-45bb-8f49-666409301ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb0c8942a6c843a591e0799369c453cc', 'request_id': 'req-6718f47e-8a48-45bb-8f49-666409301ced'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:28.185017 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6718f47e-8a48-45bb-8f49-666409301ced admin admin] The token cache is being invalidate because project eb0c8942a6c843a591e0799369c453cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:35:28.186271 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6718f47e-8a48-45bb-8f49-666409301ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:28.186271 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6718f47e-8a48-45bb-8f49-666409301ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:28.190999 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1072/2121] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:35:27 2022] DELETE /identity/v3/projects/eb0c8942a6c843a591e0799369c453cc => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:35:28.192783 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f844b-d3e1-4be2-b880-2f2f10f8b426 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:28.193083 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f844b-d3e1-4be2-b880-2f2f10f8b426 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:28.193366 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f844b-d3e1-4be2-b880-2f2f10f8b426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:28.248697 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-3c9f844b-d3e1-4be2-b880-2f2f10f8b426 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:28.250266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-3c9f844b-d3e1-4be2-b880-2f2f10f8b426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:28.347809 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1050/2122] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:28.357134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e3823-fea9-4341-9c8e-fe5fc1e34c0f None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:28.357585 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e3823-fea9-4341-9c8e-fe5fc1e34c0f None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:28.358011 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e3823-fea9-4341-9c8e-fe5fc1e34c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:28.406612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-261e3823-fea9-4341-9c8e-fe5fc1e34c0f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:28.407893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-261e3823-fea9-4341-9c8e-fe5fc1e34c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:28.420593 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1073/2123] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:28.424694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f844b-d3e1-4be2-b880-2f2f10f8b426 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:28.436080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f844b-d3e1-4be2-b880-2f2f10f8b426 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:28.441263 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcaa301-472e-462c-bff2-25aa5fd43c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:28.442129 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcaa301-472e-462c-bff2-25aa5fd43c90 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:28.442551 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcaa301-472e-462c-bff2-25aa5fd43c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:28.442832 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcaa301-472e-462c-bff2-25aa5fd43c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:28.443582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcaa301-472e-462c-bff2-25aa5fd43c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:35:28.444428 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcaa301-472e-462c-bff2-25aa5fd43c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:28.446776 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcaa301-472e-462c-bff2-25aa5fd43c90 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:28.474316 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1051/2124] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:35:28.478720 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e3823-fea9-4341-9c8e-fe5fc1e34c0f None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:28.491572 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e3823-fea9-4341-9c8e-fe5fc1e34c0f None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:28.501203 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b9c38-09fa-4133-a548-b992e9bbfd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:28.502119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b9c38-09fa-4133-a548-b992e9bbfd0f admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:28.502555 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b9c38-09fa-4133-a548-b992e9bbfd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:28.502979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b9c38-09fa-4133-a548-b992e9bbfd0f admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:28.503956 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b9c38-09fa-4133-a548-b992e9bbfd0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:28.506190 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b9c38-09fa-4133-a548-b992e9bbfd0f admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:28.554044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1074/2125] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:35:28 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:35:28.559142 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcaa301-472e-462c-bff2-25aa5fd43c90 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:28.573381 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcaa301-472e-462c-bff2-25aa5fd43c90 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:28.664007 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f116c4-b352-4ce5-b579-3b1b74d02683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:28.664711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f116c4-b352-4ce5-b579-3b1b74d02683 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:28.664990 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f116c4-b352-4ce5-b579-3b1b74d02683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:28.665268 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f116c4-b352-4ce5-b579-3b1b74d02683 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:28.666181 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f116c4-b352-4ce5-b579-3b1b74d02683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:28.668586 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f116c4-b352-4ce5-b579-3b1b74d02683 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:28.701401 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1052/2126] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:35:28 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:35:28.705076 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b9c38-09fa-4133-a548-b992e9bbfd0f admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:28.743285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b9c38-09fa-4133-a548-b992e9bbfd0f admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:28.755271 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a632eef-0a1e-401d-98bb-e5c1ceca676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:28.756263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a632eef-0a1e-401d-98bb-e5c1ceca676d admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:28.756594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a632eef-0a1e-401d-98bb-e5c1ceca676d admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:28.758141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a632eef-0a1e-401d-98bb-e5c1ceca676d admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:28.760477 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a632eef-0a1e-401d-98bb-e5c1ceca676d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:28.763651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a632eef-0a1e-401d-98bb-e5c1ceca676d admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:28.791691 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1075/2127] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:35:28.793743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f116c4-b352-4ce5-b579-3b1b74d02683 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:28.808216 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f116c4-b352-4ce5-b579-3b1b74d02683 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:28.831972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d7978-8e82-41e9-a8d5-8e2a545bcf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:28.833080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d7978-8e82-41e9-a8d5-8e2a545bcf92 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:28.833527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d7978-8e82-41e9-a8d5-8e2a545bcf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:28.836196 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d7978-8e82-41e9-a8d5-8e2a545bcf92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:28.838020 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d7978-8e82-41e9-a8d5-8e2a545bcf92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:28.839845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d7978-8e82-41e9-a8d5-8e2a545bcf92 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:28.869242 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1053/2128] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:35:28.870435 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a632eef-0a1e-401d-98bb-e5c1ceca676d admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:28.888300 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a632eef-0a1e-401d-98bb-e5c1ceca676d admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:28.897967 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537ae96-b1cd-4d45-8506-f17c23574884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:28.899781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537ae96-b1cd-4d45-8506-f17c23574884 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:28.900249 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537ae96-b1cd-4d45-8506-f17c23574884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:28.900530 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537ae96-b1cd-4d45-8506-f17c23574884 admin admin] PATH_INFO: `/v3/projects/01c812120876441082e7799271cf436e/users/392613582d3041e98a53929afba04086/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:28.929449 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537ae96-b1cd-4d45-8506-f17c23574884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c812120876441082e7799271cf436e, user_id=392613582d3041e98a53929afba04086, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:28.932937 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537ae96-b1cd-4d45-8506-f17c23574884 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:28.961820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1076/2129] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:35:28 2022] PUT /identity/v3/projects/01c812120876441082e7799271cf436e/users/392613582d3041e98a53929afba04086/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:28.970049 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caede673-819f-43ed-bddf-327f2cde5ebf None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:28.970338 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caede673-819f-43ed-bddf-327f2cde5ebf None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:28.970609 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caede673-819f-43ed-bddf-327f2cde5ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:29.012390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-caede673-819f-43ed-bddf-327f2cde5ebf None None] MFA Rules not processed for user `392613582d3041e98a53929afba04086`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:29.014009 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-caede673-819f-43ed-bddf-327f2cde5ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:29.159168 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1054/2130] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:29.161853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537ae96-b1cd-4d45-8506-f17c23574884 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:29.292295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537ae96-b1cd-4d45-8506-f17c23574884 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:29.298120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03743e11-d0fa-4f77-8085-254519466229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:29.298800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03743e11-d0fa-4f77-8085-254519466229 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:29.299077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03743e11-d0fa-4f77-8085-254519466229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:29.299356 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03743e11-d0fa-4f77-8085-254519466229 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:29.302343 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03743e11-d0fa-4f77-8085-254519466229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:29.305200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03743e11-d0fa-4f77-8085-254519466229 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:29.347725 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1077/2131] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:35:29 2022] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:35:29.348997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caede673-819f-43ed-bddf-327f2cde5ebf None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:29.361126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caede673-819f-43ed-bddf-327f2cde5ebf None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:29.451983 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fd1dc-5715-486d-b36c-8aab49f6e485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:29.452701 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fd1dc-5715-486d-b36c-8aab49f6e485 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:29.452985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fd1dc-5715-486d-b36c-8aab49f6e485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:29.453265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fd1dc-5715-486d-b36c-8aab49f6e485 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:29.453960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fd1dc-5715-486d-b36c-8aab49f6e485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:29.461118 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fd1dc-5715-486d-b36c-8aab49f6e485 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:29.499098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1055/2132] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:35:29 2022] POST /identity/v3/users => generated 300 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:35:29.503183 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03743e11-d0fa-4f77-8085-254519466229 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:29.513532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03743e11-d0fa-4f77-8085-254519466229 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:29.518908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52d7ff-9898-4dc5-bbc8-b1555ea2adaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:29.519570 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52d7ff-9898-4dc5-bbc8-b1555ea2adaa admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:29.519848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52d7ff-9898-4dc5-bbc8-b1555ea2adaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:29.520124 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52d7ff-9898-4dc5-bbc8-b1555ea2adaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:29.520899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52d7ff-9898-4dc5-bbc8-b1555ea2adaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:29.522955 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52d7ff-9898-4dc5-bbc8-b1555ea2adaa admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:29.539772 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fd1dc-5715-486d-b36c-8aab49f6e485 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:29.540497 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1078/2133] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:35:29.550328 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fd1dc-5715-486d-b36c-8aab49f6e485 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:29.555846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d5b7d-8f5e-43f2-808e-119d7f20e56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:29.556954 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d5b7d-8f5e-43f2-808e-119d7f20e56b admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:29.557380 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d5b7d-8f5e-43f2-808e-119d7f20e56b admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:29.557814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d5b7d-8f5e-43f2-808e-119d7f20e56b admin admin] PATH_INFO: `/v3/projects/302edc1b23ce4932b29790ef79f174f1/users/062501ea12f3491fbbbbf303a8a7f410/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:29.574300 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d5b7d-8f5e-43f2-808e-119d7f20e56b admin admin] RBAC: Authorizing `identity:create_grant(project_id=302edc1b23ce4932b29790ef79f174f1, user_id=062501ea12f3491fbbbbf303a8a7f410, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:29.577376 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d5b7d-8f5e-43f2-808e-119d7f20e56b admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:29.601497 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52d7ff-9898-4dc5-bbc8-b1555ea2adaa admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:29.601967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1056/2134] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:35:29 2022] PUT /identity/v3/projects/302edc1b23ce4932b29790ef79f174f1/users/062501ea12f3491fbbbbf303a8a7f410/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:35:29.612188 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52d7ff-9898-4dc5-bbc8-b1555ea2adaa admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:29.696394 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51c83d-f0da-4ab3-b494-1fdf4515db22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:29.697095 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51c83d-f0da-4ab3-b494-1fdf4515db22 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:29.697457 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51c83d-f0da-4ab3-b494-1fdf4515db22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:29.697781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51c83d-f0da-4ab3-b494-1fdf4515db22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:29.698635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51c83d-f0da-4ab3-b494-1fdf4515db22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:29.701427 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51c83d-f0da-4ab3-b494-1fdf4515db22 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:29.722752 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1079/2135] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:35:29.724854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d5b7d-8f5e-43f2-808e-119d7f20e56b admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:29.737156 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d5b7d-8f5e-43f2-808e-119d7f20e56b admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:29.742996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d013889-6fad-4da7-b0d7-99aaf80463c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:29.745299 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d013889-6fad-4da7-b0d7-99aaf80463c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:29.745768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d013889-6fad-4da7-b0d7-99aaf80463c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:29.746284 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d013889-6fad-4da7-b0d7-99aaf80463c4 admin admin] PATH_INFO: `/v3/projects/302edc1b23ce4932b29790ef79f174f1/users/062501ea12f3491fbbbbf303a8a7f410/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:29.748648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d013889-6fad-4da7-b0d7-99aaf80463c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=302edc1b23ce4932b29790ef79f174f1, user_id=062501ea12f3491fbbbbf303a8a7f410, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:29.751950 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d013889-6fad-4da7-b0d7-99aaf80463c4 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:29.764990 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1057/2136] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:35:29 2022] PUT /identity/v3/projects/302edc1b23ce4932b29790ef79f174f1/users/062501ea12f3491fbbbbf303a8a7f410/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:29.782019 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348ec06-3504-4a49-8891-92a9fb93860e None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:29.782944 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348ec06-3504-4a49-8891-92a9fb93860e None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:29.783639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348ec06-3504-4a49-8891-92a9fb93860e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:29.835938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-9348ec06-3504-4a49-8891-92a9fb93860e None None] MFA Rules not processed for user `062501ea12f3491fbbbbf303a8a7f410`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:29.837650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-9348ec06-3504-4a49-8891-92a9fb93860e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:29.923940 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1080/2137] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:29.941132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d013889-6fad-4da7-b0d7-99aaf80463c4 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:29.944344 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9d013889-6fad-4da7-b0d7-99aaf80463c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:30.060368 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d013889-6fad-4da7-b0d7-99aaf80463c4 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:30.070802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede69ec-e16b-437c-9dee-e3846f39b903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:30.071476 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede69ec-e16b-437c-9dee-e3846f39b903 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:30.071776 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede69ec-e16b-437c-9dee-e3846f39b903 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:30.072033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede69ec-e16b-437c-9dee-e3846f39b903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:30.091798 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede69ec-e16b-437c-9dee-e3846f39b903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:30.095627 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede69ec-e16b-437c-9dee-e3846f39b903 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:30.111020 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1058/2138] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:35:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:35:31.277642 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348ec06-3504-4a49-8891-92a9fb93860e None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:31.455473 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348ec06-3504-4a49-8891-92a9fb93860e None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:31.461523 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc964fb-de11-43cd-9e2e-0ba688c7d460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:31.463398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc964fb-de11-43cd-9e2e-0ba688c7d460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:31.463708 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc964fb-de11-43cd-9e2e-0ba688c7d460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:31.463964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc964fb-de11-43cd-9e2e-0ba688c7d460 admin admin] PATH_INFO: `/v3/users/392613582d3041e98a53929afba04086` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:31.465994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc964fb-de11-43cd-9e2e-0ba688c7d460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=392613582d3041e98a53929afba04086)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:31.468431 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc964fb-de11-43cd-9e2e-0ba688c7d460 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:31.537751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-cdc964fb-de11-43cd-9e2e-0ba688c7d460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '392613582d3041e98a53929afba04086'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:31.545328 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-cdc964fb-de11-43cd-9e2e-0ba688c7d460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '392613582d3041e98a53929afba04086'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:31.546240 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-cdc964fb-de11-43cd-9e2e-0ba688c7d460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '392613582d3041e98a53929afba04086'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:31.571568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-cdc964fb-de11-43cd-9e2e-0ba688c7d460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '392613582d3041e98a53929afba04086'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:31.573666 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-cdc964fb-de11-43cd-9e2e-0ba688c7d460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '392613582d3041e98a53929afba04086'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:31.597393 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1081/2139] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:35:31 2022] DELETE /identity/v3/users/392613582d3041e98a53929afba04086 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:31.603157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6787a7-8c89-437a-8663-93437d1ed7ef None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:31.603676 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6787a7-8c89-437a-8663-93437d1ed7ef None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:31.604562 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6787a7-8c89-437a-8663-93437d1ed7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:31.639544 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-7b6787a7-8c89-437a-8663-93437d1ed7ef None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:31.642739 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-7b6787a7-8c89-437a-8663-93437d1ed7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:31.742568 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1059/2140] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:31.755346 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc964fb-de11-43cd-9e2e-0ba688c7d460 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:31.759532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-cdc964fb-de11-43cd-9e2e-0ba688c7d460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:31.826411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc964fb-de11-43cd-9e2e-0ba688c7d460 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:31.849187 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1966e05-f843-41cb-b381-946a51d56323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:31.850081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1966e05-f843-41cb-b381-946a51d56323 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:31.850565 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1966e05-f843-41cb-b381-946a51d56323 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:31.851087 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1966e05-f843-41cb-b381-946a51d56323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:31.862467 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1966e05-f843-41cb-b381-946a51d56323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:31.864234 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1966e05-f843-41cb-b381-946a51d56323 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:31.876107 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1082/2141] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:35:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:35:32.289264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6787a7-8c89-437a-8663-93437d1ed7ef None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:32.290800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-7b6787a7-8c89-437a-8663-93437d1ed7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:32.313058 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6787a7-8c89-437a-8663-93437d1ed7ef None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:32.328731 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce71cc-d139-4be5-be7b-b45e3a56cdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:32.329663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce71cc-d139-4be5-be7b-b45e3a56cdb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:32.329949 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce71cc-d139-4be5-be7b-b45e3a56cdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:32.330230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce71cc-d139-4be5-be7b-b45e3a56cdb4 admin admin] PATH_INFO: `/v3/projects/01c812120876441082e7799271cf436e` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:32.331544 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce71cc-d139-4be5-be7b-b45e3a56cdb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01c812120876441082e7799271cf436e)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:32.333565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce71cc-d139-4be5-be7b-b45e3a56cdb4 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:32.426636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c4ce71cc-d139-4be5-be7b-b45e3a56cdb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01c812120876441082e7799271cf436e', 'request_id': 'req-c4ce71cc-d139-4be5-be7b-b45e3a56cdb4'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:32.434441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c4ce71cc-d139-4be5-be7b-b45e3a56cdb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01c812120876441082e7799271cf436e', 'request_id': 'req-c4ce71cc-d139-4be5-be7b-b45e3a56cdb4'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:32.445030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c4ce71cc-d139-4be5-be7b-b45e3a56cdb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01c812120876441082e7799271cf436e', 'request_id': 'req-c4ce71cc-d139-4be5-be7b-b45e3a56cdb4'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:32.479828 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c4ce71cc-d139-4be5-be7b-b45e3a56cdb4 admin admin] The token cache is being invalidate because project 01c812120876441082e7799271cf436e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:35:32.480328 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c4ce71cc-d139-4be5-be7b-b45e3a56cdb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:32.481248 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c4ce71cc-d139-4be5-be7b-b45e3a56cdb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:32.484561 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1060/2142] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:35:32 2022] DELETE /identity/v3/projects/01c812120876441082e7799271cf436e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:32.488570 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1966e05-f843-41cb-b381-946a51d56323 service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:32.503204 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1966e05-f843-41cb-b381-946a51d56323 service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:32.572522 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4bab7-ebfb-4ba5-90f1-e50c66e399d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:32.573549 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4bab7-ebfb-4ba5-90f1-e50c66e399d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:32.573805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4bab7-ebfb-4ba5-90f1-e50c66e399d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:32.574079 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4bab7-ebfb-4ba5-90f1-e50c66e399d2 admin admin] PATH_INFO: `/v3/users/062501ea12f3491fbbbbf303a8a7f410` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:32.575419 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4bab7-ebfb-4ba5-90f1-e50c66e399d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=062501ea12f3491fbbbbf303a8a7f410)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:32.577483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4bab7-ebfb-4ba5-90f1-e50c66e399d2 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:32.637945 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-83b4bab7-ebfb-4ba5-90f1-e50c66e399d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062501ea12f3491fbbbbf303a8a7f410'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:32.645759 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-83b4bab7-ebfb-4ba5-90f1-e50c66e399d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062501ea12f3491fbbbbf303a8a7f410'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:32.646634 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-83b4bab7-ebfb-4ba5-90f1-e50c66e399d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062501ea12f3491fbbbbf303a8a7f410'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:32.655786 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-83b4bab7-ebfb-4ba5-90f1-e50c66e399d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062501ea12f3491fbbbbf303a8a7f410'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:32.656701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-83b4bab7-ebfb-4ba5-90f1-e50c66e399d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062501ea12f3491fbbbbf303a8a7f410'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:32.677054 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1083/2143] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:35:32 2022] DELETE /identity/v3/users/062501ea12f3491fbbbbf303a8a7f410 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:33.086269 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce71cc-d139-4be5-be7b-b45e3a56cdb4 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:33.088251 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c4ce71cc-d139-4be5-be7b-b45e3a56cdb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:33.123041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce71cc-d139-4be5-be7b-b45e3a56cdb4 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:33.242235 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7631e-5d80-45d5-895c-d87f595c2a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:33.243104 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7631e-5d80-45d5-895c-d87f595c2a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:33.243386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7631e-5d80-45d5-895c-d87f595c2a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:33.243831 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7631e-5d80-45d5-895c-d87f595c2a5f admin admin] PATH_INFO: `/v3/projects/302edc1b23ce4932b29790ef79f174f1` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:33.245275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7631e-5d80-45d5-895c-d87f595c2a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=302edc1b23ce4932b29790ef79f174f1)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:33.247202 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7631e-5d80-45d5-895c-d87f595c2a5f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:33.359925 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-40e7631e-5d80-45d5-895c-d87f595c2a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302edc1b23ce4932b29790ef79f174f1', 'request_id': 'req-40e7631e-5d80-45d5-895c-d87f595c2a5f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:33.375172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-40e7631e-5d80-45d5-895c-d87f595c2a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302edc1b23ce4932b29790ef79f174f1', 'request_id': 'req-40e7631e-5d80-45d5-895c-d87f595c2a5f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:33.383126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-40e7631e-5d80-45d5-895c-d87f595c2a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302edc1b23ce4932b29790ef79f174f1', 'request_id': 'req-40e7631e-5d80-45d5-895c-d87f595c2a5f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:33.403954 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-40e7631e-5d80-45d5-895c-d87f595c2a5f admin admin] The token cache is being invalidate because project 302edc1b23ce4932b29790ef79f174f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:35:33.407922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-40e7631e-5d80-45d5-895c-d87f595c2a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:33.408833 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-40e7631e-5d80-45d5-895c-d87f595c2a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:33.415220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1061/2144] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:35:33 2022] DELETE /identity/v3/projects/302edc1b23ce4932b29790ef79f174f1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:33.417058 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03cc61-76ca-49df-a3e5-10a318718cb3 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:33.417531 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03cc61-76ca-49df-a3e5-10a318718cb3 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:33.417817 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03cc61-76ca-49df-a3e5-10a318718cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:33.448930 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-7b03cc61-76ca-49df-a3e5-10a318718cb3 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:33.450561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-7b03cc61-76ca-49df-a3e5-10a318718cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:33.529264 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1084/2145] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:35:33.537921 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128d06b-df57-44ab-91d7-6977a85bf637 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:33.538399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128d06b-df57-44ab-91d7-6977a85bf637 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:33.538750 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128d06b-df57-44ab-91d7-6977a85bf637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:33.562664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-3128d06b-df57-44ab-91d7-6977a85bf637 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:33.564225 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-3128d06b-df57-44ab-91d7-6977a85bf637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:33.575508 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1062/2146] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:33.579351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03cc61-76ca-49df-a3e5-10a318718cb3 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:33.590548 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03cc61-76ca-49df-a3e5-10a318718cb3 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:33.596360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a74d1-8800-4065-b5d3-a9248c70a5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:33.597642 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a74d1-8800-4065-b5d3-a9248c70a5ad admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:33.598272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a74d1-8800-4065-b5d3-a9248c70a5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:33.598826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a74d1-8800-4065-b5d3-a9248c70a5ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:33.599706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a74d1-8800-4065-b5d3-a9248c70a5ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:35:33.600306 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a74d1-8800-4065-b5d3-a9248c70a5ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:33.602779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a74d1-8800-4065-b5d3-a9248c70a5ad admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:33.619664 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1085/2147] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:35:33.629465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128d06b-df57-44ab-91d7-6977a85bf637 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:33.641502 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128d06b-df57-44ab-91d7-6977a85bf637 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:33.646568 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ab2a2-fbfb-4451-beec-f2073df8aed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:33.647775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ab2a2-fbfb-4451-beec-f2073df8aed8 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:33.648053 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ab2a2-fbfb-4451-beec-f2073df8aed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:33.648324 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ab2a2-fbfb-4451-beec-f2073df8aed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:33.649195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ab2a2-fbfb-4451-beec-f2073df8aed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:33.651318 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ab2a2-fbfb-4451-beec-f2073df8aed8 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:33.691728 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1063/2148] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:35:33 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:35:33.693324 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a74d1-8800-4065-b5d3-a9248c70a5ad admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:33.716527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a74d1-8800-4065-b5d3-a9248c70a5ad admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:33.796615 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f05330-28d0-4f66-a1ed-33b3e121def3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:33.797602 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f05330-28d0-4f66-a1ed-33b3e121def3 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:33.797957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f05330-28d0-4f66-a1ed-33b3e121def3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:33.798505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f05330-28d0-4f66-a1ed-33b3e121def3 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:33.799283 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f05330-28d0-4f66-a1ed-33b3e121def3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:33.801277 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f05330-28d0-4f66-a1ed-33b3e121def3 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:33.832986 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1086/2149] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:35:33 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:35:33.835581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ab2a2-fbfb-4451-beec-f2073df8aed8 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:33.848829 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ab2a2-fbfb-4451-beec-f2073df8aed8 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:33.854877 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32807acd-209d-40df-be8e-74a28ba449b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:33.855552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32807acd-209d-40df-be8e-74a28ba449b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:33.855988 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32807acd-209d-40df-be8e-74a28ba449b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:33.856269 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32807acd-209d-40df-be8e-74a28ba449b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:33.857196 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32807acd-209d-40df-be8e-74a28ba449b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:33.858823 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32807acd-209d-40df-be8e-74a28ba449b0 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:33.874936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1064/2150] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:35:33.879536 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f05330-28d0-4f66-a1ed-33b3e121def3 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:33.896127 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f05330-28d0-4f66-a1ed-33b3e121def3 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:33.902552 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7795b-4ea1-4fcb-be21-49a20ba1d358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:33.904245 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7795b-4ea1-4fcb-be21-49a20ba1d358 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:33.907455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7795b-4ea1-4fcb-be21-49a20ba1d358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:33.907946 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7795b-4ea1-4fcb-be21-49a20ba1d358 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:33.909463 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7795b-4ea1-4fcb-be21-49a20ba1d358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:33.911573 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7795b-4ea1-4fcb-be21-49a20ba1d358 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:33.932464 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32807acd-209d-40df-be8e-74a28ba449b0 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:33.935074 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1087/2151] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:35:33.947614 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32807acd-209d-40df-be8e-74a28ba449b0 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:33.956599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d262c-63c2-4799-8353-6f0a2a2c3424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:33.958064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d262c-63c2-4799-8353-6f0a2a2c3424 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:33.958602 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d262c-63c2-4799-8353-6f0a2a2c3424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:33.959773 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d262c-63c2-4799-8353-6f0a2a2c3424 admin admin] PATH_INFO: `/v3/projects/a2b8395003a34a888906326119d9dfee/users/870f1ecdf29a40b1869663982e42a2e0/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:33.989645 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d262c-63c2-4799-8353-6f0a2a2c3424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b8395003a34a888906326119d9dfee, user_id=870f1ecdf29a40b1869663982e42a2e0, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:33.992587 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d262c-63c2-4799-8353-6f0a2a2c3424 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:34.016577 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1065/2152] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:35:33 2022] PUT /identity/v3/projects/a2b8395003a34a888906326119d9dfee/users/870f1ecdf29a40b1869663982e42a2e0/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:34.033518 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e48af-9cd8-4913-9fe8-e75a196605fa None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:34.033983 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e48af-9cd8-4913-9fe8-e75a196605fa None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:34.034379 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e48af-9cd8-4913-9fe8-e75a196605fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:34.069414 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-f64e48af-9cd8-4913-9fe8-e75a196605fa None None] MFA Rules not processed for user `870f1ecdf29a40b1869663982e42a2e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:34.070940 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-f64e48af-9cd8-4913-9fe8-e75a196605fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:34.159073 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1088/2153] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:34.171435 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d262c-63c2-4799-8353-6f0a2a2c3424 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:34.174626 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-a77d262c-63c2-4799-8353-6f0a2a2c3424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:34.264985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d262c-63c2-4799-8353-6f0a2a2c3424 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:34.270291 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b540f0-3c35-4bf9-afdc-7f9ec39fb34e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:34.271155 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b540f0-3c35-4bf9-afdc-7f9ec39fb34e service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:34.272139 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b540f0-3c35-4bf9-afdc-7f9ec39fb34e service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:34.272654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b540f0-3c35-4bf9-afdc-7f9ec39fb34e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:34.283418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b540f0-3c35-4bf9-afdc-7f9ec39fb34e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:34.285196 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b540f0-3c35-4bf9-afdc-7f9ec39fb34e service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:34.297003 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1066/2154] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:35:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:35:43.432572 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e48af-9cd8-4913-9fe8-e75a196605fa None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:43.531162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e48af-9cd8-4913-9fe8-e75a196605fa None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:43.538409 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934b086-8e08-4b20-bb83-36e7b4392bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:43.539806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934b086-8e08-4b20-bb83-36e7b4392bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:43.540411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934b086-8e08-4b20-bb83-36e7b4392bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:43.540969 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934b086-8e08-4b20-bb83-36e7b4392bd5 admin admin] PATH_INFO: `/v3/users/870f1ecdf29a40b1869663982e42a2e0` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:43.542649 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934b086-8e08-4b20-bb83-36e7b4392bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=870f1ecdf29a40b1869663982e42a2e0)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:43.545303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934b086-8e08-4b20-bb83-36e7b4392bd5 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:43.635172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-5934b086-8e08-4b20-bb83-36e7b4392bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870f1ecdf29a40b1869663982e42a2e0'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:43.645091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-5934b086-8e08-4b20-bb83-36e7b4392bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870f1ecdf29a40b1869663982e42a2e0'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:43.646152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-5934b086-8e08-4b20-bb83-36e7b4392bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870f1ecdf29a40b1869663982e42a2e0'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:43.657455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-5934b086-8e08-4b20-bb83-36e7b4392bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870f1ecdf29a40b1869663982e42a2e0'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:43.673662 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-5934b086-8e08-4b20-bb83-36e7b4392bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870f1ecdf29a40b1869663982e42a2e0'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:43.745375 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1089/2155] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:35:43 2022] DELETE /identity/v3/users/870f1ecdf29a40b1869663982e42a2e0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:43.746037 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9072b56-73c9-4215-a6fc-6cc1e6574028 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:43.746529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9072b56-73c9-4215-a6fc-6cc1e6574028 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:43.746605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9072b56-73c9-4215-a6fc-6cc1e6574028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:43.775730 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-f9072b56-73c9-4215-a6fc-6cc1e6574028 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:43.777220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f9072b56-73c9-4215-a6fc-6cc1e6574028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:43.898906 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1067/2156] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:43.910809 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934b086-8e08-4b20-bb83-36e7b4392bd5 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:43.912836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-5934b086-8e08-4b20-bb83-36e7b4392bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:43.995182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934b086-8e08-4b20-bb83-36e7b4392bd5 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:44.000563 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6650ba9-156c-4691-83d7-89efbd1f548a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:44.001249 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6650ba9-156c-4691-83d7-89efbd1f548a service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:44.001529 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6650ba9-156c-4691-83d7-89efbd1f548a service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:44.001803 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6650ba9-156c-4691-83d7-89efbd1f548a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:44.012684 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6650ba9-156c-4691-83d7-89efbd1f548a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:44.014160 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6650ba9-156c-4691-83d7-89efbd1f548a service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:44.034596 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1090/2157] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:35:44.540917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9072b56-73c9-4215-a6fc-6cc1e6574028 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:44.542346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f9072b56-73c9-4215-a6fc-6cc1e6574028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:44.563380 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9072b56-73c9-4215-a6fc-6cc1e6574028 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:44.575680 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354347e-b2fa-4549-83ba-c6ab9b0a9392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:44.576817 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354347e-b2fa-4549-83ba-c6ab9b0a9392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:44.577166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354347e-b2fa-4549-83ba-c6ab9b0a9392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:44.577544 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354347e-b2fa-4549-83ba-c6ab9b0a9392 admin admin] PATH_INFO: `/v3/projects/a2b8395003a34a888906326119d9dfee` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:44.579163 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354347e-b2fa-4549-83ba-c6ab9b0a9392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2b8395003a34a888906326119d9dfee)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:44.581539 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354347e-b2fa-4549-83ba-c6ab9b0a9392 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:44.660304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4354347e-b2fa-4549-83ba-c6ab9b0a9392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2b8395003a34a888906326119d9dfee', 'request_id': 'req-4354347e-b2fa-4549-83ba-c6ab9b0a9392'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:44.672727 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4354347e-b2fa-4549-83ba-c6ab9b0a9392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2b8395003a34a888906326119d9dfee', 'request_id': 'req-4354347e-b2fa-4549-83ba-c6ab9b0a9392'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:44.681155 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4354347e-b2fa-4549-83ba-c6ab9b0a9392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2b8395003a34a888906326119d9dfee', 'request_id': 'req-4354347e-b2fa-4549-83ba-c6ab9b0a9392'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:44.699449 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4354347e-b2fa-4549-83ba-c6ab9b0a9392 admin admin] The token cache is being invalidate because project a2b8395003a34a888906326119d9dfee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:35:44.699870 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4354347e-b2fa-4549-83ba-c6ab9b0a9392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:44.700798 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4354347e-b2fa-4549-83ba-c6ab9b0a9392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:44.702893 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1068/2158] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:35:44 2022] DELETE /identity/v3/projects/a2b8395003a34a888906326119d9dfee => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:44.707757 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf4e02-db90-4520-a6c5-0e0c369fdfb4 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:44.708421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf4e02-db90-4520-a6c5-0e0c369fdfb4 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:44.708421 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf4e02-db90-4520-a6c5-0e0c369fdfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:44.749052 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-68cf4e02-db90-4520-a6c5-0e0c369fdfb4 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:44.750272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-68cf4e02-db90-4520-a6c5-0e0c369fdfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:44.882221 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d7943-c916-49c5-aef3-7c114e1cda90 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:44.882805 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d7943-c916-49c5-aef3-7c114e1cda90 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:44.882805 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d7943-c916-49c5-aef3-7c114e1cda90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:44.887198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1091/2159] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:44.905476 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-267d7943-c916-49c5-aef3-7c114e1cda90 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:44.917690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-267d7943-c916-49c5-aef3-7c114e1cda90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:44.948898 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1069/2160] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:44.953248 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf4e02-db90-4520-a6c5-0e0c369fdfb4 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:44.967651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf4e02-db90-4520-a6c5-0e0c369fdfb4 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:44.977379 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd10cb2-a195-4cfb-a5dd-c7456de90565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:44.978077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd10cb2-a195-4cfb-a5dd-c7456de90565 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:44.978626 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd10cb2-a195-4cfb-a5dd-c7456de90565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:44.979131 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd10cb2-a195-4cfb-a5dd-c7456de90565 admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:44.980167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd10cb2-a195-4cfb-a5dd-c7456de90565 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:35:44.980574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd10cb2-a195-4cfb-a5dd-c7456de90565 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:44.983347 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd10cb2-a195-4cfb-a5dd-c7456de90565 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:45.015886 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1092/2161] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:35:45.019527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d7943-c916-49c5-aef3-7c114e1cda90 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:45.032739 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d7943-c916-49c5-aef3-7c114e1cda90 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:45.052040 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada32703-55eb-4185-8d5f-914ddabc1ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:45.053882 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada32703-55eb-4185-8d5f-914ddabc1ccf admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:45.054532 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada32703-55eb-4185-8d5f-914ddabc1ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:45.055004 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada32703-55eb-4185-8d5f-914ddabc1ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:45.056043 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada32703-55eb-4185-8d5f-914ddabc1ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:45.058516 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada32703-55eb-4185-8d5f-914ddabc1ccf admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:45.109756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1070/2162] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:35:45 2022] POST /identity/v3/projects => generated 359 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:35:45.114585 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd10cb2-a195-4cfb-a5dd-c7456de90565 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:45.142413 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd10cb2-a195-4cfb-a5dd-c7456de90565 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:45.279829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a383e81-ad5a-4d42-9fc8-f068b127d89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:45.280669 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a383e81-ad5a-4d42-9fc8-f068b127d89f admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:45.280957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a383e81-ad5a-4d42-9fc8-f068b127d89f admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:45.281227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a383e81-ad5a-4d42-9fc8-f068b127d89f admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:45.281932 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a383e81-ad5a-4d42-9fc8-f068b127d89f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:45.283858 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a383e81-ad5a-4d42-9fc8-f068b127d89f admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:45.316111 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1093/2163] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:35:45 2022] POST /identity/v3/users => generated 280 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:35:45.321931 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada32703-55eb-4185-8d5f-914ddabc1ccf admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:45.336268 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada32703-55eb-4185-8d5f-914ddabc1ccf admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:45.341390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64d1be-66d8-4441-beb7-94db0d8da35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:45.342302 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64d1be-66d8-4441-beb7-94db0d8da35d admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:45.342773 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64d1be-66d8-4441-beb7-94db0d8da35d admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:45.343260 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64d1be-66d8-4441-beb7-94db0d8da35d admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:45.344190 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64d1be-66d8-4441-beb7-94db0d8da35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:45.346341 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64d1be-66d8-4441-beb7-94db0d8da35d admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:45.363721 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1071/2164] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:35:45.369047 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a383e81-ad5a-4d42-9fc8-f068b127d89f admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:45.382663 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a383e81-ad5a-4d42-9fc8-f068b127d89f admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:45.393050 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b1b65-6ff4-4271-806f-894717adf016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:45.394147 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b1b65-6ff4-4271-806f-894717adf016 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:45.394496 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b1b65-6ff4-4271-806f-894717adf016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:45.394839 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b1b65-6ff4-4271-806f-894717adf016 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:45.395642 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b1b65-6ff4-4271-806f-894717adf016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:45.398312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b1b65-6ff4-4271-806f-894717adf016 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:45.428184 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1094/2165] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:35:45.430224 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64d1be-66d8-4441-beb7-94db0d8da35d admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:45.445914 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64d1be-66d8-4441-beb7-94db0d8da35d admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:45.451984 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12680c-82d2-4433-940f-a54bf9529886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:45.453005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12680c-82d2-4433-940f-a54bf9529886 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:45.453360 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12680c-82d2-4433-940f-a54bf9529886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:45.453704 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12680c-82d2-4433-940f-a54bf9529886 admin admin] PATH_INFO: `/v3/projects/84525c23abc8467597acf25bc71d2bf1/users/4959759f76b54d6c981b2bdf9028989a/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:45.473270 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12680c-82d2-4433-940f-a54bf9529886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84525c23abc8467597acf25bc71d2bf1, user_id=4959759f76b54d6c981b2bdf9028989a, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:45.477915 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12680c-82d2-4433-940f-a54bf9529886 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:45.504614 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1072/2166] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:35:45 2022] PUT /identity/v3/projects/84525c23abc8467597acf25bc71d2bf1/users/4959759f76b54d6c981b2bdf9028989a/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:45.508863 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7987a5-cbde-40a9-8438-f77a68717dfe None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:45.509528 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7987a5-cbde-40a9-8438-f77a68717dfe None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:45.511279 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7987a5-cbde-40a9-8438-f77a68717dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:45.550714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-6b7987a5-cbde-40a9-8438-f77a68717dfe None None] MFA Rules not processed for user `4959759f76b54d6c981b2bdf9028989a`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:45.552235 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-6b7987a5-cbde-40a9-8438-f77a68717dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:45.655910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1095/2167] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:45 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:45.705161 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12680c-82d2-4433-940f-a54bf9529886 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:45.707225 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9d12680c-82d2-4433-940f-a54bf9529886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:45.787272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12680c-82d2-4433-940f-a54bf9529886 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:45.791188 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0684b3-a8ff-412d-9e86-56d42ff03d11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:45.791917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0684b3-a8ff-412d-9e86-56d42ff03d11 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:45.792414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0684b3-a8ff-412d-9e86-56d42ff03d11 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:45.792813 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0684b3-a8ff-412d-9e86-56d42ff03d11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:45.803441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0684b3-a8ff-412d-9e86-56d42ff03d11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:45.805213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0684b3-a8ff-412d-9e86-56d42ff03d11 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:45.817495 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1073/2168] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:35:45 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:35:45.838570 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7987a5-cbde-40a9-8438-f77a68717dfe None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:45.998605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7987a5-cbde-40a9-8438-f77a68717dfe None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:46.009747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab7a84-77b9-421c-bfc6-27068b0377ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:46.010761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab7a84-77b9-421c-bfc6-27068b0377ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:46.011044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab7a84-77b9-421c-bfc6-27068b0377ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:46.011473 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab7a84-77b9-421c-bfc6-27068b0377ee admin admin] PATH_INFO: `/v3/users/4959759f76b54d6c981b2bdf9028989a` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:46.012939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab7a84-77b9-421c-bfc6-27068b0377ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=4959759f76b54d6c981b2bdf9028989a)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:46.015116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab7a84-77b9-421c-bfc6-27068b0377ee admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:46.137362 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-58ab7a84-77b9-421c-bfc6-27068b0377ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4959759f76b54d6c981b2bdf9028989a'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:46.150428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-58ab7a84-77b9-421c-bfc6-27068b0377ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4959759f76b54d6c981b2bdf9028989a'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:46.151311 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-58ab7a84-77b9-421c-bfc6-27068b0377ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4959759f76b54d6c981b2bdf9028989a'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:46.165619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-58ab7a84-77b9-421c-bfc6-27068b0377ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4959759f76b54d6c981b2bdf9028989a'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:46.166563 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-58ab7a84-77b9-421c-bfc6-27068b0377ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4959759f76b54d6c981b2bdf9028989a'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:46.201824 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1096/2169] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:35:45 2022] DELETE /identity/v3/users/4959759f76b54d6c981b2bdf9028989a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:46.205952 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dfe39-fe9e-4472-9c5a-974dd10bc68f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:46.206410 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dfe39-fe9e-4472-9c5a-974dd10bc68f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:46.206504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dfe39-fe9e-4472-9c5a-974dd10bc68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:46.212027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db129d71-df4b-4fcd-8262-e0082e13630a None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:46.212650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db129d71-df4b-4fcd-8262-e0082e13630a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:46.213112 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db129d71-df4b-4fcd-8262-e0082e13630a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:46.232733 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-c92dfe39-fe9e-4472-9c5a-974dd10bc68f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:46.234124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c92dfe39-fe9e-4472-9c5a-974dd10bc68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:46.261840 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-db129d71-df4b-4fcd-8262-e0082e13630a None None] MFA Rules not processed for user `d211582f9fc34b0e815e27db081c50c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:46.263085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-db129d71-df4b-4fcd-8262-e0082e13630a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:46.350490 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1097/2170] 10.222.0.60 () {58 vars in 1009 bytes} [Fri May 6 23:35:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:46.383580 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db129d71-df4b-4fcd-8262-e0082e13630a None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:46.385051 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-db129d71-df4b-4fcd-8262-e0082e13630a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:46.417608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1074/2171] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:46.446399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92dfe39-fe9e-4472-9c5a-974dd10bc68f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:46.448094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c92dfe39-fe9e-4472-9c5a-974dd10bc68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:46.555132 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db129d71-df4b-4fcd-8262-e0082e13630a None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:46.581837 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a58feb-9b3a-4c72-94df-2feaafa5d3ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b3ec57aee94b87889d578e114fa0db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:46.583005 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a58feb-9b3a-4c72-94df-2feaafa5d3ac service swift] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:46.583300 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a58feb-9b3a-4c72-94df-2feaafa5d3ac service swift] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:46.583574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a58feb-9b3a-4c72-94df-2feaafa5d3ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:46.601356 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a58feb-9b3a-4c72-94df-2feaafa5d3ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:46.603154 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92dfe39-fe9e-4472-9c5a-974dd10bc68f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:46.603346 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a58feb-9b3a-4c72-94df-2feaafa5d3ac service swift] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:46.617649 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1098/2172] 10.222.0.60 () {60 vars in 1384 bytes} [Fri May 6 23:35:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 06 23:35:46.619256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d020c-629d-40b2-9e06-630f9d566d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:46.619845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d020c-629d-40b2-9e06-630f9d566d29 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:46.620140 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d020c-629d-40b2-9e06-630f9d566d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:46.620423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d020c-629d-40b2-9e06-630f9d566d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:46.634914 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d020c-629d-40b2-9e06-630f9d566d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:46.636785 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d020c-629d-40b2-9e06-630f9d566d29 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:46.667574 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1075/2173] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:35:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:35:47.321724 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a58feb-9b3a-4c72-94df-2feaafa5d3ac service swift] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:47.325764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-30a58feb-9b3a-4c72-94df-2feaafa5d3ac service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:47.366460 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a58feb-9b3a-4c72-94df-2feaafa5d3ac service swift] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:47.390326 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4eefa0-bde7-40b0-b791-b21181bf5df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:47.391329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4eefa0-bde7-40b0-b791-b21181bf5df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:47.391666 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4eefa0-bde7-40b0-b791-b21181bf5df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:47.391956 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4eefa0-bde7-40b0-b791-b21181bf5df7 admin admin] PATH_INFO: `/v3/projects/84525c23abc8467597acf25bc71d2bf1` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:47.397057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4eefa0-bde7-40b0-b791-b21181bf5df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84525c23abc8467597acf25bc71d2bf1)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:47.401180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4eefa0-bde7-40b0-b791-b21181bf5df7 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:47.504366 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dc4eefa0-bde7-40b0-b791-b21181bf5df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84525c23abc8467597acf25bc71d2bf1', 'request_id': 'req-dc4eefa0-bde7-40b0-b791-b21181bf5df7'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:47.517466 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dc4eefa0-bde7-40b0-b791-b21181bf5df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84525c23abc8467597acf25bc71d2bf1', 'request_id': 'req-dc4eefa0-bde7-40b0-b791-b21181bf5df7'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:47.540097 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dc4eefa0-bde7-40b0-b791-b21181bf5df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84525c23abc8467597acf25bc71d2bf1', 'request_id': 'req-dc4eefa0-bde7-40b0-b791-b21181bf5df7'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:47.576355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dc4eefa0-bde7-40b0-b791-b21181bf5df7 admin admin] The token cache is being invalidate because project 84525c23abc8467597acf25bc71d2bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:35:47.576944 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dc4eefa0-bde7-40b0-b791-b21181bf5df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:47.578491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dc4eefa0-bde7-40b0-b791-b21181bf5df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:47.586670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1099/2174] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:35:47 2022] DELETE /identity/v3/projects/84525c23abc8467597acf25bc71d2bf1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:47.595208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398515e-e24b-421f-9f2e-418425e7042b None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:47.595658 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398515e-e24b-421f-9f2e-418425e7042b None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:47.595735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398515e-e24b-421f-9f2e-418425e7042b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:47.641190 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-e398515e-e24b-421f-9f2e-418425e7042b None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:47.650113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e398515e-e24b-421f-9f2e-418425e7042b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:47.756418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1076/2175] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:47.763999 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9815c-830d-4c16-b1b4-2bec066858aa None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:47.764359 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9815c-830d-4c16-b1b4-2bec066858aa None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:47.764738 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9815c-830d-4c16-b1b4-2bec066858aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:47.812673 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-82d9815c-830d-4c16-b1b4-2bec066858aa None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:47.814110 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-82d9815c-830d-4c16-b1b4-2bec066858aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:47.843019 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398515e-e24b-421f-9f2e-418425e7042b None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:47.853583 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1100/2176] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:47.855555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398515e-e24b-421f-9f2e-418425e7042b None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:47.866178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366b143-0077-4f2f-83a7-9627d2281afd None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:47.866538 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366b143-0077-4f2f-83a7-9627d2281afd None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:47.866889 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366b143-0077-4f2f-83a7-9627d2281afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:47.870771 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4bd0f-edd6-4f00-b25a-579e84c2c2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:47.871442 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4bd0f-edd6-4f00-b25a-579e84c2c2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:47.872817 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4bd0f-edd6-4f00-b25a-579e84c2c2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:47.873103 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4bd0f-edd6-4f00-b25a-579e84c2c2e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:47.873929 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4bd0f-edd6-4f00-b25a-579e84c2c2e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:35:47.874156 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4bd0f-edd6-4f00-b25a-579e84c2c2e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:47.880492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4bd0f-edd6-4f00-b25a-579e84c2c2e2 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:47.900593 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1077/2177] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:35:47.903664 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-1366b143-0077-4f2f-83a7-9627d2281afd None None] MFA Rules not processed for user `d211582f9fc34b0e815e27db081c50c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:47.904672 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4bd0f-edd6-4f00-b25a-579e84c2c2e2 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:47.905615 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-1366b143-0077-4f2f-83a7-9627d2281afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:47.921824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4bd0f-edd6-4f00-b25a-579e84c2c2e2 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:47.930420 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f935fe-9a33-4916-8a05-73c87989d9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:47.931516 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f935fe-9a33-4916-8a05-73c87989d9ed admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:47.932058 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f935fe-9a33-4916-8a05-73c87989d9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:47.933012 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f935fe-9a33-4916-8a05-73c87989d9ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:47.934556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f935fe-9a33-4916-8a05-73c87989d9ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:47.936566 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f935fe-9a33-4916-8a05-73c87989d9ed admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:47.980030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1078/2178] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:35:47 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:35:47.985046 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f935fe-9a33-4916-8a05-73c87989d9ed admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:48.019708 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1101/2179] 10.222.0.60 () {58 vars in 967 bytes} [Fri May 6 23:35:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:35:48.059501 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366b143-0077-4f2f-83a7-9627d2281afd None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:48.061114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-1366b143-0077-4f2f-83a7-9627d2281afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:48.129926 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f935fe-9a33-4916-8a05-73c87989d9ed admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:48.140305 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f34ba-d763-4b64-9b80-88f0fdc6ad34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:48.141111 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f34ba-d763-4b64-9b80-88f0fdc6ad34 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:48.141492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f34ba-d763-4b64-9b80-88f0fdc6ad34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:48.141863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f34ba-d763-4b64-9b80-88f0fdc6ad34 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:48.142658 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f34ba-d763-4b64-9b80-88f0fdc6ad34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:48.144718 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f34ba-d763-4b64-9b80-88f0fdc6ad34 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:48.178489 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1079/2180] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:35:47 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:35:48.180232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f34ba-d763-4b64-9b80-88f0fdc6ad34 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:48.206498 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366b143-0077-4f2f-83a7-9627d2281afd None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:48.210263 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f34ba-d763-4b64-9b80-88f0fdc6ad34 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:48.221430 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c76c3-b774-4700-9873-aa80109cb6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:48.222109 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c76c3-b774-4700-9873-aa80109cb6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:48.222400 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c76c3-b774-4700-9873-aa80109cb6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:48.222808 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c76c3-b774-4700-9873-aa80109cb6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:48.228688 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c76c3-b774-4700-9873-aa80109cb6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:48.230529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c76c3-b774-4700-9873-aa80109cb6d1 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:48.249859 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1080/2181] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:35:48.256147 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c76c3-b774-4700-9873-aa80109cb6d1 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:48.280100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c76c3-b774-4700-9873-aa80109cb6d1 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:48.290172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6ca5c-5bfb-46e7-97ae-ee07818c1858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:48.290854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6ca5c-5bfb-46e7-97ae-ee07818c1858 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:48.291227 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6ca5c-5bfb-46e7-97ae-ee07818c1858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:48.291821 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6ca5c-5bfb-46e7-97ae-ee07818c1858 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:48.292243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6ca5c-5bfb-46e7-97ae-ee07818c1858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:48.293913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6ca5c-5bfb-46e7-97ae-ee07818c1858 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:48.317183 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1081/2182] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:35:48.323236 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6ca5c-5bfb-46e7-97ae-ee07818c1858 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:48.344145 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6ca5c-5bfb-46e7-97ae-ee07818c1858 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:48.357950 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef1d3c-8553-4890-844b-7bb02eacf515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:48.359135 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef1d3c-8553-4890-844b-7bb02eacf515 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:48.359372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef1d3c-8553-4890-844b-7bb02eacf515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:48.359651 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef1d3c-8553-4890-844b-7bb02eacf515 admin admin] PATH_INFO: `/v3/projects/b207eee88918499bb1beca1aa822fb17/users/69bfa26e7370404589cec304b8ac51a7/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:48.390540 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef1d3c-8553-4890-844b-7bb02eacf515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b207eee88918499bb1beca1aa822fb17, user_id=69bfa26e7370404589cec304b8ac51a7, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:48.400341 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef1d3c-8553-4890-844b-7bb02eacf515 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:48.404443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ac69d-5d68-4416-bd14-3a1e65782b67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b3ec57aee94b87889d578e114fa0db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:48.405490 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ac69d-5d68-4416-bd14-3a1e65782b67 service swift] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:48.405819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ac69d-5d68-4416-bd14-3a1e65782b67 service swift] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:48.406103 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ac69d-5d68-4416-bd14-3a1e65782b67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:48.440496 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1082/2183] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:35:48 2022] PUT /identity/v3/projects/b207eee88918499bb1beca1aa822fb17/users/69bfa26e7370404589cec304b8ac51a7/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:48.442016 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3c7d4-a1da-4761-b68c-82c927100aff None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:48.442310 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3c7d4-a1da-4761-b68c-82c927100aff None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:48.442589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3c7d4-a1da-4761-b68c-82c927100aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:48.520951 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ac69d-5d68-4416-bd14-3a1e65782b67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:48.523621 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ac69d-5d68-4416-bd14-3a1e65782b67 service swift] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:48.532894 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-b9a3c7d4-a1da-4761-b68c-82c927100aff None None] MFA Rules not processed for user `69bfa26e7370404589cec304b8ac51a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:48.533956 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1102/2184] 10.222.0.60 () {60 vars in 1384 bytes} [Fri May 6 23:35:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 06 23:35:48.534140 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-b9a3c7d4-a1da-4761-b68c-82c927100aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:48.660173 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1083/2185] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:48.665133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ac69d-5d68-4416-bd14-3a1e65782b67 service swift] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:48.682214 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ac69d-5d68-4416-bd14-3a1e65782b67 service swift] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:48.916971 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722da02-661c-4adb-91d8-2f1301c3dae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:48.917859 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722da02-661c-4adb-91d8-2f1301c3dae3 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:48.918212 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722da02-661c-4adb-91d8-2f1301c3dae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:48.918563 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722da02-661c-4adb-91d8-2f1301c3dae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:48.922179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722da02-661c-4adb-91d8-2f1301c3dae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:48.924567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722da02-661c-4adb-91d8-2f1301c3dae3 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:48.959332 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1103/2186] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:35:48 2022] POST /identity/v3/projects => generated 373 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:35:48.963164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3c7d4-a1da-4761-b68c-82c927100aff None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:48.975345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3c7d4-a1da-4761-b68c-82c927100aff None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:49.051701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193132f5-9374-4b3f-8140-f1509d72c791 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:49.052643 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193132f5-9374-4b3f-8140-f1509d72c791 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:49.053141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193132f5-9374-4b3f-8140-f1509d72c791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:49.064528 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1e0e6-21fe-444b-8a03-c976dca0e83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:49.065273 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1e0e6-21fe-444b-8a03-c976dca0e83e admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:49.065552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1e0e6-21fe-444b-8a03-c976dca0e83e admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:49.065822 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1e0e6-21fe-444b-8a03-c976dca0e83e admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:49.066516 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1e0e6-21fe-444b-8a03-c976dca0e83e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:49.069207 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1e0e6-21fe-444b-8a03-c976dca0e83e admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:49.080177 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-193132f5-9374-4b3f-8140-f1509d72c791 None None] MFA Rules not processed for user `d211582f9fc34b0e815e27db081c50c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:49.081948 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-193132f5-9374-4b3f-8140-f1509d72c791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:49.104804 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1084/2187] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:35:48 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:35:49.106037 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1e0e6-21fe-444b-8a03-c976dca0e83e admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:49.118579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1e0e6-21fe-444b-8a03-c976dca0e83e admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:49.123476 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e10d4-a863-42df-b97d-821d9e734b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:49.124902 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e10d4-a863-42df-b97d-821d9e734b19 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:49.125278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e10d4-a863-42df-b97d-821d9e734b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:49.125630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e10d4-a863-42df-b97d-821d9e734b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:49.126435 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e10d4-a863-42df-b97d-821d9e734b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:49.128244 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e10d4-a863-42df-b97d-821d9e734b19 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:49.145369 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1085/2188] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:35:49.146834 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e10d4-a863-42df-b97d-821d9e734b19 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:49.157698 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e10d4-a863-42df-b97d-821d9e734b19 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:49.165391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1104/2189] 10.222.0.60 () {58 vars in 1009 bytes} [Fri May 6 23:35:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:35:49.169692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a22aa-7faa-47c2-be4c-93aabb5c06b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:49.170577 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a22aa-7faa-47c2-be4c-93aabb5c06b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:49.170856 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a22aa-7faa-47c2-be4c-93aabb5c06b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:49.171145 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a22aa-7faa-47c2-be4c-93aabb5c06b7 admin admin] PATH_INFO: `/v3/projects/d7e1cde935a54316a24a99a21a64a926/users/36e9f73bfca54f09923822813ba7434c/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:49.180519 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193132f5-9374-4b3f-8140-f1509d72c791 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:49.188518 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a22aa-7faa-47c2-be4c-93aabb5c06b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e1cde935a54316a24a99a21a64a926, user_id=36e9f73bfca54f09923822813ba7434c, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:49.191289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a22aa-7faa-47c2-be4c-93aabb5c06b7 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:49.209235 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1086/2190] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:35:49 2022] PUT /identity/v3/projects/d7e1cde935a54316a24a99a21a64a926/users/36e9f73bfca54f09923822813ba7434c/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:49.213173 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a22aa-7faa-47c2-be4c-93aabb5c06b7 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:49.262436 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193132f5-9374-4b3f-8140-f1509d72c791 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:49.281812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a22aa-7faa-47c2-be4c-93aabb5c06b7 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:49.287598 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b3ad4-905b-4f4b-8c90-f9e765acefe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:49.288266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b3ad4-905b-4f4b-8c90-f9e765acefe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:49.288555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b3ad4-905b-4f4b-8c90-f9e765acefe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:49.288854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b3ad4-905b-4f4b-8c90-f9e765acefe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:49.289600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b3ad4-905b-4f4b-8c90-f9e765acefe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:49.291692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b3ad4-905b-4f4b-8c90-f9e765acefe5 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:49.302534 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1087/2191] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:35:49.306520 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b3ad4-905b-4f4b-8c90-f9e765acefe5 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:49.316026 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b3ad4-905b-4f4b-8c90-f9e765acefe5 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:49.320525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f450d5-aad3-4824-8b4a-42b9484b4876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:49.321405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f450d5-aad3-4824-8b4a-42b9484b4876 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:49.321685 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f450d5-aad3-4824-8b4a-42b9484b4876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:49.321954 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f450d5-aad3-4824-8b4a-42b9484b4876 admin admin] PATH_INFO: `/v3/projects/d7e1cde935a54316a24a99a21a64a926/users/36e9f73bfca54f09923822813ba7434c/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:49.323107 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5bde3-c1a9-4784-8434-6009963d5267 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b3ec57aee94b87889d578e114fa0db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:49.323746 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5bde3-c1a9-4784-8434-6009963d5267 service swift] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:49.323848 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f450d5-aad3-4824-8b4a-42b9484b4876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e1cde935a54316a24a99a21a64a926, user_id=36e9f73bfca54f09923822813ba7434c, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:49.324021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5bde3-c1a9-4784-8434-6009963d5267 service swift] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:49.324295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5bde3-c1a9-4784-8434-6009963d5267 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:49.326509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f450d5-aad3-4824-8b4a-42b9484b4876 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:49.337167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1088/2192] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:35:49 2022] PUT /identity/v3/projects/d7e1cde935a54316a24a99a21a64a926/users/36e9f73bfca54f09923822813ba7434c/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:35:49.347276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c826f66-38f1-4f2e-97e3-436fbe6f6844 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:49.347561 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c826f66-38f1-4f2e-97e3-436fbe6f6844 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:49.347837 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c826f66-38f1-4f2e-97e3-436fbe6f6844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:49.374913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-7c826f66-38f1-4f2e-97e3-436fbe6f6844 None None] MFA Rules not processed for user `36e9f73bfca54f09923822813ba7434c`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:49.376109 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-7c826f66-38f1-4f2e-97e3-436fbe6f6844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:49.381787 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5bde3-c1a9-4784-8434-6009963d5267 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:49.383394 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5bde3-c1a9-4784-8434-6009963d5267 service swift] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:49.391525 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1105/2193] 10.222.0.60 () {60 vars in 1384 bytes} [Fri May 6 23:35:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 06 23:35:49.448273 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1089/2194] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:49.458186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5bde3-c1a9-4784-8434-6009963d5267 service swift] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:49.460292 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-9ef5bde3-c1a9-4784-8434-6009963d5267 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:49.515961 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5bde3-c1a9-4784-8434-6009963d5267 service swift] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:49.575854 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f02a8-db29-4e3e-ae30-29b5344b956c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:49.576509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f02a8-db29-4e3e-ae30-29b5344b956c service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:49.576822 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f02a8-db29-4e3e-ae30-29b5344b956c service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:49.577097 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f02a8-db29-4e3e-ae30-29b5344b956c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:49.640387 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f02a8-db29-4e3e-ae30-29b5344b956c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:49.641874 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f02a8-db29-4e3e-ae30-29b5344b956c service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:49.651273 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1106/2195] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:35:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:35:49.724974 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0595d0-647e-4d57-af16-f2b9642254d1 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:49.725448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0595d0-647e-4d57-af16-f2b9642254d1 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:49.725540 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0595d0-647e-4d57-af16-f2b9642254d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:49.743849 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-2b0595d0-647e-4d57-af16-f2b9642254d1 None None] MFA Rules not processed for user `d211582f9fc34b0e815e27db081c50c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:49.744993 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-2b0595d0-647e-4d57-af16-f2b9642254d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:49.798819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1090/2196] 10.222.0.60 () {58 vars in 967 bytes} [Fri May 6 23:35:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:49.811342 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f02a8-db29-4e3e-ae30-29b5344b956c service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:49.905650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f02a8-db29-4e3e-ae30-29b5344b956c service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:49.912741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a25aa-b9fb-4cbd-978d-1b186df2c7e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b3ec57aee94b87889d578e114fa0db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:49.913729 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a25aa-b9fb-4cbd-978d-1b186df2c7e6 service swift] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:49.914154 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a25aa-b9fb-4cbd-978d-1b186df2c7e6 service swift] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:49.914586 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a25aa-b9fb-4cbd-978d-1b186df2c7e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:49.924239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a25aa-b9fb-4cbd-978d-1b186df2c7e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:49.938068 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a25aa-b9fb-4cbd-978d-1b186df2c7e6 service swift] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:49.960457 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1107/2197] 10.222.0.60 () {60 vars in 1384 bytes} [Fri May 6 23:35:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 06 23:35:50.084701 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e4d77-90dd-4d15-98d2-ee32fdf32a7d None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:50.084701 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e4d77-90dd-4d15-98d2-ee32fdf32a7d None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:50.084967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e4d77-90dd-4d15-98d2-ee32fdf32a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:50.109813 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-8c9e4d77-90dd-4d15-98d2-ee32fdf32a7d None None] MFA Rules not processed for user `d211582f9fc34b0e815e27db081c50c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:50.110096 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-8c9e4d77-90dd-4d15-98d2-ee32fdf32a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:50.118535 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1091/2198] 10.222.0.60 () {58 vars in 967 bytes} [Fri May 6 23:35:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:50.135892 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a25aa-b9fb-4cbd-978d-1b186df2c7e6 service swift] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:50.148109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a25aa-b9fb-4cbd-978d-1b186df2c7e6 service swift] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:50.153991 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460e326-fb8e-486d-8c53-673a68b71cad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b3ec57aee94b87889d578e114fa0db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:50.154627 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460e326-fb8e-486d-8c53-673a68b71cad service swift] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:50.154904 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460e326-fb8e-486d-8c53-673a68b71cad service swift] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:50.155173 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460e326-fb8e-486d-8c53-673a68b71cad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:50.168563 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460e326-fb8e-486d-8c53-673a68b71cad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:50.170625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460e326-fb8e-486d-8c53-673a68b71cad service swift] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:50.184034 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1108/2199] 10.222.0.60 () {60 vars in 1384 bytes} [Fri May 6 23:35:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 06 23:35:50.592099 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24e88c-0eb9-4d88-ad22-60a221fa158d None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:50.592701 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24e88c-0eb9-4d88-ad22-60a221fa158d None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:50.593198 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24e88c-0eb9-4d88-ad22-60a221fa158d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:50.613860 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-bd24e88c-0eb9-4d88-ad22-60a221fa158d None None] MFA Rules not processed for user `d211582f9fc34b0e815e27db081c50c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:50.615356 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-bd24e88c-0eb9-4d88-ad22-60a221fa158d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:50.623865 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1092/2200] 10.222.0.60 () {58 vars in 1009 bytes} [Fri May 6 23:35:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:50.639500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460e326-fb8e-486d-8c53-673a68b71cad service swift] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:50.653572 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460e326-fb8e-486d-8c53-673a68b71cad service swift] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:50.659320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581409b-229a-4894-8682-fc9ba323b5b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b3ec57aee94b87889d578e114fa0db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:50.660283 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581409b-229a-4894-8682-fc9ba323b5b9 service swift] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:50.660701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581409b-229a-4894-8682-fc9ba323b5b9 service swift] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:50.661079 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581409b-229a-4894-8682-fc9ba323b5b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:50.670895 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581409b-229a-4894-8682-fc9ba323b5b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:50.673112 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581409b-229a-4894-8682-fc9ba323b5b9 service swift] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:50.682925 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1109/2201] 10.222.0.60 () {60 vars in 1384 bytes} [Fri May 6 23:35:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 06 23:35:52.466383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24e88c-0eb9-4d88-ad22-60a221fa158d None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:52.537541 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581409b-229a-4894-8682-fc9ba323b5b9 service swift] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:52.539206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-e581409b-229a-4894-8682-fc9ba323b5b9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:52.614526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24e88c-0eb9-4d88-ad22-60a221fa158d None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:52.624356 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fcdd0-5f14-433c-a905-087f2bdb5df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:52.626601 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fcdd0-5f14-433c-a905-087f2bdb5df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:52.627039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fcdd0-5f14-433c-a905-087f2bdb5df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:52.627463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fcdd0-5f14-433c-a905-087f2bdb5df1 admin admin] PATH_INFO: `/v3/users/69bfa26e7370404589cec304b8ac51a7` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:52.629363 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4fcdd0-5f14-433c-a905-087f2bdb5df1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69bfa26e7370404589cec304b8ac51a7)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:52.632697 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4fcdd0-5f14-433c-a905-087f2bdb5df1 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:52.681566 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581409b-229a-4894-8682-fc9ba323b5b9 service swift] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:52.687507 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4412e5e-6554-416d-af85-122738381c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:52.689110 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4412e5e-6554-416d-af85-122738381c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:52.689733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4412e5e-6554-416d-af85-122738381c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:52.690219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4412e5e-6554-416d-af85-122738381c86 admin admin] PATH_INFO: `/v3/users/ae0b2bc8ab624995a0da0e93c5c34de7` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:52.691851 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4412e5e-6554-416d-af85-122738381c86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae0b2bc8ab624995a0da0e93c5c34de7)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:52.696283 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4412e5e-6554-416d-af85-122738381c86 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:52.737590 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8e4fcdd0-5f14-433c-a905-087f2bdb5df1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69bfa26e7370404589cec304b8ac51a7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:52.747265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8e4fcdd0-5f14-433c-a905-087f2bdb5df1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69bfa26e7370404589cec304b8ac51a7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:52.758587 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8e4fcdd0-5f14-433c-a905-087f2bdb5df1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69bfa26e7370404589cec304b8ac51a7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:52.759947 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8e4fcdd0-5f14-433c-a905-087f2bdb5df1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69bfa26e7370404589cec304b8ac51a7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:52.761274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8e4fcdd0-5f14-433c-a905-087f2bdb5df1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69bfa26e7370404589cec304b8ac51a7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:52.787647 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1093/2202] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:35:52 2022] DELETE /identity/v3/users/69bfa26e7370404589cec304b8ac51a7 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:52.791367 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fcdd0-5f14-433c-a905-087f2bdb5df1 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:52.793637 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-8e4fcdd0-5f14-433c-a905-087f2bdb5df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:52.804725 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-d4412e5e-6554-416d-af85-122738381c86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae0b2bc8ab624995a0da0e93c5c34de7'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:52.820109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-d4412e5e-6554-416d-af85-122738381c86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae0b2bc8ab624995a0da0e93c5c34de7'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:52.822291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-d4412e5e-6554-416d-af85-122738381c86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae0b2bc8ab624995a0da0e93c5c34de7'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:52.849788 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-d4412e5e-6554-416d-af85-122738381c86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae0b2bc8ab624995a0da0e93c5c34de7'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:52.850666 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-d4412e5e-6554-416d-af85-122738381c86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae0b2bc8ab624995a0da0e93c5c34de7'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:52.886888 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1110/2203] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:35:52 2022] DELETE /identity/v3/users/ae0b2bc8ab624995a0da0e93c5c34de7 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:35:52.890374 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab86b1b-af4c-4203-9182-331d3db2f59c None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:52.890672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab86b1b-af4c-4203-9182-331d3db2f59c None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:52.891005 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab86b1b-af4c-4203-9182-331d3db2f59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:52.909231 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fcdd0-5f14-433c-a905-087f2bdb5df1 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:52.915060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-1ab86b1b-af4c-4203-9182-331d3db2f59c None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:52.916382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-1ab86b1b-af4c-4203-9182-331d3db2f59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:53.022237 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942849c-93d2-4edd-b8c4-acf244cfd957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:53.023412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942849c-93d2-4edd-b8c4-acf244cfd957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:53.023805 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942849c-93d2-4edd-b8c4-acf244cfd957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:53.026312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1111/2204] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:53.027927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a95fcc-4c85-496e-9b07-3784499d165f None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:53.032219 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942849c-93d2-4edd-b8c4-acf244cfd957 admin admin] PATH_INFO: `/v3/users/f7fe55e67014453f87f47418493e0b92` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:53.033498 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a95fcc-4c85-496e-9b07-3784499d165f None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:53.034950 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942849c-93d2-4edd-b8c4-acf244cfd957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7fe55e67014453f87f47418493e0b92)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:53.035802 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a95fcc-4c85-496e-9b07-3784499d165f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:53.038004 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942849c-93d2-4edd-b8c4-acf244cfd957 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:53.073930 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-a1a95fcc-4c85-496e-9b07-3784499d165f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:53.075707 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-a1a95fcc-4c85-496e-9b07-3784499d165f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:53.111762 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1112/2205] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:53.113922 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a95fcc-4c85-496e-9b07-3784499d165f None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:53.116347 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-a1a95fcc-4c85-496e-9b07-3784499d165f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:53.135815 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d942849c-93d2-4edd-b8c4-acf244cfd957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7fe55e67014453f87f47418493e0b92'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:53.149864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d942849c-93d2-4edd-b8c4-acf244cfd957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7fe55e67014453f87f47418493e0b92'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:53.164819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d942849c-93d2-4edd-b8c4-acf244cfd957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7fe55e67014453f87f47418493e0b92'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:53.165519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d942849c-93d2-4edd-b8c4-acf244cfd957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7fe55e67014453f87f47418493e0b92'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:53.166279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d942849c-93d2-4edd-b8c4-acf244cfd957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7fe55e67014453f87f47418493e0b92'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:53.210891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1094/2206] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:35:52 2022] DELETE /identity/v3/users/f7fe55e67014453f87f47418493e0b92 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:53.216427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942849c-93d2-4edd-b8c4-acf244cfd957 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:53.218886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-d942849c-93d2-4edd-b8c4-acf244cfd957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:53.280723 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a95fcc-4c85-496e-9b07-3784499d165f None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:53.337880 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942849c-93d2-4edd-b8c4-acf244cfd957 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:53.350262 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d7d39-ffbf-4f3e-8634-c3a3772115bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:53.351236 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d7d39-ffbf-4f3e-8634-c3a3772115bc service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:53.351236 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d7d39-ffbf-4f3e-8634-c3a3772115bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:53.351466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d7d39-ffbf-4f3e-8634-c3a3772115bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:53.355569 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-301d7d39-ffbf-4f3e-8634-c3a3772115bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:53.384100 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7459c-6924-479e-bea8-9aa6f8f44f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:53.384952 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7459c-6924-479e-bea8-9aa6f8f44f81 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:53.385305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7459c-6924-479e-bea8-9aa6f8f44f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:53.386192 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7459c-6924-479e-bea8-9aa6f8f44f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:53.388383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-02a7459c-6924-479e-bea8-9aa6f8f44f81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:53.511032 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d7d39-ffbf-4f3e-8634-c3a3772115bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:53.512663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d7d39-ffbf-4f3e-8634-c3a3772115bc service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:53.522743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a7459c-6924-479e-bea8-9aa6f8f44f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:53.525701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a7459c-6924-479e-bea8-9aa6f8f44f81 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:53.527191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1095/2207] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:35:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:35:53.528041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d7d39-ffbf-4f3e-8634-c3a3772115bc service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:53.529424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-301d7d39-ffbf-4f3e-8634-c3a3772115bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:53.549024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d7d39-ffbf-4f3e-8634-c3a3772115bc service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:53.556194 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1113/2208] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:35:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:35:53.565189 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8db79-401f-40c1-bfbd-ebb6f1a93053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:53.566535 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8db79-401f-40c1-bfbd-ebb6f1a93053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:53.567348 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8db79-401f-40c1-bfbd-ebb6f1a93053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:53.568354 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8db79-401f-40c1-bfbd-ebb6f1a93053 admin admin] PATH_INFO: `/v3/projects/e6bcfbcf3cf84607a2ea593055bf4cd6` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:53.570890 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8db79-401f-40c1-bfbd-ebb6f1a93053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6bcfbcf3cf84607a2ea593055bf4cd6)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:53.573182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8db79-401f-40c1-bfbd-ebb6f1a93053 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:53.669520 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-74b8db79-401f-40c1-bfbd-ebb6f1a93053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6bcfbcf3cf84607a2ea593055bf4cd6', 'request_id': 'req-74b8db79-401f-40c1-bfbd-ebb6f1a93053'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:53.678590 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-74b8db79-401f-40c1-bfbd-ebb6f1a93053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6bcfbcf3cf84607a2ea593055bf4cd6', 'request_id': 'req-74b8db79-401f-40c1-bfbd-ebb6f1a93053'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:53.692006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-74b8db79-401f-40c1-bfbd-ebb6f1a93053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6bcfbcf3cf84607a2ea593055bf4cd6', 'request_id': 'req-74b8db79-401f-40c1-bfbd-ebb6f1a93053'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:53.721345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-74b8db79-401f-40c1-bfbd-ebb6f1a93053 admin admin] The token cache is being invalidate because project e6bcfbcf3cf84607a2ea593055bf4cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:35:53.721753 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-74b8db79-401f-40c1-bfbd-ebb6f1a93053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:53.722502 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-74b8db79-401f-40c1-bfbd-ebb6f1a93053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:53.725447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1096/2209] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:35:53 2022] DELETE /identity/v3/projects/e6bcfbcf3cf84607a2ea593055bf4cd6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:53.730271 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667c924-44fa-4297-a39a-1b552d2acfae None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:53.730598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667c924-44fa-4297-a39a-1b552d2acfae None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:53.730888 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667c924-44fa-4297-a39a-1b552d2acfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:53.806691 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-6667c924-44fa-4297-a39a-1b552d2acfae None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:53.807954 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-6667c924-44fa-4297-a39a-1b552d2acfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:53.959167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e62e1-5932-4962-a94f-a5edf8d33212 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:53.959674 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e62e1-5932-4962-a94f-a5edf8d33212 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:53.960142 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e62e1-5932-4962-a94f-a5edf8d33212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:53.981042 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1114/2210] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:35:53.982941 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893dba7-5c10-4cab-a152-58994a8123a8 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:53.983384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893dba7-5c10-4cab-a152-58994a8123a8 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:53.983862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893dba7-5c10-4cab-a152-58994a8123a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:53.997618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-733e62e1-5932-4962-a94f-a5edf8d33212 None None] MFA Rules not processed for user `d9fff6faa4cd424fb86378738e54d6fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:53.998829 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-733e62e1-5932-4962-a94f-a5edf8d33212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:54.008488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-0893dba7-5c10-4cab-a152-58994a8123a8 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:54.009819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-0893dba7-5c10-4cab-a152-58994a8123a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:54.032284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1115/2211] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:54.034082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893dba7-5c10-4cab-a152-58994a8123a8 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:54.038800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-0893dba7-5c10-4cab-a152-58994a8123a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:54.067809 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893dba7-5c10-4cab-a152-58994a8123a8 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:54.084887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1e2a7-a872-4e21-9553-7bee3248838f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:54.086177 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1e2a7-a872-4e21-9553-7bee3248838f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:54.087175 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1e2a7-a872-4e21-9553-7bee3248838f admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:54.087619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1e2a7-a872-4e21-9553-7bee3248838f admin admin] PATH_INFO: `/v3/projects/fa604de18da04c76bd6932bc44d8547f` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:54.089423 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1e2a7-a872-4e21-9553-7bee3248838f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa604de18da04c76bd6932bc44d8547f)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:54.091632 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1e2a7-a872-4e21-9553-7bee3248838f admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:54.114639 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1097/2212] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:35:54.115694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e62e1-5932-4962-a94f-a5edf8d33212 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:54.128786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e62e1-5932-4962-a94f-a5edf8d33212 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:54.137254 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5751f6c-4700-4567-836f-078f0d64675a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:54.138577 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5751f6c-4700-4567-836f-078f0d64675a admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:54.138959 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5751f6c-4700-4567-836f-078f0d64675a admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:54.139705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5751f6c-4700-4567-836f-078f0d64675a admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:54.140816 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5751f6c-4700-4567-836f-078f0d64675a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:35:54.141263 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5751f6c-4700-4567-836f-078f0d64675a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:54.144224 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5751f6c-4700-4567-836f-078f0d64675a admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:54.168729 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1098/2213] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:35:54.169200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5751f6c-4700-4567-836f-078f0d64675a admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:54.181110 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5751f6c-4700-4567-836f-078f0d64675a admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:54.182271 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-e3b1e2a7-a872-4e21-9553-7bee3248838f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa604de18da04c76bd6932bc44d8547f', 'request_id': 'req-e3b1e2a7-a872-4e21-9553-7bee3248838f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:54.189883 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-e3b1e2a7-a872-4e21-9553-7bee3248838f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa604de18da04c76bd6932bc44d8547f', 'request_id': 'req-e3b1e2a7-a872-4e21-9553-7bee3248838f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:54.216482 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-e3b1e2a7-a872-4e21-9553-7bee3248838f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa604de18da04c76bd6932bc44d8547f', 'request_id': 'req-e3b1e2a7-a872-4e21-9553-7bee3248838f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:54.259800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-e3b1e2a7-a872-4e21-9553-7bee3248838f admin admin] The token cache is being invalidate because project fa604de18da04c76bd6932bc44d8547f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:35:54.260264 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-e3b1e2a7-a872-4e21-9553-7bee3248838f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:54.263587 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-e3b1e2a7-a872-4e21-9553-7bee3248838f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:54.265783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1116/2214] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:35:54 2022] DELETE /identity/v3/projects/fa604de18da04c76bd6932bc44d8547f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:54.286277 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1e2a7-a872-4e21-9553-7bee3248838f admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:54.293069 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-e3b1e2a7-a872-4e21-9553-7bee3248838f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:54.312401 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef98552-1060-452f-8fe4-91d1eeebc0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:54.313281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef98552-1060-452f-8fe4-91d1eeebc0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:54.314991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef98552-1060-452f-8fe4-91d1eeebc0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:54.315396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef98552-1060-452f-8fe4-91d1eeebc0a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:54.318153 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef98552-1060-452f-8fe4-91d1eeebc0a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:54.321013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef98552-1060-452f-8fe4-91d1eeebc0a4 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:54.384585 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1099/2215] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:35:54 2022] POST /identity/v3/projects => generated 367 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:35:54.389181 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef98552-1060-452f-8fe4-91d1eeebc0a4 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:54.391388 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-2ef98552-1060-452f-8fe4-91d1eeebc0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:54.449315 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1e2a7-a872-4e21-9553-7bee3248838f admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:54.489020 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef98552-1060-452f-8fe4-91d1eeebc0a4 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:54.497109 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557608cc-ae96-498e-b4e2-3973636a16b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:54.498439 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557608cc-ae96-498e-b4e2-3973636a16b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:54.498828 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557608cc-ae96-498e-b4e2-3973636a16b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:54.499223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557608cc-ae96-498e-b4e2-3973636a16b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:54.500021 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557608cc-ae96-498e-b4e2-3973636a16b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:54.507889 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557608cc-ae96-498e-b4e2-3973636a16b5 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:54.545794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1100/2216] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:35:54 2022] POST /identity/v3/users => generated 284 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:35:54.549659 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557608cc-ae96-498e-b4e2-3973636a16b5 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:54.556679 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a550854-c2bb-4dbd-8e45-b417a8a1c166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:54.558067 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a550854-c2bb-4dbd-8e45-b417a8a1c166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:54.558425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a550854-c2bb-4dbd-8e45-b417a8a1c166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:54.558710 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a550854-c2bb-4dbd-8e45-b417a8a1c166 admin admin] PATH_INFO: `/v3/projects/b207eee88918499bb1beca1aa822fb17` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:54.559985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a550854-c2bb-4dbd-8e45-b417a8a1c166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b207eee88918499bb1beca1aa822fb17)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:54.562199 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a550854-c2bb-4dbd-8e45-b417a8a1c166 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:54.562466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557608cc-ae96-498e-b4e2-3973636a16b5 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:54.568612 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7508c-800b-4d13-a589-444c608ba703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:54.569518 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7508c-800b-4d13-a589-444c608ba703 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:54.569917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7508c-800b-4d13-a589-444c608ba703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:54.570260 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7508c-800b-4d13-a589-444c608ba703 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:54.571052 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7508c-800b-4d13-a589-444c608ba703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:54.572766 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7508c-800b-4d13-a589-444c608ba703 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:54.584479 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1101/2217] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:35:54.588568 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7508c-800b-4d13-a589-444c608ba703 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:54.600883 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7508c-800b-4d13-a589-444c608ba703 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:54.607968 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d873a5-ab22-4e13-9fa7-43c1fdb40370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:54.608816 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d873a5-ab22-4e13-9fa7-43c1fdb40370 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:54.609161 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d873a5-ab22-4e13-9fa7-43c1fdb40370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:54.609673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d873a5-ab22-4e13-9fa7-43c1fdb40370 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:54.610525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d873a5-ab22-4e13-9fa7-43c1fdb40370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:54.612337 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d873a5-ab22-4e13-9fa7-43c1fdb40370 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:54.628626 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1102/2218] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:35:54.633750 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d873a5-ab22-4e13-9fa7-43c1fdb40370 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:54.637065 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-0a550854-c2bb-4dbd-8e45-b417a8a1c166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b207eee88918499bb1beca1aa822fb17', 'request_id': 'req-0a550854-c2bb-4dbd-8e45-b417a8a1c166'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:54.643761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-0a550854-c2bb-4dbd-8e45-b417a8a1c166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b207eee88918499bb1beca1aa822fb17', 'request_id': 'req-0a550854-c2bb-4dbd-8e45-b417a8a1c166'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:54.650314 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-0a550854-c2bb-4dbd-8e45-b417a8a1c166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b207eee88918499bb1beca1aa822fb17', 'request_id': 'req-0a550854-c2bb-4dbd-8e45-b417a8a1c166'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:54.652381 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d873a5-ab22-4e13-9fa7-43c1fdb40370 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:54.701760 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-0a550854-c2bb-4dbd-8e45-b417a8a1c166 admin admin] The token cache is being invalidate because project b207eee88918499bb1beca1aa822fb17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:35:54.702051 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-0a550854-c2bb-4dbd-8e45-b417a8a1c166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:54.702733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-0a550854-c2bb-4dbd-8e45-b417a8a1c166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:54.704824 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1117/2219] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:35:54 2022] DELETE /identity/v3/projects/b207eee88918499bb1beca1aa822fb17 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:54.710053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a550854-c2bb-4dbd-8e45-b417a8a1c166 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:54.711811 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-0a550854-c2bb-4dbd-8e45-b417a8a1c166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:54.723000 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0cd452-301f-45b6-9963-fe937a91e804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:54.724890 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cd452-301f-45b6-9963-fe937a91e804 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:54.725173 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cd452-301f-45b6-9963-fe937a91e804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:54.725444 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cd452-301f-45b6-9963-fe937a91e804 admin admin] PATH_INFO: `/v3/projects/b5da5e99dce14afeadc515366bb63104/users/91c1ff140d2e46c1a3ca8a0c2cac24f4/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:54.745350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0cd452-301f-45b6-9963-fe937a91e804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5da5e99dce14afeadc515366bb63104, user_id=91c1ff140d2e46c1a3ca8a0c2cac24f4, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:54.748855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0cd452-301f-45b6-9963-fe937a91e804 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:54.772100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1103/2220] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:35:54 2022] PUT /identity/v3/projects/b5da5e99dce14afeadc515366bb63104/users/91c1ff140d2e46c1a3ca8a0c2cac24f4/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:54.782524 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71684f6a-6c36-4894-b617-c921e675dab8 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:54.785385 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71684f6a-6c36-4894-b617-c921e675dab8 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:54.785694 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71684f6a-6c36-4894-b617-c921e675dab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:54.814291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a550854-c2bb-4dbd-8e45-b417a8a1c166 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:54.850056 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-71684f6a-6c36-4894-b617-c921e675dab8 None None] MFA Rules not processed for user `91c1ff140d2e46c1a3ca8a0c2cac24f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:54.851494 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-71684f6a-6c36-4894-b617-c921e675dab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:54.894103 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3c642-b8cd-48db-a493-6daa10aa1f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:54.894985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c642-b8cd-48db-a493-6daa10aa1f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:54.895262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c642-b8cd-48db-a493-6daa10aa1f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:54.895765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c642-b8cd-48db-a493-6daa10aa1f30 admin admin] PATH_INFO: `/v3/users/36e9f73bfca54f09923822813ba7434c` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:54.897482 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3c642-b8cd-48db-a493-6daa10aa1f30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36e9f73bfca54f09923822813ba7434c)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:54.899572 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3c642-b8cd-48db-a493-6daa10aa1f30 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:54.983946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1104/2221] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:54.984185 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-5ea3c642-b8cd-48db-a493-6daa10aa1f30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36e9f73bfca54f09923822813ba7434c'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:54.996827 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-5ea3c642-b8cd-48db-a493-6daa10aa1f30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36e9f73bfca54f09923822813ba7434c'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:55.001015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-5ea3c642-b8cd-48db-a493-6daa10aa1f30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36e9f73bfca54f09923822813ba7434c'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:55.002349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71684f6a-6c36-4894-b617-c921e675dab8 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:55.004885 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-71684f6a-6c36-4894-b617-c921e675dab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:55.016433 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-5ea3c642-b8cd-48db-a493-6daa10aa1f30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36e9f73bfca54f09923822813ba7434c'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:55.021694 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-5ea3c642-b8cd-48db-a493-6daa10aa1f30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36e9f73bfca54f09923822813ba7434c'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:55.061493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1118/2222] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:35:54 2022] DELETE /identity/v3/users/36e9f73bfca54f09923822813ba7434c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:55.105660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71684f6a-6c36-4894-b617-c921e675dab8 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:55.193150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050abfe-6147-4d7e-8262-82b6132b3574 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a63ecc7210574058aad75a3114b57202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:55.193898 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050abfe-6147-4d7e-8262-82b6132b3574 service glance] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:55.194176 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050abfe-6147-4d7e-8262-82b6132b3574 service glance] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:55.194453 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050abfe-6147-4d7e-8262-82b6132b3574 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:55.197262 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e050abfe-6147-4d7e-8262-82b6132b3574 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:55.321516 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050abfe-6147-4d7e-8262-82b6132b3574 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:55.323209 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050abfe-6147-4d7e-8262-82b6132b3574 service glance] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:55.347664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1105/2223] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:35:55 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:35:55.493490 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3c642-b8cd-48db-a493-6daa10aa1f30 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:55.495075 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-5ea3c642-b8cd-48db-a493-6daa10aa1f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:55.615530 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3c642-b8cd-48db-a493-6daa10aa1f30 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:55.633363 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f929c05-e437-4ae3-bb9d-481727fd9768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:55.634269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f929c05-e437-4ae3-bb9d-481727fd9768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:55.634506 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f929c05-e437-4ae3-bb9d-481727fd9768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:55.634778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f929c05-e437-4ae3-bb9d-481727fd9768 admin admin] PATH_INFO: `/v3/projects/d7e1cde935a54316a24a99a21a64a926` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:55.635981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f929c05-e437-4ae3-bb9d-481727fd9768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e1cde935a54316a24a99a21a64a926)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:55.638044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f929c05-e437-4ae3-bb9d-481727fd9768 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:55.701927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2f929c05-e437-4ae3-bb9d-481727fd9768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e1cde935a54316a24a99a21a64a926', 'request_id': 'req-2f929c05-e437-4ae3-bb9d-481727fd9768'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:55.711107 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2f929c05-e437-4ae3-bb9d-481727fd9768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e1cde935a54316a24a99a21a64a926', 'request_id': 'req-2f929c05-e437-4ae3-bb9d-481727fd9768'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:55.721454 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2f929c05-e437-4ae3-bb9d-481727fd9768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e1cde935a54316a24a99a21a64a926', 'request_id': 'req-2f929c05-e437-4ae3-bb9d-481727fd9768'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:55.738445 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2f929c05-e437-4ae3-bb9d-481727fd9768 admin admin] The token cache is being invalidate because project d7e1cde935a54316a24a99a21a64a926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:35:55.738727 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2f929c05-e437-4ae3-bb9d-481727fd9768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:55.739381 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2f929c05-e437-4ae3-bb9d-481727fd9768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:35:55.741397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1119/2224] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:35:55 2022] DELETE /identity/v3/projects/d7e1cde935a54316a24a99a21a64a926 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:55.746788 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36bef7-731b-4092-974d-e7cae6ef8c29 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:55.747311 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36bef7-731b-4092-974d-e7cae6ef8c29 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:55.747618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36bef7-731b-4092-974d-e7cae6ef8c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:55.776766 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-ca36bef7-731b-4092-974d-e7cae6ef8c29 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:55.778356 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-ca36bef7-731b-4092-974d-e7cae6ef8c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:55.882608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1106/2225] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:35:55.894689 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80c334-3409-48b3-989a-b9c1c7b0905c None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:55.894980 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80c334-3409-48b3-989a-b9c1c7b0905c None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:55.895301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80c334-3409-48b3-989a-b9c1c7b0905c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:55.957620 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-7e80c334-3409-48b3-989a-b9c1c7b0905c None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:55.958925 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-7e80c334-3409-48b3-989a-b9c1c7b0905c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:55.978293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1120/2226] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:55.979862 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36bef7-731b-4092-974d-e7cae6ef8c29 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:55.992459 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36bef7-731b-4092-974d-e7cae6ef8c29 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:56.001426 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f983b23-e237-4c61-a7e0-d42f43903c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:56.003450 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f983b23-e237-4c61-a7e0-d42f43903c92 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:56.004399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f983b23-e237-4c61-a7e0-d42f43903c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:56.004752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f983b23-e237-4c61-a7e0-d42f43903c92 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:56.006697 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f983b23-e237-4c61-a7e0-d42f43903c92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:35:56.007021 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f983b23-e237-4c61-a7e0-d42f43903c92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:56.009553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f983b23-e237-4c61-a7e0-d42f43903c92 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:56.028975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1107/2227] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:35:56.035846 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80c334-3409-48b3-989a-b9c1c7b0905c None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:56.050613 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80c334-3409-48b3-989a-b9c1c7b0905c None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:56.057606 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a31982-88de-4337-85f4-ab397b3245cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:56.058459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a31982-88de-4337-85f4-ab397b3245cb admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:56.058833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a31982-88de-4337-85f4-ab397b3245cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:56.059203 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a31982-88de-4337-85f4-ab397b3245cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:56.060495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a31982-88de-4337-85f4-ab397b3245cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:56.063041 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a31982-88de-4337-85f4-ab397b3245cb admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:56.144241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1121/2228] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:35:56 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:35:56.149214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f983b23-e237-4c61-a7e0-d42f43903c92 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:56.160999 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f983b23-e237-4c61-a7e0-d42f43903c92 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:56.238777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d79bc2-ef25-4715-8ba3-4eebd8bad5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:56.239452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d79bc2-ef25-4715-8ba3-4eebd8bad5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:56.240389 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d79bc2-ef25-4715-8ba3-4eebd8bad5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:56.240696 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d79bc2-ef25-4715-8ba3-4eebd8bad5b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:56.241404 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d79bc2-ef25-4715-8ba3-4eebd8bad5b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:56.244744 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d79bc2-ef25-4715-8ba3-4eebd8bad5b9 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:56.270214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1108/2229] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:35:56 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:35:56.274782 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a31982-88de-4337-85f4-ab397b3245cb admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:56.285753 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a31982-88de-4337-85f4-ab397b3245cb admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:56.292744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb862ef-df47-4af7-9808-39ba5c80f680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:56.293458 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb862ef-df47-4af7-9808-39ba5c80f680 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:56.293771 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb862ef-df47-4af7-9808-39ba5c80f680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:56.294254 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb862ef-df47-4af7-9808-39ba5c80f680 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:56.294991 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb862ef-df47-4af7-9808-39ba5c80f680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:56.298066 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb862ef-df47-4af7-9808-39ba5c80f680 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:56.311990 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1122/2230] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:35:56.316213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d79bc2-ef25-4715-8ba3-4eebd8bad5b9 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:56.331864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d79bc2-ef25-4715-8ba3-4eebd8bad5b9 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:56.338268 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78280081-d3b5-4508-ba45-6404ff7bd54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:56.338962 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78280081-d3b5-4508-ba45-6404ff7bd54a admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:56.339226 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78280081-d3b5-4508-ba45-6404ff7bd54a admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:56.339502 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78280081-d3b5-4508-ba45-6404ff7bd54a admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:56.340235 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78280081-d3b5-4508-ba45-6404ff7bd54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:56.343179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78280081-d3b5-4508-ba45-6404ff7bd54a admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:56.357165 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1109/2231] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:35:56.361462 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb862ef-df47-4af7-9808-39ba5c80f680 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:56.377042 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb862ef-df47-4af7-9808-39ba5c80f680 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:56.383824 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed90ef9-0582-4853-b907-0016e96149fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:56.385275 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed90ef9-0582-4853-b907-0016e96149fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:56.385628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed90ef9-0582-4853-b907-0016e96149fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:56.385975 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed90ef9-0582-4853-b907-0016e96149fa admin admin] PATH_INFO: `/v3/projects/5b65f58d692248d3bf0c03bff716e1fb/users/a9fd4d50424a41d59ee31d65ec362058/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:56.403256 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed90ef9-0582-4853-b907-0016e96149fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b65f58d692248d3bf0c03bff716e1fb, user_id=a9fd4d50424a41d59ee31d65ec362058, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:56.406302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed90ef9-0582-4853-b907-0016e96149fa admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:56.425946 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1123/2232] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:35:56 2022] PUT /identity/v3/projects/5b65f58d692248d3bf0c03bff716e1fb/users/a9fd4d50424a41d59ee31d65ec362058/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:35:56.431323 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb526ee8-5071-44c8-a89f-3574bb74750c None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:56.431773 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb526ee8-5071-44c8-a89f-3574bb74750c None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:56.432170 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb526ee8-5071-44c8-a89f-3574bb74750c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:56.465567 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-fb526ee8-5071-44c8-a89f-3574bb74750c None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:35:56.468565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-fb526ee8-5071-44c8-a89f-3574bb74750c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:56.565508 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1110/2233] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:35:56.577922 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed90ef9-0582-4853-b907-0016e96149fa admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:35:56.579740 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-7ed90ef9-0582-4853-b907-0016e96149fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:35:56.678911 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed90ef9-0582-4853-b907-0016e96149fa admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:35:56.684064 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd02c0-2132-4429-8003-535ab4513654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:35:56.685288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd02c0-2132-4429-8003-535ab4513654 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:35:56.685734 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd02c0-2132-4429-8003-535ab4513654 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:35:56.686227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd02c0-2132-4429-8003-535ab4513654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:35:56.722113 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd02c0-2132-4429-8003-535ab4513654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:35:56.724206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd02c0-2132-4429-8003-535ab4513654 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:35:56.735598 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1124/2234] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:36:04.226283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f5446-6077-4ca5-b6b5-ca4c349b2076 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:04.226903 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f5446-6077-4ca5-b6b5-ca4c349b2076 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:04.231399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f5446-6077-4ca5-b6b5-ca4c349b2076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:04.284913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-893f5446-6077-4ca5-b6b5-ca4c349b2076 None None] MFA Rules not processed for user `a9fd4d50424a41d59ee31d65ec362058`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:36:04.287230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-893f5446-6077-4ca5-b6b5-ca4c349b2076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:04.437569 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1111/2235] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:36:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:36:04.453075 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd02c0-2132-4429-8003-535ab4513654 service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:04.466162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd02c0-2132-4429-8003-535ab4513654 service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:04.472494 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4b049-ee32-4445-8d1f-99d570846e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:04.473560 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4b049-ee32-4445-8d1f-99d570846e63 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:04.474416 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4b049-ee32-4445-8d1f-99d570846e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:04.475190 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4b049-ee32-4445-8d1f-99d570846e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:04.476122 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4b049-ee32-4445-8d1f-99d570846e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:04.478354 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4b049-ee32-4445-8d1f-99d570846e63 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:04.521388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1125/2236] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:36:04 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:36:04.528727 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f5446-6077-4ca5-b6b5-ca4c349b2076 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:04.541516 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f5446-6077-4ca5-b6b5-ca4c349b2076 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:04.625000 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35c590-be2c-412b-a34f-6f98a629b3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:04.625683 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35c590-be2c-412b-a34f-6f98a629b3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:04.625961 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35c590-be2c-412b-a34f-6f98a629b3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:04.626232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35c590-be2c-412b-a34f-6f98a629b3b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:04.626947 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35c590-be2c-412b-a34f-6f98a629b3b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:04.628914 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35c590-be2c-412b-a34f-6f98a629b3b5 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:04.672724 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1112/2237] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:36:04 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:36:04.674031 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4b049-ee32-4445-8d1f-99d570846e63 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:04.694512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4b049-ee32-4445-8d1f-99d570846e63 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:04.703324 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f38c3-51a6-4728-b956-3105a69ac4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:04.704005 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f38c3-51a6-4728-b956-3105a69ac4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:04.704300 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f38c3-51a6-4728-b956-3105a69ac4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:04.704586 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f38c3-51a6-4728-b956-3105a69ac4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:04.705327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f38c3-51a6-4728-b956-3105a69ac4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:04.706955 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f38c3-51a6-4728-b956-3105a69ac4f0 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:04.726233 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35c590-be2c-412b-a34f-6f98a629b3b5 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:04.733327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1126/2238] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:36:04.736809 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35c590-be2c-412b-a34f-6f98a629b3b5 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:04.742436 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad231d-1d29-4fd0-ab48-619e772a00ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:04.743435 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad231d-1d29-4fd0-ab48-619e772a00ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:04.743736 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad231d-1d29-4fd0-ab48-619e772a00ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:04.744017 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad231d-1d29-4fd0-ab48-619e772a00ed admin admin] PATH_INFO: `/v3/projects/44565a723e3d494b8ce945e42976ab08/users/9d08f3d1fb47418ba9979ab2e6cc205a/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:04.763449 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad231d-1d29-4fd0-ab48-619e772a00ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=44565a723e3d494b8ce945e42976ab08, user_id=9d08f3d1fb47418ba9979ab2e6cc205a, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:04.768840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad231d-1d29-4fd0-ab48-619e772a00ed admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:04.787126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1113/2239] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:36:04 2022] PUT /identity/v3/projects/44565a723e3d494b8ce945e42976ab08/users/9d08f3d1fb47418ba9979ab2e6cc205a/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:36:04.791196 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f38c3-51a6-4728-b956-3105a69ac4f0 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:04.812097 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f38c3-51a6-4728-b956-3105a69ac4f0 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:04.917125 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35de65b-5bc6-487c-87be-72f41e17b6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:04.917806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35de65b-5bc6-487c-87be-72f41e17b6aa admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:04.918085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35de65b-5bc6-487c-87be-72f41e17b6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:04.918354 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35de65b-5bc6-487c-87be-72f41e17b6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:04.919089 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35de65b-5bc6-487c-87be-72f41e17b6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:04.924801 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35de65b-5bc6-487c-87be-72f41e17b6aa admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:04.941423 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1127/2240] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:36:04.945571 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad231d-1d29-4fd0-ab48-619e772a00ed admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:04.967048 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad231d-1d29-4fd0-ab48-619e772a00ed admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:04.976399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee6781-6645-460f-8694-5d7ec9fcf4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:04.977333 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee6781-6645-460f-8694-5d7ec9fcf4b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:04.977611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee6781-6645-460f-8694-5d7ec9fcf4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:04.977888 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee6781-6645-460f-8694-5d7ec9fcf4b7 admin admin] PATH_INFO: `/v3/projects/44565a723e3d494b8ce945e42976ab08/users/9d08f3d1fb47418ba9979ab2e6cc205a/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:04.982808 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee6781-6645-460f-8694-5d7ec9fcf4b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44565a723e3d494b8ce945e42976ab08, user_id=9d08f3d1fb47418ba9979ab2e6cc205a, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:04.995925 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee6781-6645-460f-8694-5d7ec9fcf4b7 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:05.015876 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1114/2241] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:36:04 2022] PUT /identity/v3/projects/44565a723e3d494b8ce945e42976ab08/users/9d08f3d1fb47418ba9979ab2e6cc205a/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:36:12.429292 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7f63f-ef82-4b8f-a3d9-b409fc5b7467 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:12.429879 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7f63f-ef82-4b8f-a3d9-b409fc5b7467 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:12.429879 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7f63f-ef82-4b8f-a3d9-b409fc5b7467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:12.449633 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e47cad-020a-4760-92cb-e451cd1af52c None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:12.450207 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e47cad-020a-4760-92cb-e451cd1af52c None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:12.450418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e47cad-020a-4760-92cb-e451cd1af52c None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:12.452831 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1115/2242] 10.222.0.60 () {54 vars in 921 bytes} [Fri May 6 23:36:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 06 23:36:12.461047 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-f3d7f63f-ef82-4b8f-a3d9-b409fc5b7467 None None] MFA Rules not processed for user `9d08f3d1fb47418ba9979ab2e6cc205a`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:36:12.462262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-f3d7f63f-ef82-4b8f-a3d9-b409fc5b7467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:12.463640 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185c0da-15b7-4670-8388-6427ee218b50 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:12.464017 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185c0da-15b7-4670-8388-6427ee218b50 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:12.464410 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185c0da-15b7-4670-8388-6427ee218b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:12.535269 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-f185c0da-15b7-4670-8388-6427ee218b50 None None] MFA Rules not processed for user `9b74631c6e1547d991753a65c41bc7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:36:12.536660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f185c0da-15b7-4670-8388-6427ee218b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:12.553592 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1128/2243] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:36:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:36:12.638681 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1116/2244] 10.222.0.60 () {58 vars in 1018 bytes} [Fri May 6 23:36:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:36:12.655997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7f63f-ef82-4b8f-a3d9-b409fc5b7467 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:12.657517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-f3d7f63f-ef82-4b8f-a3d9-b409fc5b7467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:12.657732 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185c0da-15b7-4670-8388-6427ee218b50 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:12.659654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f185c0da-15b7-4670-8388-6427ee218b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:12.673732 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185c0da-15b7-4670-8388-6427ee218b50 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:12.679887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54336d-2c80-4dfc-b374-bb6c7abbf282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:12.680554 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54336d-2c80-4dfc-b374-bb6c7abbf282 service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:12.680888 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54336d-2c80-4dfc-b374-bb6c7abbf282 service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:12.681174 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54336d-2c80-4dfc-b374-bb6c7abbf282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:12.720207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7f63f-ef82-4b8f-a3d9-b409fc5b7467 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:12.724370 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee833c75-3e8f-4bb8-9a4f-4afd828be568 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a63ecc7210574058aad75a3114b57202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:12.725031 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee833c75-3e8f-4bb8-9a4f-4afd828be568 service glance] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:12.725314 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee833c75-3e8f-4bb8-9a4f-4afd828be568 service glance] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:12.725592 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee833c75-3e8f-4bb8-9a4f-4afd828be568 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:12.738072 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee833c75-3e8f-4bb8-9a4f-4afd828be568 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:12.740358 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee833c75-3e8f-4bb8-9a4f-4afd828be568 service glance] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:12.749413 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54336d-2c80-4dfc-b374-bb6c7abbf282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:12.751031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54336d-2c80-4dfc-b374-bb6c7abbf282 service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:12.760600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1129/2245] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:36:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:36:12.763129 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1117/2246] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:36:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:36:12.858670 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e507146-5cc8-49cf-8923-6a4473f833f9 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:12.858958 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e507146-5cc8-49cf-8923-6a4473f833f9 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:12.859240 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e507146-5cc8-49cf-8923-6a4473f833f9 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:12.861910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1130/2247] 10.222.0.60 () {54 vars in 921 bytes} [Fri May 6 23:36:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:36:12.870274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968051f-29ed-4ac0-8aec-9803cfde51e5 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:12.870552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968051f-29ed-4ac0-8aec-9803cfde51e5 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:12.870818 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968051f-29ed-4ac0-8aec-9803cfde51e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:12.897448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-e968051f-29ed-4ac0-8aec-9803cfde51e5 None None] MFA Rules not processed for user `046352b8553c4f23b6dda151f6f7ce00`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:36:12.898756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e968051f-29ed-4ac0-8aec-9803cfde51e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:12.954624 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1118/2248] 10.222.0.60 () {58 vars in 1018 bytes} [Fri May 6 23:36:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:36:12.967135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e507146-5cc8-49cf-8923-6a4473f833f9 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:12.978359 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e507146-5cc8-49cf-8923-6a4473f833f9 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:12.982130 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b507de4-8f26-4aa1-a542-d23ab9adc232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:12.982875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b507de4-8f26-4aa1-a542-d23ab9adc232 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:12.983258 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b507de4-8f26-4aa1-a542-d23ab9adc232 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:12.983634 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b507de4-8f26-4aa1-a542-d23ab9adc232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:12.992620 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b507de4-8f26-4aa1-a542-d23ab9adc232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:12.994268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b507de4-8f26-4aa1-a542-d23ab9adc232 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:13.003231 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1131/2249] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:36:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:36:13.101883 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a6b33-02b8-4f61-8332-1340295417f9 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:13.102183 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a6b33-02b8-4f61-8332-1340295417f9 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:13.102466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a6b33-02b8-4f61-8332-1340295417f9 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:13.103855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1119/2250] 10.222.0.60 () {54 vars in 921 bytes} [Fri May 6 23:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:36:13.109963 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467aba7-2f07-424b-a30e-691d34750f63 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:13.110366 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467aba7-2f07-424b-a30e-691d34750f63 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:13.110710 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467aba7-2f07-424b-a30e-691d34750f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:13.131750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-d467aba7-2f07-424b-a30e-691d34750f63 None None] MFA Rules not processed for user `9b74631c6e1547d991753a65c41bc7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:36:13.133061 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d467aba7-2f07-424b-a30e-691d34750f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:13.143334 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1132/2251] 10.222.0.60 () {58 vars in 1018 bytes} [Fri May 6 23:36:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:36:13.166545 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a6b33-02b8-4f61-8332-1340295417f9 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:13.178658 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a6b33-02b8-4f61-8332-1340295417f9 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:13.182417 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df3f90-b9ee-4da2-a35b-7b7f6370d93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:13.183055 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df3f90-b9ee-4da2-a35b-7b7f6370d93e service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:13.183338 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df3f90-b9ee-4da2-a35b-7b7f6370d93e service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:13.183604 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df3f90-b9ee-4da2-a35b-7b7f6370d93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:13.196895 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df3f90-b9ee-4da2-a35b-7b7f6370d93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:13.198421 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df3f90-b9ee-4da2-a35b-7b7f6370d93e service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:13.211099 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1120/2252] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:36:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:36:18.055234 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88cd32-2a39-4e4f-a37f-91c90cc14c6a None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:18.056333 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88cd32-2a39-4e4f-a37f-91c90cc14c6a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:18.056810 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88cd32-2a39-4e4f-a37f-91c90cc14c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:18.176005 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-0e88cd32-2a39-4e4f-a37f-91c90cc14c6a None None] MFA Rules not processed for user `d211582f9fc34b0e815e27db081c50c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:36:18.176005 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-0e88cd32-2a39-4e4f-a37f-91c90cc14c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:18.267687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1133/2253] 10.222.0.60 () {58 vars in 1009 bytes} [Fri May 6 23:36:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:36:18.280509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df3f90-b9ee-4da2-a35b-7b7f6370d93e service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:18.282054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-67df3f90-b9ee-4da2-a35b-7b7f6370d93e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:18.385650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df3f90-b9ee-4da2-a35b-7b7f6370d93e service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:18.390682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e932f64-1880-4b1a-b92d-da4e6768734d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b3ec57aee94b87889d578e114fa0db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:18.391351 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e932f64-1880-4b1a-b92d-da4e6768734d service swift] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:18.391627 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e932f64-1880-4b1a-b92d-da4e6768734d service swift] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:18.392112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e932f64-1880-4b1a-b92d-da4e6768734d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:18.400690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e932f64-1880-4b1a-b92d-da4e6768734d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:18.402278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e932f64-1880-4b1a-b92d-da4e6768734d service swift] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:18.410311 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1121/2254] 10.222.0.60 () {60 vars in 1384 bytes} [Fri May 6 23:36:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 06 23:36:27.111837 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88cd32-2a39-4e4f-a37f-91c90cc14c6a None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:27.113335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-0e88cd32-2a39-4e4f-a37f-91c90cc14c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:27.182503 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88cd32-2a39-4e4f-a37f-91c90cc14c6a None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:27.187429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301a8c4-6f2a-48cd-97cf-cbee7650dfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:27.188397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301a8c4-6f2a-48cd-97cf-cbee7650dfdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:27.188776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301a8c4-6f2a-48cd-97cf-cbee7650dfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:27.189251 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301a8c4-6f2a-48cd-97cf-cbee7650dfdf admin admin] PATH_INFO: `/v3/users/91c1ff140d2e46c1a3ca8a0c2cac24f4` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:27.190428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301a8c4-6f2a-48cd-97cf-cbee7650dfdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c1ff140d2e46c1a3ca8a0c2cac24f4)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:27.192487 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301a8c4-6f2a-48cd-97cf-cbee7650dfdf admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:27.250821 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-d301a8c4-6f2a-48cd-97cf-cbee7650dfdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c1ff140d2e46c1a3ca8a0c2cac24f4'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:36:27.259386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-d301a8c4-6f2a-48cd-97cf-cbee7650dfdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c1ff140d2e46c1a3ca8a0c2cac24f4'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:36:27.260526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-d301a8c4-6f2a-48cd-97cf-cbee7650dfdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c1ff140d2e46c1a3ca8a0c2cac24f4'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:36:27.268958 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-d301a8c4-6f2a-48cd-97cf-cbee7650dfdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c1ff140d2e46c1a3ca8a0c2cac24f4'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:36:27.269621 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-d301a8c4-6f2a-48cd-97cf-cbee7650dfdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c1ff140d2e46c1a3ca8a0c2cac24f4'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:36:27.290181 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1134/2255] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:36:27 2022] DELETE /identity/v3/users/91c1ff140d2e46c1a3ca8a0c2cac24f4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:36:27.294789 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2115-608e-4f97-9b61-2ed30f044732 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:27.295402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2115-608e-4f97-9b61-2ed30f044732 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:27.295490 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2115-608e-4f97-9b61-2ed30f044732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:27.317146 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-888b2115-608e-4f97-9b61-2ed30f044732 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:36:27.318474 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-888b2115-608e-4f97-9b61-2ed30f044732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:27.381138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1122/2256] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:36:27.391018 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301a8c4-6f2a-48cd-97cf-cbee7650dfdf admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:27.393383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d301a8c4-6f2a-48cd-97cf-cbee7650dfdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:27.452994 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301a8c4-6f2a-48cd-97cf-cbee7650dfdf admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:27.456787 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e111033-ef1e-45df-a6c9-9d80b19beb3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:27.457552 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111033-ef1e-45df-a6c9-9d80b19beb3d service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:27.458629 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111033-ef1e-45df-a6c9-9d80b19beb3d service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:27.459021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111033-ef1e-45df-a6c9-9d80b19beb3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:27.472057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e111033-ef1e-45df-a6c9-9d80b19beb3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:27.473591 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e111033-ef1e-45df-a6c9-9d80b19beb3d service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:27.483747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1135/2257] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:36:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:36:27.798573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b2115-608e-4f97-9b61-2ed30f044732 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:27.800262 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-888b2115-608e-4f97-9b61-2ed30f044732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:27.813169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b2115-608e-4f97-9b61-2ed30f044732 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:27.818471 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c90ff3-4b93-453c-8e93-59322c4ec9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:27.819495 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c90ff3-4b93-453c-8e93-59322c4ec9db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:27.820851 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c90ff3-4b93-453c-8e93-59322c4ec9db admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:27.821312 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c90ff3-4b93-453c-8e93-59322c4ec9db admin admin] PATH_INFO: `/v3/projects/b5da5e99dce14afeadc515366bb63104` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:27.823428 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c90ff3-4b93-453c-8e93-59322c4ec9db admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5da5e99dce14afeadc515366bb63104)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:27.825638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c90ff3-4b93-453c-8e93-59322c4ec9db admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:27.908928 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b2c90ff3-4b93-453c-8e93-59322c4ec9db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5da5e99dce14afeadc515366bb63104', 'request_id': 'req-b2c90ff3-4b93-453c-8e93-59322c4ec9db'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:36:27.915644 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b2c90ff3-4b93-453c-8e93-59322c4ec9db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5da5e99dce14afeadc515366bb63104', 'request_id': 'req-b2c90ff3-4b93-453c-8e93-59322c4ec9db'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:36:27.921178 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b2c90ff3-4b93-453c-8e93-59322c4ec9db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5da5e99dce14afeadc515366bb63104', 'request_id': 'req-b2c90ff3-4b93-453c-8e93-59322c4ec9db'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:36:27.933582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b2c90ff3-4b93-453c-8e93-59322c4ec9db admin admin] The token cache is being invalidate because project b5da5e99dce14afeadc515366bb63104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:36:27.933865 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b2c90ff3-4b93-453c-8e93-59322c4ec9db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:36:27.934499 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b2c90ff3-4b93-453c-8e93-59322c4ec9db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:36:27.936235 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1123/2258] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:36:27 2022] DELETE /identity/v3/projects/b5da5e99dce14afeadc515366bb63104 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:36:27.941552 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bee1d6-2f18-4101-86aa-1c6dbe8ccba1 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:27.941866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bee1d6-2f18-4101-86aa-1c6dbe8ccba1 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:27.942691 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bee1d6-2f18-4101-86aa-1c6dbe8ccba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:27.962180 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-99bee1d6-2f18-4101-86aa-1c6dbe8ccba1 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:36:27.963370 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-99bee1d6-2f18-4101-86aa-1c6dbe8ccba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:28.023230 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1136/2259] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:36:28.031017 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc887d-ad5d-43ec-8379-a17fae3febed None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:28.031308 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc887d-ad5d-43ec-8379-a17fae3febed None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:28.031674 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc887d-ad5d-43ec-8379-a17fae3febed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:28.050919 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-01fc887d-ad5d-43ec-8379-a17fae3febed None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:36:28.052725 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-01fc887d-ad5d-43ec-8379-a17fae3febed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:28.061108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1124/2260] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:36:28.065228 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bee1d6-2f18-4101-86aa-1c6dbe8ccba1 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:28.075066 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bee1d6-2f18-4101-86aa-1c6dbe8ccba1 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:28.079722 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa41553-d158-4ffe-99e6-7775e8e866e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:28.080417 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa41553-d158-4ffe-99e6-7775e8e866e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:28.080728 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa41553-d158-4ffe-99e6-7775e8e866e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:28.081008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa41553-d158-4ffe-99e6-7775e8e866e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:28.081748 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa41553-d158-4ffe-99e6-7775e8e866e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:36:28.082068 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa41553-d158-4ffe-99e6-7775e8e866e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:28.083684 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa41553-d158-4ffe-99e6-7775e8e866e5 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:28.102141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1137/2261] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:36:28.102392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc887d-ad5d-43ec-8379-a17fae3febed None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:28.111678 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc887d-ad5d-43ec-8379-a17fae3febed None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:28.117502 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30869502-3ba6-493d-b6ea-a7a7e057d981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:28.118344 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30869502-3ba6-493d-b6ea-a7a7e057d981 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:28.118697 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30869502-3ba6-493d-b6ea-a7a7e057d981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:28.119045 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30869502-3ba6-493d-b6ea-a7a7e057d981 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:28.119807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30869502-3ba6-493d-b6ea-a7a7e057d981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:28.121892 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30869502-3ba6-493d-b6ea-a7a7e057d981 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:28.152836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1125/2262] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:36:28 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:36:28.157423 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa41553-d158-4ffe-99e6-7775e8e866e5 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:28.168130 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa41553-d158-4ffe-99e6-7775e8e866e5 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:28.225704 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300d58a-c122-427a-9c68-c6e561417402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:28.226381 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300d58a-c122-427a-9c68-c6e561417402 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:28.226662 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300d58a-c122-427a-9c68-c6e561417402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:28.227067 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300d58a-c122-427a-9c68-c6e561417402 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:28.227775 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300d58a-c122-427a-9c68-c6e561417402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:28.229782 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300d58a-c122-427a-9c68-c6e561417402 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:28.252654 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1138/2263] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:36:28 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:36:28.256895 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30869502-3ba6-493d-b6ea-a7a7e057d981 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:28.267153 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30869502-3ba6-493d-b6ea-a7a7e057d981 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:28.272416 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cb589-09c2-4d53-8863-5eadf8a342d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:28.273089 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cb589-09c2-4d53-8863-5eadf8a342d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:28.273370 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cb589-09c2-4d53-8863-5eadf8a342d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:28.280923 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cb589-09c2-4d53-8863-5eadf8a342d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:28.280923 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cb589-09c2-4d53-8863-5eadf8a342d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:28.280923 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cb589-09c2-4d53-8863-5eadf8a342d8 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:28.292572 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1126/2264] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:36:28.301259 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300d58a-c122-427a-9c68-c6e561417402 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:28.311812 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300d58a-c122-427a-9c68-c6e561417402 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:28.316709 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0386df-ec79-46ca-b5d1-ceb4878c1538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:28.317416 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0386df-ec79-46ca-b5d1-ceb4878c1538 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:28.317701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0386df-ec79-46ca-b5d1-ceb4878c1538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:28.318002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0386df-ec79-46ca-b5d1-ceb4878c1538 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:28.318924 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0386df-ec79-46ca-b5d1-ceb4878c1538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:28.320693 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0386df-ec79-46ca-b5d1-ceb4878c1538 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:28.331333 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1139/2265] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:36:28.336188 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cb589-09c2-4d53-8863-5eadf8a342d8 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:28.352621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cb589-09c2-4d53-8863-5eadf8a342d8 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:28.357869 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200df15d-4ba3-460f-87f4-c31bb8eff83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:28.358785 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200df15d-4ba3-460f-87f4-c31bb8eff83e admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:28.359075 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200df15d-4ba3-460f-87f4-c31bb8eff83e admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:28.359401 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200df15d-4ba3-460f-87f4-c31bb8eff83e admin admin] PATH_INFO: `/v3/projects/e945e78585194b4c8ceff8affbfe7962/users/a27d8cb56cc742cebedeb2d78fc73e2b/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:28.378279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200df15d-4ba3-460f-87f4-c31bb8eff83e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e945e78585194b4c8ceff8affbfe7962, user_id=a27d8cb56cc742cebedeb2d78fc73e2b, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:28.381581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200df15d-4ba3-460f-87f4-c31bb8eff83e admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:28.400648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1127/2266] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:36:28 2022] PUT /identity/v3/projects/e945e78585194b4c8ceff8affbfe7962/users/a27d8cb56cc742cebedeb2d78fc73e2b/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:36:28.402830 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e6df1-1d0d-49b3-9b7d-e225fb02bd28 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:28.403124 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e6df1-1d0d-49b3-9b7d-e225fb02bd28 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:28.403440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e6df1-1d0d-49b3-9b7d-e225fb02bd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:28.425223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-680e6df1-1d0d-49b3-9b7d-e225fb02bd28 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:36:28.426982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-680e6df1-1d0d-49b3-9b7d-e225fb02bd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:28.512481 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1140/2267] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:36:28.522274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200df15d-4ba3-460f-87f4-c31bb8eff83e admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:28.524715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-200df15d-4ba3-460f-87f4-c31bb8eff83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:28.596319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200df15d-4ba3-460f-87f4-c31bb8eff83e admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:28.611135 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed9f4d-23a5-4ee6-a484-93322507e0a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:28.611787 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed9f4d-23a5-4ee6-a484-93322507e0a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:28.611993 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed9f4d-23a5-4ee6-a484-93322507e0a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:28.612266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed9f4d-23a5-4ee6-a484-93322507e0a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:28.622466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed9f4d-23a5-4ee6-a484-93322507e0a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:28.623926 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed9f4d-23a5-4ee6-a484-93322507e0a8 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:28.634438 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1128/2268] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:36:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:36:31.222886 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e6df1-1d0d-49b3-9b7d-e225fb02bd28 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:31.226068 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-680e6df1-1d0d-49b3-9b7d-e225fb02bd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:31.356121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e6df1-1d0d-49b3-9b7d-e225fb02bd28 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:31.367009 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1293cf9-b129-4d9e-ac67-6d1ddeeb68be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1f7704fb5644688b8764bb1ce15734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:31.368323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1293cf9-b129-4d9e-ac67-6d1ddeeb68be service placement] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:31.368663 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1293cf9-b129-4d9e-ac67-6d1ddeeb68be service placement] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:31.369099 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1293cf9-b129-4d9e-ac67-6d1ddeeb68be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:31.371765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d1293cf9-b129-4d9e-ac67-6d1ddeeb68be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:31.402991 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1293cf9-b129-4d9e-ac67-6d1ddeeb68be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:31.405540 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1293cf9-b129-4d9e-ac67-6d1ddeeb68be service placement] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:31.426797 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1141/2269] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:36:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:36:32.064575 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4760c9-97e3-41e3-a309-5afe617bcfc0 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:32.065745 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4760c9-97e3-41e3-a309-5afe617bcfc0 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:32.066281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4760c9-97e3-41e3-a309-5afe617bcfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:32.096489 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-9c4760c9-97e3-41e3-a309-5afe617bcfc0 None None] MFA Rules not processed for user `a9fd4d50424a41d59ee31d65ec362058`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:36:32.098032 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9c4760c9-97e3-41e3-a309-5afe617bcfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:32.210086 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1129/2270] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:36:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:36:33.967295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ff4cd-114d-4293-9f67-f7a0af0ca3d3 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:33.972001 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ff4cd-114d-4293-9f67-f7a0af0ca3d3 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:33.972250 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ff4cd-114d-4293-9f67-f7a0af0ca3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:34.010219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-945ff4cd-114d-4293-9f67-f7a0af0ca3d3 None None] MFA Rules not processed for user `a27d8cb56cc742cebedeb2d78fc73e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:36:34.011761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-945ff4cd-114d-4293-9f67-f7a0af0ca3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:34.104253 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1142/2271] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:36:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:36:34.109188 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4760c9-97e3-41e3-a309-5afe617bcfc0 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:34.124191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4760c9-97e3-41e3-a309-5afe617bcfc0 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:34.132122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9a335-ad47-4e41-a561-bb36f9c2a1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:34.133098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9a335-ad47-4e41-a561-bb36f9c2a1df admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:34.133660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9a335-ad47-4e41-a561-bb36f9c2a1df admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:34.134188 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9a335-ad47-4e41-a561-bb36f9c2a1df admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:34.134988 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9a335-ad47-4e41-a561-bb36f9c2a1df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:34.137018 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9a335-ad47-4e41-a561-bb36f9c2a1df admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:34.177672 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1130/2272] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:36:34 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:36:34.179004 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ff4cd-114d-4293-9f67-f7a0af0ca3d3 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:34.196322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ff4cd-114d-4293-9f67-f7a0af0ca3d3 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:34.269241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bbce0-fedc-412c-9634-e71232af3716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:34.269950 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bbce0-fedc-412c-9634-e71232af3716 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:34.270235 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bbce0-fedc-412c-9634-e71232af3716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:34.270508 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bbce0-fedc-412c-9634-e71232af3716 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:34.271265 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bbce0-fedc-412c-9634-e71232af3716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:34.273472 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bbce0-fedc-412c-9634-e71232af3716 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:34.296645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1143/2273] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:36:34 2022] POST /identity/v3/users => generated 298 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:36:34.300350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9a335-ad47-4e41-a561-bb36f9c2a1df admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:34.312344 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9a335-ad47-4e41-a561-bb36f9c2a1df admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:34.323788 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bd2fa-918d-4542-824b-bac6a5e2204e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:34.323788 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bd2fa-918d-4542-824b-bac6a5e2204e admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:34.323788 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bd2fa-918d-4542-824b-bac6a5e2204e admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:34.323788 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bd2fa-918d-4542-824b-bac6a5e2204e admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:34.324128 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bd2fa-918d-4542-824b-bac6a5e2204e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:34.326176 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bd2fa-918d-4542-824b-bac6a5e2204e admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:34.338129 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1131/2274] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:36:34.342449 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bbce0-fedc-412c-9634-e71232af3716 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:34.357328 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bbce0-fedc-412c-9634-e71232af3716 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:34.369468 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668ad5e-d69d-40c7-8419-8dd408aad13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:34.370973 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668ad5e-d69d-40c7-8419-8dd408aad13b admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:34.371322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668ad5e-d69d-40c7-8419-8dd408aad13b admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:34.371559 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668ad5e-d69d-40c7-8419-8dd408aad13b admin admin] PATH_INFO: `/v3/projects/38a2d7ed10dd4ff2af66cbc601b8a0e0/users/a983fe8761e34ebc99bade37b18fb5f0/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:34.401400 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668ad5e-d69d-40c7-8419-8dd408aad13b admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a2d7ed10dd4ff2af66cbc601b8a0e0, user_id=a983fe8761e34ebc99bade37b18fb5f0, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:34.404205 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668ad5e-d69d-40c7-8419-8dd408aad13b admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:34.423715 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1144/2275] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:36:34 2022] PUT /identity/v3/projects/38a2d7ed10dd4ff2af66cbc601b8a0e0/users/a983fe8761e34ebc99bade37b18fb5f0/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:36:34.425440 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bd2fa-918d-4542-824b-bac6a5e2204e admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:34.445505 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bd2fa-918d-4542-824b-bac6a5e2204e admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:34.524724 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb952575-e0ef-448f-8dec-8abce45dbda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:34.525525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb952575-e0ef-448f-8dec-8abce45dbda6 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:34.525875 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb952575-e0ef-448f-8dec-8abce45dbda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:34.526221 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb952575-e0ef-448f-8dec-8abce45dbda6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:34.527027 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb952575-e0ef-448f-8dec-8abce45dbda6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:34.528758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb952575-e0ef-448f-8dec-8abce45dbda6 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:34.539738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1132/2276] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:36:34.543865 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668ad5e-d69d-40c7-8419-8dd408aad13b admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:34.554523 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668ad5e-d69d-40c7-8419-8dd408aad13b admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:34.559344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465e951-87cd-4ca0-b98c-ac502e4cf90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:34.560225 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465e951-87cd-4ca0-b98c-ac502e4cf90e admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:34.560500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465e951-87cd-4ca0-b98c-ac502e4cf90e admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:34.560811 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465e951-87cd-4ca0-b98c-ac502e4cf90e admin admin] PATH_INFO: `/v3/projects/38a2d7ed10dd4ff2af66cbc601b8a0e0/users/a983fe8761e34ebc99bade37b18fb5f0/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:34.562786 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465e951-87cd-4ca0-b98c-ac502e4cf90e admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a2d7ed10dd4ff2af66cbc601b8a0e0, user_id=a983fe8761e34ebc99bade37b18fb5f0, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:34.565535 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465e951-87cd-4ca0-b98c-ac502e4cf90e admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:34.575693 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1145/2277] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:36:34 2022] PUT /identity/v3/projects/38a2d7ed10dd4ff2af66cbc601b8a0e0/users/a983fe8761e34ebc99bade37b18fb5f0/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:36:40.227633 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894462b8-04b8-43f6-ba6e-e7a0a26fca87 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:40.228190 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894462b8-04b8-43f6-ba6e-e7a0a26fca87 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:40.228190 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894462b8-04b8-43f6-ba6e-e7a0a26fca87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:40.258417 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-894462b8-04b8-43f6-ba6e-e7a0a26fca87 None None] MFA Rules not processed for user `a983fe8761e34ebc99bade37b18fb5f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:36:40.259617 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-894462b8-04b8-43f6-ba6e-e7a0a26fca87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:40.339915 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1133/2278] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:36:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:36:40.353657 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465e951-87cd-4ca0-b98c-ac502e4cf90e admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:40.355440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-4465e951-87cd-4ca0-b98c-ac502e4cf90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:40.442164 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465e951-87cd-4ca0-b98c-ac502e4cf90e admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:40.446395 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64086d4a-61f9-46db-9381-72c864751c47 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a63ecc7210574058aad75a3114b57202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:40.447062 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64086d4a-61f9-46db-9381-72c864751c47 service glance] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:40.447340 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64086d4a-61f9-46db-9381-72c864751c47 service glance] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:40.447614 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64086d4a-61f9-46db-9381-72c864751c47 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:40.509797 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64086d4a-61f9-46db-9381-72c864751c47 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:40.511255 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64086d4a-61f9-46db-9381-72c864751c47 service glance] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:40.521374 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1146/2279] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:36:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:36:40.644350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a1d5b-8d02-485b-9ea9-8d45a097bb53 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:40.644799 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a1d5b-8d02-485b-9ea9-8d45a097bb53 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:40.645818 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a1d5b-8d02-485b-9ea9-8d45a097bb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:40.669565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-fa3a1d5b-8d02-485b-9ea9-8d45a097bb53 None None] MFA Rules not processed for user `d211582f9fc34b0e815e27db081c50c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:36:40.670909 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-fa3a1d5b-8d02-485b-9ea9-8d45a097bb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:40.739649 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1134/2280] 10.222.0.60 () {58 vars in 1009 bytes} [Fri May 6 23:36:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:36:40.766836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64086d4a-61f9-46db-9381-72c864751c47 service glance] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:40.768138 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-64086d4a-61f9-46db-9381-72c864751c47 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:40.846067 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64086d4a-61f9-46db-9381-72c864751c47 service glance] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:40.851283 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42be036-92f9-4013-8988-4a4632423902 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b3ec57aee94b87889d578e114fa0db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:40.852018 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42be036-92f9-4013-8988-4a4632423902 service swift] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:40.852294 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42be036-92f9-4013-8988-4a4632423902 service swift] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:40.852581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42be036-92f9-4013-8988-4a4632423902 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:40.861533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42be036-92f9-4013-8988-4a4632423902 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:40.863237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42be036-92f9-4013-8988-4a4632423902 service swift] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:40.872102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1147/2281] 10.222.0.60 () {60 vars in 1384 bytes} [Fri May 6 23:36:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 06 23:36:45.956306 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c607dba-b48d-44a2-a3e6-4c00656d31bc None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:45.956903 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c607dba-b48d-44a2-a3e6-4c00656d31bc None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:45.956903 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c607dba-b48d-44a2-a3e6-4c00656d31bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:45.977790 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-4c607dba-b48d-44a2-a3e6-4c00656d31bc None None] MFA Rules not processed for user `d211582f9fc34b0e815e27db081c50c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:36:45.979338 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-4c607dba-b48d-44a2-a3e6-4c00656d31bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:46.007069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1135/2282] 10.222.0.60 () {58 vars in 967 bytes} [Fri May 6 23:36:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:36:46.020124 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42be036-92f9-4013-8988-4a4632423902 service swift] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:46.031582 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42be036-92f9-4013-8988-4a4632423902 service swift] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:46.038044 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905c3da-7046-49b8-9b8b-e503e0efaf1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b3ec57aee94b87889d578e114fa0db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:46.038193 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905c3da-7046-49b8-9b8b-e503e0efaf1b service swift] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:46.038404 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905c3da-7046-49b8-9b8b-e503e0efaf1b service swift] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:46.038686 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905c3da-7046-49b8-9b8b-e503e0efaf1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:46.053883 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905c3da-7046-49b8-9b8b-e503e0efaf1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:46.055662 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905c3da-7046-49b8-9b8b-e503e0efaf1b service swift] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:46.064449 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1148/2283] 10.222.0.60 () {60 vars in 1384 bytes} [Fri May 6 23:36:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 06 23:36:51.406022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6a86b-8d25-4f35-86f9-226d6d4198cc None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:51.406519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6a86b-8d25-4f35-86f9-226d6d4198cc None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:51.406613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6a86b-8d25-4f35-86f9-226d6d4198cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:51.424040 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-23f6a86b-8d25-4f35-86f9-226d6d4198cc None None] MFA Rules not processed for user `a27d8cb56cc742cebedeb2d78fc73e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:36:51.425227 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-23f6a86b-8d25-4f35-86f9-226d6d4198cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:51.432448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1136/2284] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:36:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:36:54.483434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979408a4-46d3-4075-b069-2b7eb8e20d18 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:54.484353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979408a4-46d3-4075-b069-2b7eb8e20d18 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:54.484836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979408a4-46d3-4075-b069-2b7eb8e20d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:54.505888 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-979408a4-46d3-4075-b069-2b7eb8e20d18 None None] MFA Rules not processed for user `d211582f9fc34b0e815e27db081c50c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:36:54.507315 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-979408a4-46d3-4075-b069-2b7eb8e20d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:54.515709 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1149/2285] 10.222.0.60 () {58 vars in 1009 bytes} [Fri May 6 23:36:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:36:54.531405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6a86b-8d25-4f35-86f9-226d6d4198cc None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:54.545939 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6a86b-8d25-4f35-86f9-226d6d4198cc None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:54.552266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8503c-c444-47b1-b70e-74b52548422f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b3ec57aee94b87889d578e114fa0db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:54.553869 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8503c-c444-47b1-b70e-74b52548422f service swift] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:54.554582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8503c-c444-47b1-b70e-74b52548422f service swift] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:54.555707 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8503c-c444-47b1-b70e-74b52548422f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:54.570818 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8503c-c444-47b1-b70e-74b52548422f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:54.572652 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8503c-c444-47b1-b70e-74b52548422f service swift] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:54.585393 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1137/2286] 10.222.0.60 () {60 vars in 1384 bytes} [Fri May 6 23:36:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 06 23:36:54.600745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979408a4-46d3-4075-b069-2b7eb8e20d18 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:36:54.603056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-979408a4-46d3-4075-b069-2b7eb8e20d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:54.694057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979408a4-46d3-4075-b069-2b7eb8e20d18 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:36:54.700080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14425bfb-7d34-4664-91d9-481ec6769446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:36:54.701663 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425bfb-7d34-4664-91d9-481ec6769446 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:36:54.702258 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425bfb-7d34-4664-91d9-481ec6769446 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:36:54.702783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425bfb-7d34-4664-91d9-481ec6769446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:36:54.709577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-14425bfb-7d34-4664-91d9-481ec6769446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:36:54.874074 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14425bfb-7d34-4664-91d9-481ec6769446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:36:54.875249 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14425bfb-7d34-4664-91d9-481ec6769446 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:36:54.912349 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1150/2287] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:36:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:37:24.384161 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8503c-c444-47b1-b70e-74b52548422f service swift] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:37:24.393976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8503c-c444-47b1-b70e-74b52548422f service swift] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:37:24.398120 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034b4ca-08c4-4e2f-bb2c-136bb800b0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:37:24.398744 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034b4ca-08c4-4e2f-bb2c-136bb800b0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:37:24.399024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034b4ca-08c4-4e2f-bb2c-136bb800b0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:37:24.399297 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034b4ca-08c4-4e2f-bb2c-136bb800b0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:37:24.407988 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034b4ca-08c4-4e2f-bb2c-136bb800b0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:37:24.409437 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034b4ca-08c4-4e2f-bb2c-136bb800b0e2 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:37:24.420997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1138/2288] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:37:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:37:31.479392 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdb2c6-cc89-4fc0-b8b0-2b68ffe47a72 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:37:31.479937 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdb2c6-cc89-4fc0-b8b0-2b68ffe47a72 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:37:31.479937 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdb2c6-cc89-4fc0-b8b0-2b68ffe47a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:37:31.498376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-0afdb2c6-cc89-4fc0-b8b0-2b68ffe47a72 None None] MFA Rules not processed for user `d9fff6faa4cd424fb86378738e54d6fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:37:31.499584 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-0afdb2c6-cc89-4fc0-b8b0-2b68ffe47a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:37:31.551320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1151/2289] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:37:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:37:35.485737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771bfcb-0be8-421e-b58f-0e847001eaaa None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:37:35.486288 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771bfcb-0be8-421e-b58f-0e847001eaaa None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:37:35.486379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771bfcb-0be8-421e-b58f-0e847001eaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:37:35.522510 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-f771bfcb-0be8-421e-b58f-0e847001eaaa None None] MFA Rules not processed for user `70b7101dccda45d78d379ec512eea44f`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:37:35.524341 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f771bfcb-0be8-421e-b58f-0e847001eaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:37:35.606777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1139/2290] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:37:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:37:39.588375 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146a9b7-8156-4484-a2ab-541a84d3aeaf None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:37:39.589000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146a9b7-8156-4484-a2ab-541a84d3aeaf None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:37:39.589000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146a9b7-8156-4484-a2ab-541a84d3aeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:37:39.607789 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-c146a9b7-8156-4484-a2ab-541a84d3aeaf None None] MFA Rules not processed for user `dd4e3bdb8957489b95d48c6f9bd91ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:37:39.609099 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c146a9b7-8156-4484-a2ab-541a84d3aeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:37:39.670655 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1152/2291] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:37:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:38:10.591350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badd670-1896-4f0f-b11d-9006e5ea2fd8 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:10.591881 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badd670-1896-4f0f-b11d-9006e5ea2fd8 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:10.591994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badd670-1896-4f0f-b11d-9006e5ea2fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:10.609057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-3badd670-1896-4f0f-b11d-9006e5ea2fd8 None None] MFA Rules not processed for user `f8f765f9b7104604b1ea1ec482932814`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:38:10.610236 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-3badd670-1896-4f0f-b11d-9006e5ea2fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:10.663463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1140/2292] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:38:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:38:18.211542 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146a9b7-8156-4484-a2ab-541a84d3aeaf None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:18.221041 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146a9b7-8156-4484-a2ab-541a84d3aeaf None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:18.225095 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7899d-af0d-497e-af1f-b571560c9334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:18.225981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7899d-af0d-497e-af1f-b571560c9334 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:18.226260 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7899d-af0d-497e-af1f-b571560c9334 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:18.226532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7899d-af0d-497e-af1f-b571560c9334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:18.228306 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-a6d7899d-af0d-497e-af1f-b571560c9334 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:18.296709 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7899d-af0d-497e-af1f-b571560c9334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:18.298154 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7899d-af0d-497e-af1f-b571560c9334 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:18.309469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1153/2293] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:38:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:38:19.483268 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badd670-1896-4f0f-b11d-9006e5ea2fd8 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:19.493601 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badd670-1896-4f0f-b11d-9006e5ea2fd8 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:19.497182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e14cf5-4cdc-4636-86d8-ad65618d3760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:19.497906 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e14cf5-4cdc-4636-86d8-ad65618d3760 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:19.498257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e14cf5-4cdc-4636-86d8-ad65618d3760 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:19.498537 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e14cf5-4cdc-4636-86d8-ad65618d3760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:19.500519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-71e14cf5-4cdc-4636-86d8-ad65618d3760 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:19.514005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e14cf5-4cdc-4636-86d8-ad65618d3760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:19.515434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e14cf5-4cdc-4636-86d8-ad65618d3760 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:19.527027 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1141/2294] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:38:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:38:39.437252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7899d-af0d-497e-af1f-b571560c9334 service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:39.438612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-a6d7899d-af0d-497e-af1f-b571560c9334 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:39.452600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7899d-af0d-497e-af1f-b571560c9334 service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:39.457884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579748a6-1f9d-422f-bddb-b0b747afed06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:39.458506 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579748a6-1f9d-422f-bddb-b0b747afed06 service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:39.458782 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579748a6-1f9d-422f-bddb-b0b747afed06 service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:39.459078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579748a6-1f9d-422f-bddb-b0b747afed06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:39.460785 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-579748a6-1f9d-422f-bddb-b0b747afed06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:39.470386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579748a6-1f9d-422f-bddb-b0b747afed06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:39.471935 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579748a6-1f9d-422f-bddb-b0b747afed06 service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:39.480796 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1154/2295] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:38:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:38:43.046916 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e14cf5-4cdc-4636-86d8-ad65618d3760 service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:43.058352 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e14cf5-4cdc-4636-86d8-ad65618d3760 service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:43.063782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0f6ca-1660-4736-bf4f-4fec5790b82c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:43.064413 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0f6ca-1660-4736-bf4f-4fec5790b82c service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:43.064796 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0f6ca-1660-4736-bf4f-4fec5790b82c service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:43.065074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0f6ca-1660-4736-bf4f-4fec5790b82c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:43.066805 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-28d0f6ca-1660-4736-bf4f-4fec5790b82c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:43.077153 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0f6ca-1660-4736-bf4f-4fec5790b82c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:43.078725 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0f6ca-1660-4736-bf4f-4fec5790b82c service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:43.087367 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1142/2296] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:38:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:38:43.126533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579748a6-1f9d-422f-bddb-b0b747afed06 service nova] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:43.135635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579748a6-1f9d-422f-bddb-b0b747afed06 service nova] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:43.139174 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da658a-22fb-4db0-8589-6e454e32d667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:43.139802 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da658a-22fb-4db0-8589-6e454e32d667 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:43.140081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da658a-22fb-4db0-8589-6e454e32d667 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:43.140353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da658a-22fb-4db0-8589-6e454e32d667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:43.142108 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-72da658a-22fb-4db0-8589-6e454e32d667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:43.202007 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da658a-22fb-4db0-8589-6e454e32d667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:43.203449 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da658a-22fb-4db0-8589-6e454e32d667 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:43.213622 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1155/2297] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:38:43.341125 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0f6ca-1660-4736-bf4f-4fec5790b82c service nova] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:43.343127 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-28d0f6ca-1660-4736-bf4f-4fec5790b82c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:43.421249 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0f6ca-1660-4736-bf4f-4fec5790b82c service nova] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:43.424783 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7738897-a958-47ca-9e75-bfdeba2a57ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:43.425417 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7738897-a958-47ca-9e75-bfdeba2a57ba service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:43.425695 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7738897-a958-47ca-9e75-bfdeba2a57ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:43.425967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7738897-a958-47ca-9e75-bfdeba2a57ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:43.427747 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-a7738897-a958-47ca-9e75-bfdeba2a57ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:43.438625 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7738897-a958-47ca-9e75-bfdeba2a57ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:43.440057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7738897-a958-47ca-9e75-bfdeba2a57ba service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:43.449212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1143/2298] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:38:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:38:47.180345 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da658a-22fb-4db0-8589-6e454e32d667 service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:47.187328 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-72da658a-22fb-4db0-8589-6e454e32d667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:47.199647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da658a-22fb-4db0-8589-6e454e32d667 service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:47.204244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18532d-ad22-41ea-b279-37992bb43c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:47.205168 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18532d-ad22-41ea-b279-37992bb43c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:47.205450 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18532d-ad22-41ea-b279-37992bb43c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:47.205727 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18532d-ad22-41ea-b279-37992bb43c98 admin admin] PATH_INFO: `/v3/users/70b7101dccda45d78d379ec512eea44f` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:47.206939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18532d-ad22-41ea-b279-37992bb43c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70b7101dccda45d78d379ec512eea44f)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:47.209415 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18532d-ad22-41ea-b279-37992bb43c98 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:47.261373 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2d18532d-ad22-41ea-b279-37992bb43c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70b7101dccda45d78d379ec512eea44f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:38:47.269088 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2d18532d-ad22-41ea-b279-37992bb43c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70b7101dccda45d78d379ec512eea44f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:38:47.269607 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2d18532d-ad22-41ea-b279-37992bb43c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70b7101dccda45d78d379ec512eea44f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:38:47.280240 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2d18532d-ad22-41ea-b279-37992bb43c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70b7101dccda45d78d379ec512eea44f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:38:47.281161 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2d18532d-ad22-41ea-b279-37992bb43c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70b7101dccda45d78d379ec512eea44f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:38:47.299888 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1156/2299] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:38:47 2022] DELETE /identity/v3/users/70b7101dccda45d78d379ec512eea44f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:38:47.515972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7738897-a958-47ca-9e75-bfdeba2a57ba service cinder] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:47.534504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7738897-a958-47ca-9e75-bfdeba2a57ba service cinder] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:47.603304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dbcab-1849-4ef2-9e56-86ad54a1b318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:47.604162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dbcab-1849-4ef2-9e56-86ad54a1b318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:47.604445 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dbcab-1849-4ef2-9e56-86ad54a1b318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:47.604751 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dbcab-1849-4ef2-9e56-86ad54a1b318 admin admin] PATH_INFO: `/v3/projects/0a63c8271d644833bc46ae96dc3aa954` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:47.605986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3dbcab-1849-4ef2-9e56-86ad54a1b318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a63c8271d644833bc46ae96dc3aa954)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:47.607835 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3dbcab-1849-4ef2-9e56-86ad54a1b318 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:47.653135 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8d3dbcab-1849-4ef2-9e56-86ad54a1b318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a63c8271d644833bc46ae96dc3aa954', 'request_id': 'req-8d3dbcab-1849-4ef2-9e56-86ad54a1b318'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:38:47.659212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8d3dbcab-1849-4ef2-9e56-86ad54a1b318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a63c8271d644833bc46ae96dc3aa954', 'request_id': 'req-8d3dbcab-1849-4ef2-9e56-86ad54a1b318'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:38:47.664600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8d3dbcab-1849-4ef2-9e56-86ad54a1b318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a63c8271d644833bc46ae96dc3aa954', 'request_id': 'req-8d3dbcab-1849-4ef2-9e56-86ad54a1b318'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:38:47.677912 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8d3dbcab-1849-4ef2-9e56-86ad54a1b318 admin admin] The token cache is being invalidate because project 0a63c8271d644833bc46ae96dc3aa954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:38:47.678201 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8d3dbcab-1849-4ef2-9e56-86ad54a1b318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:38:47.678868 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8d3dbcab-1849-4ef2-9e56-86ad54a1b318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:38:47.680674 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1144/2300] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:38:47 2022] DELETE /identity/v3/projects/0a63c8271d644833bc46ae96dc3aa954 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:38:47.685575 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d5e9e-035a-49f6-97b3-e1cc0a1f0b89 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:47.685934 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d5e9e-035a-49f6-97b3-e1cc0a1f0b89 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:47.686281 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d5e9e-035a-49f6-97b3-e1cc0a1f0b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:47.705678 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-c46d5e9e-035a-49f6-97b3-e1cc0a1f0b89 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:38:47.707012 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c46d5e9e-035a-49f6-97b3-e1cc0a1f0b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:47.777457 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1157/2301] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:38:47.783033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2481d0f-fe6d-4fdb-958e-0c4d629c5c94 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:47.783387 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2481d0f-fe6d-4fdb-958e-0c4d629c5c94 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:47.783727 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2481d0f-fe6d-4fdb-958e-0c4d629c5c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:47.803985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-c2481d0f-fe6d-4fdb-958e-0c4d629c5c94 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:38:47.805522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c2481d0f-fe6d-4fdb-958e-0c4d629c5c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:47.814210 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1145/2302] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:38:47.818518 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d5e9e-035a-49f6-97b3-e1cc0a1f0b89 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:47.830977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d5e9e-035a-49f6-97b3-e1cc0a1f0b89 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:47.836627 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7badb-ab6c-4097-b95b-a738791ecf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:47.837417 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7badb-ab6c-4097-b95b-a738791ecf4f admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:47.837779 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7badb-ab6c-4097-b95b-a738791ecf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:47.838125 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7badb-ab6c-4097-b95b-a738791ecf4f admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:47.839439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7badb-ab6c-4097-b95b-a738791ecf4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:38:47.839985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7badb-ab6c-4097-b95b-a738791ecf4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:47.841877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7badb-ab6c-4097-b95b-a738791ecf4f admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:47.861639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1158/2303] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:38:47.862739 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2481d0f-fe6d-4fdb-958e-0c4d629c5c94 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:47.873143 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2481d0f-fe6d-4fdb-958e-0c4d629c5c94 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:47.880238 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32565463-b631-426c-b3c6-89aed49342d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:47.880504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32565463-b631-426c-b3c6-89aed49342d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:47.880822 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32565463-b631-426c-b3c6-89aed49342d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:47.881181 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32565463-b631-426c-b3c6-89aed49342d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:47.881928 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32565463-b631-426c-b3c6-89aed49342d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:47.885634 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32565463-b631-426c-b3c6-89aed49342d9 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:47.919908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1146/2304] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:38:47 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:38:47.923642 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7badb-ab6c-4097-b95b-a738791ecf4f admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:47.935090 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7badb-ab6c-4097-b95b-a738791ecf4f admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:48.003336 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca700c-a7ad-474d-abda-a5c4caa566ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:48.004739 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca700c-a7ad-474d-abda-a5c4caa566ae admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:48.005058 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca700c-a7ad-474d-abda-a5c4caa566ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:48.005348 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca700c-a7ad-474d-abda-a5c4caa566ae admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:48.008878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca700c-a7ad-474d-abda-a5c4caa566ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:48.008878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca700c-a7ad-474d-abda-a5c4caa566ae admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:48.036469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1159/2305] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:38:47 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:38:48.040306 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32565463-b631-426c-b3c6-89aed49342d9 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:48.065109 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32565463-b631-426c-b3c6-89aed49342d9 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:48.070921 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb3f3b-e01e-4569-ba58-34751723c5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:48.071937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb3f3b-e01e-4569-ba58-34751723c5ab admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:48.072218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb3f3b-e01e-4569-ba58-34751723c5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:48.072774 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb3f3b-e01e-4569-ba58-34751723c5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:48.073695 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb3f3b-e01e-4569-ba58-34751723c5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:48.075482 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb3f3b-e01e-4569-ba58-34751723c5ab admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:48.095701 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1147/2306] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:38:48.099203 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca700c-a7ad-474d-abda-a5c4caa566ae admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:48.110765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca700c-a7ad-474d-abda-a5c4caa566ae admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:48.118231 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa07315-95a1-4d8e-864c-80a836e5fdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:48.119149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa07315-95a1-4d8e-864c-80a836e5fdbf admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:48.119600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa07315-95a1-4d8e-864c-80a836e5fdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:48.120051 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa07315-95a1-4d8e-864c-80a836e5fdbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:48.121612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa07315-95a1-4d8e-864c-80a836e5fdbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:48.124665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa07315-95a1-4d8e-864c-80a836e5fdbf admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:48.140650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1160/2307] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:38:48.145579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb3f3b-e01e-4569-ba58-34751723c5ab admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:48.166858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb3f3b-e01e-4569-ba58-34751723c5ab admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:48.177354 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acc130-b900-4921-bcb5-14e1388f1d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:48.178308 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acc130-b900-4921-bcb5-14e1388f1d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:48.178708 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acc130-b900-4921-bcb5-14e1388f1d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:48.179057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acc130-b900-4921-bcb5-14e1388f1d6a admin admin] PATH_INFO: `/v3/projects/e4d2308c0d774f2cb92643c238cd0862/users/7e7a8b1ca32b401b9b49b5213cd9fe7a/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:48.204093 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27acc130-b900-4921-bcb5-14e1388f1d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d2308c0d774f2cb92643c238cd0862, user_id=7e7a8b1ca32b401b9b49b5213cd9fe7a, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:48.207133 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27acc130-b900-4921-bcb5-14e1388f1d6a admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:48.226829 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1148/2308] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:38:48 2022] PUT /identity/v3/projects/e4d2308c0d774f2cb92643c238cd0862/users/7e7a8b1ca32b401b9b49b5213cd9fe7a/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:38:48.236688 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00b004-c75a-45ca-9992-b60b2483dd63 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:48.237134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00b004-c75a-45ca-9992-b60b2483dd63 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:48.237238 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00b004-c75a-45ca-9992-b60b2483dd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:48.268943 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-fb00b004-c75a-45ca-9992-b60b2483dd63 None None] MFA Rules not processed for user `7e7a8b1ca32b401b9b49b5213cd9fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:38:48.270959 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-fb00b004-c75a-45ca-9992-b60b2483dd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:48.341040 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1161/2309] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:38:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:38:48.351679 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acc130-b900-4921-bcb5-14e1388f1d6a admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:48.353801 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-27acc130-b900-4921-bcb5-14e1388f1d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:48.432210 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acc130-b900-4921-bcb5-14e1388f1d6a admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:48.437797 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595ee7e-b40b-4e6b-8290-cd9c26dcb998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:48.438661 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595ee7e-b40b-4e6b-8290-cd9c26dcb998 service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:48.438943 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595ee7e-b40b-4e6b-8290-cd9c26dcb998 service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:48.439221 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595ee7e-b40b-4e6b-8290-cd9c26dcb998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:48.451507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595ee7e-b40b-4e6b-8290-cd9c26dcb998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:48.453313 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595ee7e-b40b-4e6b-8290-cd9c26dcb998 service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:48.464708 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1149/2310] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:38:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:38:50.203847 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290df68-a780-469d-afd6-1eb97c3dd65d None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:50.204459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290df68-a780-469d-afd6-1eb97c3dd65d None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:50.204459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290df68-a780-469d-afd6-1eb97c3dd65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:50.223505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-4290df68-a780-469d-afd6-1eb97c3dd65d None None] MFA Rules not processed for user `d9fff6faa4cd424fb86378738e54d6fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:38:50.224746 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-4290df68-a780-469d-afd6-1eb97c3dd65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:50.281067 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1162/2311] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:38:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:38:50.641372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595ee7e-b40b-4e6b-8290-cd9c26dcb998 service nova] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:50.642885 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-5595ee7e-b40b-4e6b-8290-cd9c26dcb998 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:50.698781 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595ee7e-b40b-4e6b-8290-cd9c26dcb998 service nova] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:50.702438 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eae382-d903-49d2-9e3b-c3a6838e56ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:50.703068 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eae382-d903-49d2-9e3b-c3a6838e56ed service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:50.703346 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eae382-d903-49d2-9e3b-c3a6838e56ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:50.703618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eae382-d903-49d2-9e3b-c3a6838e56ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:50.705385 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-13eae382-d903-49d2-9e3b-c3a6838e56ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:50.715325 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eae382-d903-49d2-9e3b-c3a6838e56ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:50.716763 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eae382-d903-49d2-9e3b-c3a6838e56ed service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:50.724670 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1150/2312] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:38:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:38:51.031655 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290df68-a780-469d-afd6-1eb97c3dd65d None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:51.033208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-4290df68-a780-469d-afd6-1eb97c3dd65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:51.101411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290df68-a780-469d-afd6-1eb97c3dd65d None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:51.106330 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff22732-3d29-4088-86e3-470a9f6c450f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1f7704fb5644688b8764bb1ce15734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:51.107084 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff22732-3d29-4088-86e3-470a9f6c450f service placement] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:51.107463 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff22732-3d29-4088-86e3-470a9f6c450f service placement] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:51.107801 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff22732-3d29-4088-86e3-470a9f6c450f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:51.109700 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-dff22732-3d29-4088-86e3-470a9f6c450f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:51.122785 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff22732-3d29-4088-86e3-470a9f6c450f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:51.124853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff22732-3d29-4088-86e3-470a9f6c450f service placement] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:51.135138 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1163/2313] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:38:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:38:51.146048 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eae382-d903-49d2-9e3b-c3a6838e56ed service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:51.218164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eae382-d903-49d2-9e3b-c3a6838e56ed service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:51.223672 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532cb5e-3088-4cf8-9732-1bfe9b3795e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:51.224580 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532cb5e-3088-4cf8-9732-1bfe9b3795e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:51.224853 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532cb5e-3088-4cf8-9732-1bfe9b3795e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:51.225124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532cb5e-3088-4cf8-9732-1bfe9b3795e7 admin admin] PATH_INFO: `/v3/users/7e7a8b1ca32b401b9b49b5213cd9fe7a` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:51.226739 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532cb5e-3088-4cf8-9732-1bfe9b3795e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e7a8b1ca32b401b9b49b5213cd9fe7a)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:51.228735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532cb5e-3088-4cf8-9732-1bfe9b3795e7 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:51.279473 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2532cb5e-3088-4cf8-9732-1bfe9b3795e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e7a8b1ca32b401b9b49b5213cd9fe7a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:38:51.287208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2532cb5e-3088-4cf8-9732-1bfe9b3795e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e7a8b1ca32b401b9b49b5213cd9fe7a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:38:51.294882 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2532cb5e-3088-4cf8-9732-1bfe9b3795e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e7a8b1ca32b401b9b49b5213cd9fe7a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:38:51.295512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2532cb5e-3088-4cf8-9732-1bfe9b3795e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e7a8b1ca32b401b9b49b5213cd9fe7a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:38:51.296172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2532cb5e-3088-4cf8-9732-1bfe9b3795e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e7a8b1ca32b401b9b49b5213cd9fe7a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:38:51.313881 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1151/2314] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:38:51 2022] DELETE /identity/v3/users/7e7a8b1ca32b401b9b49b5213cd9fe7a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:38:51.319196 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a64a6f-e743-4b19-9d8f-1f5f00861b40 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:51.319673 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a64a6f-e743-4b19-9d8f-1f5f00861b40 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:51.319901 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a64a6f-e743-4b19-9d8f-1f5f00861b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:51.339195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-00a64a6f-e743-4b19-9d8f-1f5f00861b40 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:38:51.341052 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-00a64a6f-e743-4b19-9d8f-1f5f00861b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:51.401268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1164/2315] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:38:51.410839 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532cb5e-3088-4cf8-9732-1bfe9b3795e7 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:51.412230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-2532cb5e-3088-4cf8-9732-1bfe9b3795e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:51.476805 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532cb5e-3088-4cf8-9732-1bfe9b3795e7 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:51.481475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e419b-b582-4d83-819b-332b7903980a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:51.482120 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e419b-b582-4d83-819b-332b7903980a service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:51.482398 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e419b-b582-4d83-819b-332b7903980a service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:51.482668 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e419b-b582-4d83-819b-332b7903980a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:51.494112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e419b-b582-4d83-819b-332b7903980a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:51.495542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e419b-b582-4d83-819b-332b7903980a service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:51.507322 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1152/2316] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:38:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:38:51.859703 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a64a6f-e743-4b19-9d8f-1f5f00861b40 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:51.867336 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-00a64a6f-e743-4b19-9d8f-1f5f00861b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:51.881612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a64a6f-e743-4b19-9d8f-1f5f00861b40 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:51.886210 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38a99f-1eb0-40fa-a4e9-31405a333662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:51.887065 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38a99f-1eb0-40fa-a4e9-31405a333662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:51.887346 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38a99f-1eb0-40fa-a4e9-31405a333662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:51.887612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38a99f-1eb0-40fa-a4e9-31405a333662 admin admin] PATH_INFO: `/v3/projects/e4d2308c0d774f2cb92643c238cd0862` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:51.888956 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38a99f-1eb0-40fa-a4e9-31405a333662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d2308c0d774f2cb92643c238cd0862)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:51.890866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38a99f-1eb0-40fa-a4e9-31405a333662 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:51.937312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-de38a99f-1eb0-40fa-a4e9-31405a333662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d2308c0d774f2cb92643c238cd0862', 'request_id': 'req-de38a99f-1eb0-40fa-a4e9-31405a333662'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:38:51.943252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-de38a99f-1eb0-40fa-a4e9-31405a333662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d2308c0d774f2cb92643c238cd0862', 'request_id': 'req-de38a99f-1eb0-40fa-a4e9-31405a333662'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:38:51.948488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-de38a99f-1eb0-40fa-a4e9-31405a333662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d2308c0d774f2cb92643c238cd0862', 'request_id': 'req-de38a99f-1eb0-40fa-a4e9-31405a333662'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:38:51.960364 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-de38a99f-1eb0-40fa-a4e9-31405a333662 admin admin] The token cache is being invalidate because project e4d2308c0d774f2cb92643c238cd0862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:38:51.960680 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-de38a99f-1eb0-40fa-a4e9-31405a333662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:38:51.961300 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-de38a99f-1eb0-40fa-a4e9-31405a333662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:38:51.962865 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1165/2317] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:38:51 2022] DELETE /identity/v3/projects/e4d2308c0d774f2cb92643c238cd0862 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:38:51.967741 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a6dcc-d14f-4901-8286-4c7c4554519e None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:51.968210 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a6dcc-d14f-4901-8286-4c7c4554519e None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:51.968306 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a6dcc-d14f-4901-8286-4c7c4554519e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:51.986583 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-b81a6dcc-d14f-4901-8286-4c7c4554519e None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:38:51.987786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-b81a6dcc-d14f-4901-8286-4c7c4554519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:52.047805 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1153/2318] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:38:52.057094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64e044-ee5e-4523-b966-32689d54bece None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:52.057383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64e044-ee5e-4523-b966-32689d54bece None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:52.057664 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64e044-ee5e-4523-b966-32689d54bece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:52.076370 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-df64e044-ee5e-4523-b966-32689d54bece None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:38:52.077591 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-df64e044-ee5e-4523-b966-32689d54bece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:52.085912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1166/2319] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:38:52.089753 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a6dcc-d14f-4901-8286-4c7c4554519e None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:52.099612 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a6dcc-d14f-4901-8286-4c7c4554519e None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:52.104625 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9bbcd-2bb6-48f0-a59e-7e58368d6954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:52.106104 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9bbcd-2bb6-48f0-a59e-7e58368d6954 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:52.106487 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9bbcd-2bb6-48f0-a59e-7e58368d6954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:52.106891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9bbcd-2bb6-48f0-a59e-7e58368d6954 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:52.107705 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9bbcd-2bb6-48f0-a59e-7e58368d6954 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:38:52.108089 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9bbcd-2bb6-48f0-a59e-7e58368d6954 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:52.109839 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9bbcd-2bb6-48f0-a59e-7e58368d6954 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:52.126421 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1154/2320] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:38:52.130905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64e044-ee5e-4523-b966-32689d54bece None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:52.140626 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64e044-ee5e-4523-b966-32689d54bece None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:52.145648 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355805c7-c2ed-4a41-b674-597dcef7e118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:52.146522 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355805c7-c2ed-4a41-b674-597dcef7e118 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:52.146804 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355805c7-c2ed-4a41-b674-597dcef7e118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:52.147082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355805c7-c2ed-4a41-b674-597dcef7e118 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:52.147802 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355805c7-c2ed-4a41-b674-597dcef7e118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:52.149936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355805c7-c2ed-4a41-b674-597dcef7e118 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:52.184617 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1167/2321] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:38:52 2022] POST /identity/v3/projects => generated 357 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:38:52.190224 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9bbcd-2bb6-48f0-a59e-7e58368d6954 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:52.205032 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9bbcd-2bb6-48f0-a59e-7e58368d6954 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:52.281928 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b534c-8b57-49d3-b8e5-9e2e665c039f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:52.282598 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b534c-8b57-49d3-b8e5-9e2e665c039f admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:52.282875 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b534c-8b57-49d3-b8e5-9e2e665c039f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:52.283149 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b534c-8b57-49d3-b8e5-9e2e665c039f admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:52.283840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b534c-8b57-49d3-b8e5-9e2e665c039f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:52.286882 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b534c-8b57-49d3-b8e5-9e2e665c039f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:52.312521 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1155/2322] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:38:52 2022] POST /identity/v3/users => generated 279 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:38:52.313835 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355805c7-c2ed-4a41-b674-597dcef7e118 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:52.324817 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355805c7-c2ed-4a41-b674-597dcef7e118 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:52.329526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477f83f-3b87-4151-96cb-89305e5ffde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:52.330261 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477f83f-3b87-4151-96cb-89305e5ffde3 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:52.330628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477f83f-3b87-4151-96cb-89305e5ffde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:52.330913 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477f83f-3b87-4151-96cb-89305e5ffde3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:52.331647 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477f83f-3b87-4151-96cb-89305e5ffde3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:52.333870 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477f83f-3b87-4151-96cb-89305e5ffde3 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:52.345410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1168/2323] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:38:52.350226 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b534c-8b57-49d3-b8e5-9e2e665c039f admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:52.360865 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b534c-8b57-49d3-b8e5-9e2e665c039f admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:52.365562 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024401fe-8d5d-4306-ba38-8554f1464306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:52.366197 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024401fe-8d5d-4306-ba38-8554f1464306 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:52.366473 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024401fe-8d5d-4306-ba38-8554f1464306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:52.366743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024401fe-8d5d-4306-ba38-8554f1464306 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:52.367451 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024401fe-8d5d-4306-ba38-8554f1464306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:52.369071 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024401fe-8d5d-4306-ba38-8554f1464306 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:52.379221 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1156/2324] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:38:52.383301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477f83f-3b87-4151-96cb-89305e5ffde3 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:52.393051 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477f83f-3b87-4151-96cb-89305e5ffde3 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:52.400210 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8b73a-dd1c-484c-92c7-bc53a8f7ed5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:52.401156 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8b73a-dd1c-484c-92c7-bc53a8f7ed5f admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:52.401558 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8b73a-dd1c-484c-92c7-bc53a8f7ed5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:52.401845 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8b73a-dd1c-484c-92c7-bc53a8f7ed5f admin admin] PATH_INFO: `/v3/projects/bc7443d0eb854219975b28dbec332d38/users/56c573553e664a37a5b8b4fdabd2a4c2/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:52.417263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8b73a-dd1c-484c-92c7-bc53a8f7ed5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7443d0eb854219975b28dbec332d38, user_id=56c573553e664a37a5b8b4fdabd2a4c2, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:52.419996 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8b73a-dd1c-484c-92c7-bc53a8f7ed5f admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:52.432984 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1169/2325] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:38:52 2022] PUT /identity/v3/projects/bc7443d0eb854219975b28dbec332d38/users/56c573553e664a37a5b8b4fdabd2a4c2/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:38:52.443268 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc54be-2dab-4a92-929b-18ff9179b22b None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:52.443615 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc54be-2dab-4a92-929b-18ff9179b22b None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:52.443953 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc54be-2dab-4a92-929b-18ff9179b22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:52.470249 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-24cc54be-2dab-4a92-929b-18ff9179b22b None None] MFA Rules not processed for user `56c573553e664a37a5b8b4fdabd2a4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:38:52.471529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-24cc54be-2dab-4a92-929b-18ff9179b22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:52.546307 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1157/2326] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:38:52 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:38:52.551209 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8b73a-dd1c-484c-92c7-bc53a8f7ed5f admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:52.613236 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8b73a-dd1c-484c-92c7-bc53a8f7ed5f admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:52.617886 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c0de3-880c-4297-8c92-82d15285fa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:52.618546 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c0de3-880c-4297-8c92-82d15285fa2a admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:52.618832 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c0de3-880c-4297-8c92-82d15285fa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:52.619112 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c0de3-880c-4297-8c92-82d15285fa2a admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:52.619819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c0de3-880c-4297-8c92-82d15285fa2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:52.621782 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c0de3-880c-4297-8c92-82d15285fa2a admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:52.650939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1170/2327] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:38:52 2022] POST /identity/v3/projects => generated 355 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:38:52.652500 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc54be-2dab-4a92-929b-18ff9179b22b None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:52.663125 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc54be-2dab-4a92-929b-18ff9179b22b None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:52.718395 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff01bf-90aa-45f9-9f60-5683bab063d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:52.719068 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff01bf-90aa-45f9-9f60-5683bab063d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:52.719352 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff01bf-90aa-45f9-9f60-5683bab063d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:52.719626 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff01bf-90aa-45f9-9f60-5683bab063d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:52.720312 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff01bf-90aa-45f9-9f60-5683bab063d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:52.722288 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff01bf-90aa-45f9-9f60-5683bab063d1 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:52.744571 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1158/2328] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:38:52 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:38:52.748353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c0de3-880c-4297-8c92-82d15285fa2a admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:52.758363 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c0de3-880c-4297-8c92-82d15285fa2a admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:52.763102 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619d974-60c7-4d6b-a365-3f4c43db0e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:52.763870 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619d974-60c7-4d6b-a365-3f4c43db0e45 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:52.764245 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619d974-60c7-4d6b-a365-3f4c43db0e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:52.764577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619d974-60c7-4d6b-a365-3f4c43db0e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:52.765327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619d974-60c7-4d6b-a365-3f4c43db0e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:52.766976 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619d974-60c7-4d6b-a365-3f4c43db0e45 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:52.778573 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1171/2329] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:38:52.782460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff01bf-90aa-45f9-9f60-5683bab063d1 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:52.792762 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff01bf-90aa-45f9-9f60-5683bab063d1 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:52.797599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1c123-1704-4dda-8f0f-32386e0058b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:52.798634 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1c123-1704-4dda-8f0f-32386e0058b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:52.798912 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1c123-1704-4dda-8f0f-32386e0058b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:52.799184 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1c123-1704-4dda-8f0f-32386e0058b2 admin admin] PATH_INFO: `/v3/projects/068ea65dc0ea4a5b95f3837a8bd31ba0/users/91e21c8a8791406caf3aa185b2cc1369/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:52.815751 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1c123-1704-4dda-8f0f-32386e0058b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=068ea65dc0ea4a5b95f3837a8bd31ba0, user_id=91e21c8a8791406caf3aa185b2cc1369, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:52.819621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1c123-1704-4dda-8f0f-32386e0058b2 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:52.838364 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1159/2330] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:38:52 2022] PUT /identity/v3/projects/068ea65dc0ea4a5b95f3837a8bd31ba0/users/91e21c8a8791406caf3aa185b2cc1369/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:38:52.843409 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619d974-60c7-4d6b-a365-3f4c43db0e45 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:52.854197 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619d974-60c7-4d6b-a365-3f4c43db0e45 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:52.919544 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668944b4-d3e1-4f5f-9e54-eb78c43c34c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:52.920058 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668944b4-d3e1-4f5f-9e54-eb78c43c34c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:52.920446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668944b4-d3e1-4f5f-9e54-eb78c43c34c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:52.920882 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668944b4-d3e1-4f5f-9e54-eb78c43c34c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:52.925304 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668944b4-d3e1-4f5f-9e54-eb78c43c34c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:52.928365 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668944b4-d3e1-4f5f-9e54-eb78c43c34c5 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:52.938974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1172/2331] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:38:52.943179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1c123-1704-4dda-8f0f-32386e0058b2 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:52.959394 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1c123-1704-4dda-8f0f-32386e0058b2 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:52.965134 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1d075-95a7-4312-bb28-6cf51dd68aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:52.966162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1d075-95a7-4312-bb28-6cf51dd68aac admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:52.966535 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1d075-95a7-4312-bb28-6cf51dd68aac admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:52.966901 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1d075-95a7-4312-bb28-6cf51dd68aac admin admin] PATH_INFO: `/v3/projects/068ea65dc0ea4a5b95f3837a8bd31ba0/users/91e21c8a8791406caf3aa185b2cc1369/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:52.969768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1d075-95a7-4312-bb28-6cf51dd68aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=068ea65dc0ea4a5b95f3837a8bd31ba0, user_id=91e21c8a8791406caf3aa185b2cc1369, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:52.972719 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1d075-95a7-4312-bb28-6cf51dd68aac admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:52.985040 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1160/2332] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:38:52 2022] PUT /identity/v3/projects/068ea65dc0ea4a5b95f3837a8bd31ba0/users/91e21c8a8791406caf3aa185b2cc1369/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:38:52.995572 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08470727-ae79-408e-bd13-d0c56416b977 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:52.996316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08470727-ae79-408e-bd13-d0c56416b977 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:52.996908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08470727-ae79-408e-bd13-d0c56416b977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:53.027201 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-08470727-ae79-408e-bd13-d0c56416b977 None None] MFA Rules not processed for user `91e21c8a8791406caf3aa185b2cc1369`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:38:53.028527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-08470727-ae79-408e-bd13-d0c56416b977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:53.029992 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1d075-95a7-4312-bb28-6cf51dd68aac admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:53.033476 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-03b1d075-95a7-4312-bb28-6cf51dd68aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:53.104905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1d075-95a7-4312-bb28-6cf51dd68aac admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:53.108886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119f9d9-38b3-458d-987f-bc932eb6a486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:53.109528 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119f9d9-38b3-458d-987f-bc932eb6a486 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:53.109996 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119f9d9-38b3-458d-987f-bc932eb6a486 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:53.110119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119f9d9-38b3-458d-987f-bc932eb6a486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:53.111822 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-4119f9d9-38b3-458d-987f-bc932eb6a486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:53.121621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119f9d9-38b3-458d-987f-bc932eb6a486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:53.123103 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119f9d9-38b3-458d-987f-bc932eb6a486 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:53.127770 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1173/2333] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:38:52 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:38:53.131692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1161/2334] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:38:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:38:53.139274 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08470727-ae79-408e-bd13-d0c56416b977 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:53.141285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-08470727-ae79-408e-bd13-d0c56416b977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:53.211703 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08470727-ae79-408e-bd13-d0c56416b977 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:53.221949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b292f5-a40a-4487-a194-8b90d4032530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:53.222815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b292f5-a40a-4487-a194-8b90d4032530 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:53.223085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b292f5-a40a-4487-a194-8b90d4032530 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:53.223375 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b292f5-a40a-4487-a194-8b90d4032530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:53.233264 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b292f5-a40a-4487-a194-8b90d4032530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:53.234689 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b292f5-a40a-4487-a194-8b90d4032530 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:53.252701 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1174/2335] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:38:53 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:38:53.323366 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119f9d9-38b3-458d-987f-bc932eb6a486 service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:53.332392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119f9d9-38b3-458d-987f-bc932eb6a486 service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:53.336025 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d74670-28bc-4ef9-901d-66197f405019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:53.337435 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d74670-28bc-4ef9-901d-66197f405019 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:53.337709 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d74670-28bc-4ef9-901d-66197f405019 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:53.337979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d74670-28bc-4ef9-901d-66197f405019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:53.399458 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d74670-28bc-4ef9-901d-66197f405019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:53.401155 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d74670-28bc-4ef9-901d-66197f405019 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:53.410927 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1162/2336] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:38:53 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:38:59.697522 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b292f5-a40a-4487-a194-8b90d4032530 service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:38:59.698949 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-a2b292f5-a40a-4487-a194-8b90d4032530 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:59.849205 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b292f5-a40a-4487-a194-8b90d4032530 service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:38:59.865025 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839f289-05c6-4ca3-b480-ffefa28f415b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:38:59.865738 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839f289-05c6-4ca3-b480-ffefa28f415b service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:59.866027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839f289-05c6-4ca3-b480-ffefa28f415b service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:59.866302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839f289-05c6-4ca3-b480-ffefa28f415b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:38:59.868262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-e839f289-05c6-4ca3-b480-ffefa28f415b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:38:59.890003 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839f289-05c6-4ca3-b480-ffefa28f415b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:38:59.892355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839f289-05c6-4ca3-b480-ffefa28f415b service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:38:59.906387 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1175/2337] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:38:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:38:59.979587 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ab5e9-726a-4fc1-878f-926f91795910 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:38:59.980069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ab5e9-726a-4fc1-878f-926f91795910 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:38:59.980186 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ab5e9-726a-4fc1-878f-926f91795910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:00.000148 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-7a2ab5e9-726a-4fc1-878f-926f91795910 None None] MFA Rules not processed for user `d211582f9fc34b0e815e27db081c50c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:00.001776 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-7a2ab5e9-726a-4fc1-878f-926f91795910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:00.075436 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1163/2338] 10.222.0.60 () {58 vars in 1009 bytes} [Fri May 6 23:38:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:39:00.131838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839f289-05c6-4ca3-b480-ffefa28f415b service nova] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:00.131838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-e839f289-05c6-4ca3-b480-ffefa28f415b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:00.208343 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839f289-05c6-4ca3-b480-ffefa28f415b service nova] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:00.223601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142cf03-2930-4f08-9b61-162c444aa758 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b3ec57aee94b87889d578e114fa0db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:00.224296 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142cf03-2930-4f08-9b61-162c444aa758 service swift] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:00.224981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142cf03-2930-4f08-9b61-162c444aa758 service swift] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:00.225142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142cf03-2930-4f08-9b61-162c444aa758 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:00.241134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142cf03-2930-4f08-9b61-162c444aa758 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:00.246296 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142cf03-2930-4f08-9b61-162c444aa758 service swift] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:00.258505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1176/2339] 10.222.0.60 () {60 vars in 1384 bytes} [Fri May 6 23:39:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 06 23:39:03.379113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ab5e9-726a-4fc1-878f-926f91795910 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:03.402184 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ab5e9-726a-4fc1-878f-926f91795910 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:03.438063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ecd7d-0309-4e1e-bc2d-6931c08c9f08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:03.438722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ecd7d-0309-4e1e-bc2d-6931c08c9f08 service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:03.439174 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ecd7d-0309-4e1e-bc2d-6931c08c9f08 service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:03.439714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ecd7d-0309-4e1e-bc2d-6931c08c9f08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:03.444780 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f94ecd7d-0309-4e1e-bc2d-6931c08c9f08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:03.469211 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ecd7d-0309-4e1e-bc2d-6931c08c9f08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:03.473647 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ecd7d-0309-4e1e-bc2d-6931c08c9f08 service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:03.508353 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1164/2340] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:39:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:39:04.994452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142cf03-2930-4f08-9b61-162c444aa758 service swift] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:04.995931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-4142cf03-2930-4f08-9b61-162c444aa758 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:05.028808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142cf03-2930-4f08-9b61-162c444aa758 service swift] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:05.044120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfc62e-a6bb-40e2-9c70-612c19dca8ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:05.045112 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfc62e-a6bb-40e2-9c70-612c19dca8ab service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:05.045562 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfc62e-a6bb-40e2-9c70-612c19dca8ab service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:05.045983 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfc62e-a6bb-40e2-9c70-612c19dca8ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:05.053833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-7adfc62e-a6bb-40e2-9c70-612c19dca8ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:05.099303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfc62e-a6bb-40e2-9c70-612c19dca8ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:05.101504 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfc62e-a6bb-40e2-9c70-612c19dca8ab service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:05.129720 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1177/2341] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:39:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:39:06.854924 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ecd7d-0309-4e1e-bc2d-6931c08c9f08 service nova] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:06.874506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ecd7d-0309-4e1e-bc2d-6931c08c9f08 service nova] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:06.889423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdcb00-9ae7-46dc-9627-0077def2b12b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:06.890605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdcb00-9ae7-46dc-9627-0077def2b12b service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:06.891096 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdcb00-9ae7-46dc-9627-0077def2b12b service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:06.891577 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdcb00-9ae7-46dc-9627-0077def2b12b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:06.893661 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-3efdcb00-9ae7-46dc-9627-0077def2b12b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:07.008307 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdcb00-9ae7-46dc-9627-0077def2b12b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:07.010038 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdcb00-9ae7-46dc-9627-0077def2b12b service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:07.022435 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1165/2342] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:39:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:39:09.821965 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfc62e-a6bb-40e2-9c70-612c19dca8ab service nova] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:09.972856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfc62e-a6bb-40e2-9c70-612c19dca8ab service nova] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:09.981718 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972c531-5931-4939-ad98-d911ad4b79f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:09.983068 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972c531-5931-4939-ad98-d911ad4b79f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:09.983508 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972c531-5931-4939-ad98-d911ad4b79f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:09.984055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972c531-5931-4939-ad98-d911ad4b79f5 admin admin] PATH_INFO: `/v3/users/56c573553e664a37a5b8b4fdabd2a4c2` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:09.985649 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972c531-5931-4939-ad98-d911ad4b79f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56c573553e664a37a5b8b4fdabd2a4c2)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:09.987778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972c531-5931-4939-ad98-d911ad4b79f5 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:10.048000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-5972c531-5931-4939-ad98-d911ad4b79f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56c573553e664a37a5b8b4fdabd2a4c2'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:10.056340 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-5972c531-5931-4939-ad98-d911ad4b79f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56c573553e664a37a5b8b4fdabd2a4c2'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:10.057066 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-5972c531-5931-4939-ad98-d911ad4b79f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56c573553e664a37a5b8b4fdabd2a4c2'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:10.070185 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-5972c531-5931-4939-ad98-d911ad4b79f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56c573553e664a37a5b8b4fdabd2a4c2'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:10.071063 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-5972c531-5931-4939-ad98-d911ad4b79f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56c573553e664a37a5b8b4fdabd2a4c2'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:10.099321 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1178/2343] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:39:09 2022] DELETE /identity/v3/users/56c573553e664a37a5b8b4fdabd2a4c2 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:39:10.101646 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf65c7-5d65-4bc6-8a1b-88128db2fad7 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:10.102170 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf65c7-5d65-4bc6-8a1b-88128db2fad7 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:10.102261 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf65c7-5d65-4bc6-8a1b-88128db2fad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:10.121970 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-fbdf65c7-5d65-4bc6-8a1b-88128db2fad7 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:10.123109 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-fbdf65c7-5d65-4bc6-8a1b-88128db2fad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:10.203984 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1166/2344] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:39:10.215255 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972c531-5931-4939-ad98-d911ad4b79f5 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:10.216454 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-5972c531-5931-4939-ad98-d911ad4b79f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:10.350334 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972c531-5931-4939-ad98-d911ad4b79f5 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:10.361659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379598d-0ab5-45da-b021-14ab81f52905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:10.362341 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379598d-0ab5-45da-b021-14ab81f52905 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:10.362630 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379598d-0ab5-45da-b021-14ab81f52905 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:10.363247 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379598d-0ab5-45da-b021-14ab81f52905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:10.384122 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379598d-0ab5-45da-b021-14ab81f52905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:10.395131 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379598d-0ab5-45da-b021-14ab81f52905 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:10.400295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1179/2345] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:39:10.755458 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf65c7-5d65-4bc6-8a1b-88128db2fad7 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:10.757385 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-fbdf65c7-5d65-4bc6-8a1b-88128db2fad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:10.782335 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf65c7-5d65-4bc6-8a1b-88128db2fad7 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:10.791167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4657e7-30fc-4c17-b309-cc529e65939f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:10.792187 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4657e7-30fc-4c17-b309-cc529e65939f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:10.792725 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4657e7-30fc-4c17-b309-cc529e65939f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:10.793503 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4657e7-30fc-4c17-b309-cc529e65939f admin admin] PATH_INFO: `/v3/projects/bc7443d0eb854219975b28dbec332d38` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:10.796456 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4657e7-30fc-4c17-b309-cc529e65939f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc7443d0eb854219975b28dbec332d38)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:10.798677 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4657e7-30fc-4c17-b309-cc529e65939f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:10.878490 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-9d4657e7-30fc-4c17-b309-cc529e65939f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc7443d0eb854219975b28dbec332d38', 'request_id': 'req-9d4657e7-30fc-4c17-b309-cc529e65939f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:10.884775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-9d4657e7-30fc-4c17-b309-cc529e65939f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc7443d0eb854219975b28dbec332d38', 'request_id': 'req-9d4657e7-30fc-4c17-b309-cc529e65939f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:10.890496 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-9d4657e7-30fc-4c17-b309-cc529e65939f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc7443d0eb854219975b28dbec332d38', 'request_id': 'req-9d4657e7-30fc-4c17-b309-cc529e65939f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:10.904970 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-9d4657e7-30fc-4c17-b309-cc529e65939f admin admin] The token cache is being invalidate because project bc7443d0eb854219975b28dbec332d38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:39:10.905367 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-9d4657e7-30fc-4c17-b309-cc529e65939f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:10.906046 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-9d4657e7-30fc-4c17-b309-cc529e65939f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:10.907685 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1167/2346] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:39:10 2022] DELETE /identity/v3/projects/bc7443d0eb854219975b28dbec332d38 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:39:10.912718 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379598d-0ab5-45da-b021-14ab81f52905 service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:10.924239 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379598d-0ab5-45da-b021-14ab81f52905 service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:10.982981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa9fac-4fea-43d1-83aa-9f8eb0b37329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:10.984357 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa9fac-4fea-43d1-83aa-9f8eb0b37329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:10.984694 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa9fac-4fea-43d1-83aa-9f8eb0b37329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:10.985012 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa9fac-4fea-43d1-83aa-9f8eb0b37329 admin admin] PATH_INFO: `/v3/users/91e21c8a8791406caf3aa185b2cc1369` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:10.987356 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa9fac-4fea-43d1-83aa-9f8eb0b37329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e21c8a8791406caf3aa185b2cc1369)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:10.989362 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa9fac-4fea-43d1-83aa-9f8eb0b37329 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:11.040478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-72aa9fac-4fea-43d1-83aa-9f8eb0b37329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e21c8a8791406caf3aa185b2cc1369'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:11.047584 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-72aa9fac-4fea-43d1-83aa-9f8eb0b37329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e21c8a8791406caf3aa185b2cc1369'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:11.048432 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-72aa9fac-4fea-43d1-83aa-9f8eb0b37329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e21c8a8791406caf3aa185b2cc1369'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:11.062454 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-72aa9fac-4fea-43d1-83aa-9f8eb0b37329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e21c8a8791406caf3aa185b2cc1369'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:11.063717 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-72aa9fac-4fea-43d1-83aa-9f8eb0b37329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e21c8a8791406caf3aa185b2cc1369'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:11.087596 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1180/2347] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:39:10 2022] DELETE /identity/v3/users/91e21c8a8791406caf3aa185b2cc1369 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:39:11.526971 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4657e7-30fc-4c17-b309-cc529e65939f admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:11.529005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9d4657e7-30fc-4c17-b309-cc529e65939f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:11.553154 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4657e7-30fc-4c17-b309-cc529e65939f admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:11.581121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32864a27-1a98-402e-9b84-c379f1f12b84 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:11.581409 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32864a27-1a98-402e-9b84-c379f1f12b84 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:11.581736 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32864a27-1a98-402e-9b84-c379f1f12b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:11.605529 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-32864a27-1a98-402e-9b84-c379f1f12b84 None None] MFA Rules not processed for user `a9fd4d50424a41d59ee31d65ec362058`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:11.607346 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-32864a27-1a98-402e-9b84-c379f1f12b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:11.666643 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a05fe-d431-49e1-a257-712c31e48fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:11.667516 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a05fe-d431-49e1-a257-712c31e48fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:11.667792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a05fe-d431-49e1-a257-712c31e48fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:11.668064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a05fe-d431-49e1-a257-712c31e48fd8 admin admin] PATH_INFO: `/v3/projects/068ea65dc0ea4a5b95f3837a8bd31ba0` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:11.670351 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a05fe-d431-49e1-a257-712c31e48fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=068ea65dc0ea4a5b95f3837a8bd31ba0)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:11.673423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a05fe-d431-49e1-a257-712c31e48fd8 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:11.708727 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1181/2348] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:39:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:39:11.748226 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8f5a05fe-d431-49e1-a257-712c31e48fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068ea65dc0ea4a5b95f3837a8bd31ba0', 'request_id': 'req-8f5a05fe-d431-49e1-a257-712c31e48fd8'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:11.754799 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8f5a05fe-d431-49e1-a257-712c31e48fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068ea65dc0ea4a5b95f3837a8bd31ba0', 'request_id': 'req-8f5a05fe-d431-49e1-a257-712c31e48fd8'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:11.761305 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8f5a05fe-d431-49e1-a257-712c31e48fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068ea65dc0ea4a5b95f3837a8bd31ba0', 'request_id': 'req-8f5a05fe-d431-49e1-a257-712c31e48fd8'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:11.777399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8f5a05fe-d431-49e1-a257-712c31e48fd8 admin admin] The token cache is being invalidate because project 068ea65dc0ea4a5b95f3837a8bd31ba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:39:11.777648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8f5a05fe-d431-49e1-a257-712c31e48fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:11.778498 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-8f5a05fe-d431-49e1-a257-712c31e48fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:11.780410 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1168/2349] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:39:11 2022] DELETE /identity/v3/projects/068ea65dc0ea4a5b95f3837a8bd31ba0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:39:11.786577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3af05b-79df-4778-b7fd-5bbe4c631b93 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:11.786868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3af05b-79df-4778-b7fd-5bbe4c631b93 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:11.787144 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3af05b-79df-4778-b7fd-5bbe4c631b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:11.813148 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-2a3af05b-79df-4778-b7fd-5bbe4c631b93 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:11.814377 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-2a3af05b-79df-4778-b7fd-5bbe4c631b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:11.891464 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1182/2350] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:39:11.893336 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49c329-6c29-4328-93f3-1a31c5378a95 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:11.893620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49c329-6c29-4328-93f3-1a31c5378a95 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:11.893896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49c329-6c29-4328-93f3-1a31c5378a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:11.913908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-ed49c329-6c29-4328-93f3-1a31c5378a95 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:11.915158 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-ed49c329-6c29-4328-93f3-1a31c5378a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:11.929405 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1169/2351] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:39:11.933435 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3af05b-79df-4778-b7fd-5bbe4c631b93 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:11.945166 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3af05b-79df-4778-b7fd-5bbe4c631b93 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:11.950134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67fca2-ad3e-4067-9ce7-5460e76c5685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:11.950959 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67fca2-ad3e-4067-9ce7-5460e76c5685 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:11.951462 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67fca2-ad3e-4067-9ce7-5460e76c5685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:11.951966 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67fca2-ad3e-4067-9ce7-5460e76c5685 admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:11.952731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67fca2-ad3e-4067-9ce7-5460e76c5685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:39:11.953037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67fca2-ad3e-4067-9ce7-5460e76c5685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:11.956162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67fca2-ad3e-4067-9ce7-5460e76c5685 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:11.971561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1183/2352] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:39:11.973366 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49c329-6c29-4328-93f3-1a31c5378a95 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:11.985090 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49c329-6c29-4328-93f3-1a31c5378a95 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:11.990264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67335f-6a92-4dfc-82be-935374b37a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:11.990975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67335f-6a92-4dfc-82be-935374b37a77 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:11.991786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67335f-6a92-4dfc-82be-935374b37a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:11.992065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67335f-6a92-4dfc-82be-935374b37a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:11.992795 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67335f-6a92-4dfc-82be-935374b37a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:11.994720 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67335f-6a92-4dfc-82be-935374b37a77 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:12.030887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1170/2353] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:39:11 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:39:12.035893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67fca2-ad3e-4067-9ce7-5460e76c5685 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:12.050914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67fca2-ad3e-4067-9ce7-5460e76c5685 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:12.125589 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f735ed-6a44-4006-bf46-7d778e54fd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:12.126387 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f735ed-6a44-4006-bf46-7d778e54fd76 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:12.126734 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f735ed-6a44-4006-bf46-7d778e54fd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:12.127078 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f735ed-6a44-4006-bf46-7d778e54fd76 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:12.127851 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f735ed-6a44-4006-bf46-7d778e54fd76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:12.132666 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f735ed-6a44-4006-bf46-7d778e54fd76 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:12.157922 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1184/2354] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:39:12 2022] POST /identity/v3/users => generated 284 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:39:12.162545 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67335f-6a92-4dfc-82be-935374b37a77 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:12.206282 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67335f-6a92-4dfc-82be-935374b37a77 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:12.217428 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbccb00-bfa7-4fc8-9ac0-748e87fe9fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:12.218115 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbccb00-bfa7-4fc8-9ac0-748e87fe9fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:12.218389 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbccb00-bfa7-4fc8-9ac0-748e87fe9fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:12.218664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbccb00-bfa7-4fc8-9ac0-748e87fe9fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:12.219406 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbccb00-bfa7-4fc8-9ac0-748e87fe9fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:12.221143 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbccb00-bfa7-4fc8-9ac0-748e87fe9fd0 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:12.238514 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1171/2355] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:39:12.241407 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f735ed-6a44-4006-bf46-7d778e54fd76 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:12.251848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f735ed-6a44-4006-bf46-7d778e54fd76 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:12.256747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a335e-1a19-47a3-a97c-a1ccdd894cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:12.257434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a335e-1a19-47a3-a97c-a1ccdd894cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:12.257712 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a335e-1a19-47a3-a97c-a1ccdd894cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:12.257984 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a335e-1a19-47a3-a97c-a1ccdd894cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:12.258725 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a335e-1a19-47a3-a97c-a1ccdd894cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:12.260414 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a335e-1a19-47a3-a97c-a1ccdd894cf3 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:12.282957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1185/2356] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:39:12.286533 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbccb00-bfa7-4fc8-9ac0-748e87fe9fd0 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:12.305634 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbccb00-bfa7-4fc8-9ac0-748e87fe9fd0 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:12.315894 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5912a9c-f3a2-49f3-9a8e-f4d34f6fd469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:12.318468 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5912a9c-f3a2-49f3-9a8e-f4d34f6fd469 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:12.319423 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5912a9c-f3a2-49f3-9a8e-f4d34f6fd469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:12.320174 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5912a9c-f3a2-49f3-9a8e-f4d34f6fd469 admin admin] PATH_INFO: `/v3/projects/df6487e1e6a54a3ab98d528c540e9277/users/c5156a23396e4630ad13b2463d8f998a/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:12.345470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5912a9c-f3a2-49f3-9a8e-f4d34f6fd469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6487e1e6a54a3ab98d528c540e9277, user_id=c5156a23396e4630ad13b2463d8f998a, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:12.349332 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5912a9c-f3a2-49f3-9a8e-f4d34f6fd469 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:12.366630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1172/2357] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:39:12 2022] PUT /identity/v3/projects/df6487e1e6a54a3ab98d528c540e9277/users/c5156a23396e4630ad13b2463d8f998a/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:39:12.377098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bd184-f971-402b-8686-98aec4daa765 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:12.377098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bd184-f971-402b-8686-98aec4daa765 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:12.379279 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bd184-f971-402b-8686-98aec4daa765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:12.401549 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5912a9c-f3a2-49f3-9a8e-f4d34f6fd469 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:12.405704 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-b5912a9c-f3a2-49f3-9a8e-f4d34f6fd469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:12.436931 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-462bd184-f971-402b-8686-98aec4daa765 None None] MFA Rules not processed for user `c5156a23396e4630ad13b2463d8f998a`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:12.438575 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-462bd184-f971-402b-8686-98aec4daa765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:12.516153 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5912a9c-f3a2-49f3-9a8e-f4d34f6fd469 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:12.521866 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35024251-c7bf-49a6-b939-d22649df547a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:12.522773 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35024251-c7bf-49a6-b939-d22649df547a service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:12.523209 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35024251-c7bf-49a6-b939-d22649df547a service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:12.523562 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35024251-c7bf-49a6-b939-d22649df547a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:12.525923 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-35024251-c7bf-49a6-b939-d22649df547a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:12.552389 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35024251-c7bf-49a6-b939-d22649df547a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:12.555377 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35024251-c7bf-49a6-b939-d22649df547a service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:12.580600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1173/2358] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:39:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:39:12.581581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1186/2359] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:39:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:39:12.593782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35024251-c7bf-49a6-b939-d22649df547a service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:12.696459 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35024251-c7bf-49a6-b939-d22649df547a service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:12.705577 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530228a-e685-4106-8a2f-0b95b628c4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:12.707931 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530228a-e685-4106-8a2f-0b95b628c4e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:12.708073 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530228a-e685-4106-8a2f-0b95b628c4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:12.708336 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530228a-e685-4106-8a2f-0b95b628c4e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:12.711581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530228a-e685-4106-8a2f-0b95b628c4e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:12.711581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530228a-e685-4106-8a2f-0b95b628c4e6 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:12.762954 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1174/2360] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:39:12 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:39:12.766685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bd184-f971-402b-8686-98aec4daa765 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:12.778573 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bd184-f971-402b-8686-98aec4daa765 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:12.883961 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcad2d1-a5d3-4a21-b40a-a1a8ea23ffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:12.884781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcad2d1-a5d3-4a21-b40a-a1a8ea23ffc2 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:12.885140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcad2d1-a5d3-4a21-b40a-a1a8ea23ffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:12.885492 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcad2d1-a5d3-4a21-b40a-a1a8ea23ffc2 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:12.886267 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcad2d1-a5d3-4a21-b40a-a1a8ea23ffc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:12.888382 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcad2d1-a5d3-4a21-b40a-a1a8ea23ffc2 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:12.929405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1187/2361] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:39:12 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:39:12.929746 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530228a-e685-4106-8a2f-0b95b628c4e6 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:12.951898 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530228a-e685-4106-8a2f-0b95b628c4e6 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:12.959511 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bffcf-8c7f-4d23-9273-8804fe7e5d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:12.960438 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bffcf-8c7f-4d23-9273-8804fe7e5d45 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:12.960814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bffcf-8c7f-4d23-9273-8804fe7e5d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:12.962354 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bffcf-8c7f-4d23-9273-8804fe7e5d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:12.963213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bffcf-8c7f-4d23-9273-8804fe7e5d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:12.967347 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bffcf-8c7f-4d23-9273-8804fe7e5d45 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:12.985854 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcad2d1-a5d3-4a21-b40a-a1a8ea23ffc2 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:12.993161 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1175/2362] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:39:12.998035 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcad2d1-a5d3-4a21-b40a-a1a8ea23ffc2 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:13.004899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa94f8-7d6c-4f48-99d7-180d11210713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:13.006856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa94f8-7d6c-4f48-99d7-180d11210713 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:13.007243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa94f8-7d6c-4f48-99d7-180d11210713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:13.007627 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa94f8-7d6c-4f48-99d7-180d11210713 admin admin] PATH_INFO: `/v3/projects/5745bdb41a8849fea7c7b27955a7fdc6/users/82da3f62d45149cda26ed1904e341075/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:13.028260 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa94f8-7d6c-4f48-99d7-180d11210713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5745bdb41a8849fea7c7b27955a7fdc6, user_id=82da3f62d45149cda26ed1904e341075, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:13.031080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa94f8-7d6c-4f48-99d7-180d11210713 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:13.070796 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bffcf-8c7f-4d23-9273-8804fe7e5d45 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:13.071741 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1188/2363] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:39:12 2022] PUT /identity/v3/projects/5745bdb41a8849fea7c7b27955a7fdc6/users/82da3f62d45149cda26ed1904e341075/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:39:13.085393 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bffcf-8c7f-4d23-9273-8804fe7e5d45 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:13.183813 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ffcae-d19b-4002-a21b-0e316199916b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:13.184528 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ffcae-d19b-4002-a21b-0e316199916b admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:13.184848 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ffcae-d19b-4002-a21b-0e316199916b admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:13.185289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ffcae-d19b-4002-a21b-0e316199916b admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:13.186415 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ffcae-d19b-4002-a21b-0e316199916b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:13.188146 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ffcae-d19b-4002-a21b-0e316199916b admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:13.199300 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1176/2364] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:39:13.203271 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa94f8-7d6c-4f48-99d7-180d11210713 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:13.227274 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa94f8-7d6c-4f48-99d7-180d11210713 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:13.236937 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c62b89-d2f5-4b1d-80c8-2abd443692b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:13.237921 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c62b89-d2f5-4b1d-80c8-2abd443692b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:13.238514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c62b89-d2f5-4b1d-80c8-2abd443692b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:13.238795 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c62b89-d2f5-4b1d-80c8-2abd443692b7 admin admin] PATH_INFO: `/v3/projects/5745bdb41a8849fea7c7b27955a7fdc6/users/82da3f62d45149cda26ed1904e341075/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:13.242476 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c62b89-d2f5-4b1d-80c8-2abd443692b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5745bdb41a8849fea7c7b27955a7fdc6, user_id=82da3f62d45149cda26ed1904e341075, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:13.245182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c62b89-d2f5-4b1d-80c8-2abd443692b7 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:13.264586 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1189/2365] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:39:13 2022] PUT /identity/v3/projects/5745bdb41a8849fea7c7b27955a7fdc6/users/82da3f62d45149cda26ed1904e341075/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:39:13.273945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b39fb-ea71-4c63-803c-da98cf17f34b None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:13.275189 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b39fb-ea71-4c63-803c-da98cf17f34b None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:13.275711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b39fb-ea71-4c63-803c-da98cf17f34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:13.335877 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-f52b39fb-ea71-4c63-803c-da98cf17f34b None None] MFA Rules not processed for user `82da3f62d45149cda26ed1904e341075`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:13.337315 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f52b39fb-ea71-4c63-803c-da98cf17f34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:13.475878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1177/2366] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:39:13 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:39:13.488329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c62b89-d2f5-4b1d-80c8-2abd443692b7 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:13.491902 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-52c62b89-d2f5-4b1d-80c8-2abd443692b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:13.571820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c62b89-d2f5-4b1d-80c8-2abd443692b7 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:13.575876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4aed9-bc3f-4617-8561-939efab02056 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:13.576687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4aed9-bc3f-4617-8561-939efab02056 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:13.577096 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4aed9-bc3f-4617-8561-939efab02056 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:13.577443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4aed9-bc3f-4617-8561-939efab02056 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:13.589766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4aed9-bc3f-4617-8561-939efab02056 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:13.591544 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4aed9-bc3f-4617-8561-939efab02056 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:13.604280 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1190/2367] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:39:13 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:39:13.683539 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b39fb-ea71-4c63-803c-da98cf17f34b None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:13.687691 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79154a-4ab2-48d1-808b-ebbe52cc71b4 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:13.687986 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79154a-4ab2-48d1-808b-ebbe52cc71b4 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:13.688265 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79154a-4ab2-48d1-808b-ebbe52cc71b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:13.694484 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b39fb-ea71-4c63-803c-da98cf17f34b None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:13.698340 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0a13d-8b00-4e3a-9473-d125057a5783 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:13.698986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0a13d-8b00-4e3a-9473-d125057a5783 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:13.699268 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0a13d-8b00-4e3a-9473-d125057a5783 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:13.699542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0a13d-8b00-4e3a-9473-d125057a5783 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:13.707877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-db79154a-4ab2-48d1-808b-ebbe52cc71b4 None None] MFA Rules not processed for user `d211582f9fc34b0e815e27db081c50c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:13.709191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-db79154a-4ab2-48d1-808b-ebbe52cc71b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:13.768092 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0a13d-8b00-4e3a-9473-d125057a5783 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:13.770226 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0a13d-8b00-4e3a-9473-d125057a5783 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:13.775935 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1191/2368] 10.222.0.60 () {58 vars in 967 bytes} [Fri May 6 23:39:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:39:13.779432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1178/2369] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:39:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:39:13.790367 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79154a-4ab2-48d1-808b-ebbe52cc71b4 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:13.792791 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-db79154a-4ab2-48d1-808b-ebbe52cc71b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:13.877384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79154a-4ab2-48d1-808b-ebbe52cc71b4 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:13.883676 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1b40a-8f2d-49c2-8b87-75a46bc46bb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b3ec57aee94b87889d578e114fa0db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:13.884326 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1b40a-8f2d-49c2-8b87-75a46bc46bb8 service swift] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:13.884630 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1b40a-8f2d-49c2-8b87-75a46bc46bb8 service swift] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:13.884902 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1b40a-8f2d-49c2-8b87-75a46bc46bb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:13.894188 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1b40a-8f2d-49c2-8b87-75a46bc46bb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:13.896470 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1b40a-8f2d-49c2-8b87-75a46bc46bb8 service swift] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:13.904452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1192/2370] 10.222.0.60 () {60 vars in 1384 bytes} [Fri May 6 23:39:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 06 23:39:17.345113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0a13d-8b00-4e3a-9473-d125057a5783 service cinder] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:17.409076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0a13d-8b00-4e3a-9473-d125057a5783 service cinder] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:17.413643 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfadff-7e96-4cae-bb4e-a52053a8039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:17.414510 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfadff-7e96-4cae-bb4e-a52053a8039e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:17.414790 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfadff-7e96-4cae-bb4e-a52053a8039e admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:17.415071 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfadff-7e96-4cae-bb4e-a52053a8039e admin admin] PATH_INFO: `/v3/users/c5156a23396e4630ad13b2463d8f998a` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:17.416415 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cfadff-7e96-4cae-bb4e-a52053a8039e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5156a23396e4630ad13b2463d8f998a)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:17.418546 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cfadff-7e96-4cae-bb4e-a52053a8039e admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:17.471935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-f8cfadff-7e96-4cae-bb4e-a52053a8039e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5156a23396e4630ad13b2463d8f998a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:17.479307 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-f8cfadff-7e96-4cae-bb4e-a52053a8039e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5156a23396e4630ad13b2463d8f998a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:17.490009 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-f8cfadff-7e96-4cae-bb4e-a52053a8039e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5156a23396e4630ad13b2463d8f998a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:17.490637 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-f8cfadff-7e96-4cae-bb4e-a52053a8039e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5156a23396e4630ad13b2463d8f998a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:17.491259 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-f8cfadff-7e96-4cae-bb4e-a52053a8039e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5156a23396e4630ad13b2463d8f998a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:17.517325 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1179/2371] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:39:17 2022] DELETE /identity/v3/users/c5156a23396e4630ad13b2463d8f998a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:39:17.520273 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb4aee-ea19-4204-8e1d-bb667702ab83 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:17.520273 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb4aee-ea19-4204-8e1d-bb667702ab83 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:17.520875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb4aee-ea19-4204-8e1d-bb667702ab83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:17.544944 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-edeb4aee-ea19-4204-8e1d-bb667702ab83 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:17.547019 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-edeb4aee-ea19-4204-8e1d-bb667702ab83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:17.716357 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1193/2372] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:39:17.745451 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfadff-7e96-4cae-bb4e-a52053a8039e admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:17.748740 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f8cfadff-7e96-4cae-bb4e-a52053a8039e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:17.929981 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfadff-7e96-4cae-bb4e-a52053a8039e admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:17.947070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b3275-0082-4fc8-a767-ca872b21e39e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:17.948031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b3275-0082-4fc8-a767-ca872b21e39e service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:17.948501 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b3275-0082-4fc8-a767-ca872b21e39e service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:17.949094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b3275-0082-4fc8-a767-ca872b21e39e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:17.984350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b3275-0082-4fc8-a767-ca872b21e39e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:17.990544 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b3275-0082-4fc8-a767-ca872b21e39e service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:18.018454 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1180/2373] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:39:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:39:18.857252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb4aee-ea19-4204-8e1d-bb667702ab83 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:18.859269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-edeb4aee-ea19-4204-8e1d-bb667702ab83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:18.879372 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb4aee-ea19-4204-8e1d-bb667702ab83 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:18.898125 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe32635-ac56-4e5e-9350-8a7933d8b953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:18.899161 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe32635-ac56-4e5e-9350-8a7933d8b953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:18.899635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe32635-ac56-4e5e-9350-8a7933d8b953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:18.900023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe32635-ac56-4e5e-9350-8a7933d8b953 admin admin] PATH_INFO: `/v3/projects/df6487e1e6a54a3ab98d528c540e9277` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:18.902995 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe32635-ac56-4e5e-9350-8a7933d8b953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df6487e1e6a54a3ab98d528c540e9277)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:18.905283 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe32635-ac56-4e5e-9350-8a7933d8b953 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:18.997989 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dbe32635-ac56-4e5e-9350-8a7933d8b953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df6487e1e6a54a3ab98d528c540e9277', 'request_id': 'req-dbe32635-ac56-4e5e-9350-8a7933d8b953'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:19.005483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dbe32635-ac56-4e5e-9350-8a7933d8b953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df6487e1e6a54a3ab98d528c540e9277', 'request_id': 'req-dbe32635-ac56-4e5e-9350-8a7933d8b953'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:19.011864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dbe32635-ac56-4e5e-9350-8a7933d8b953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df6487e1e6a54a3ab98d528c540e9277', 'request_id': 'req-dbe32635-ac56-4e5e-9350-8a7933d8b953'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:19.027175 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dbe32635-ac56-4e5e-9350-8a7933d8b953 admin admin] The token cache is being invalidate because project df6487e1e6a54a3ab98d528c540e9277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:39:19.027461 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dbe32635-ac56-4e5e-9350-8a7933d8b953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:19.028151 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dbe32635-ac56-4e5e-9350-8a7933d8b953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:19.030303 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1194/2374] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:39:18 2022] DELETE /identity/v3/projects/df6487e1e6a54a3ab98d528c540e9277 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:39:19.034225 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b3275-0082-4fc8-a767-ca872b21e39e service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:19.044893 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b3275-0082-4fc8-a767-ca872b21e39e service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:19.122011 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ea41b-b605-4fb8-8852-a0476eba881f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:19.123649 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ea41b-b605-4fb8-8852-a0476eba881f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:19.124143 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ea41b-b605-4fb8-8852-a0476eba881f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:19.124486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ea41b-b605-4fb8-8852-a0476eba881f admin admin] PATH_INFO: `/v3/users/82da3f62d45149cda26ed1904e341075` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:19.126387 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ea41b-b605-4fb8-8852-a0476eba881f admin admin] RBAC: Authorizing `identity:delete_user(user_id=82da3f62d45149cda26ed1904e341075)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:19.130129 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ea41b-b605-4fb8-8852-a0476eba881f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:19.198685 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-312ea41b-b605-4fb8-8852-a0476eba881f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82da3f62d45149cda26ed1904e341075'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:19.207066 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-312ea41b-b605-4fb8-8852-a0476eba881f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82da3f62d45149cda26ed1904e341075'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:19.216413 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-312ea41b-b605-4fb8-8852-a0476eba881f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82da3f62d45149cda26ed1904e341075'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:19.217093 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-312ea41b-b605-4fb8-8852-a0476eba881f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82da3f62d45149cda26ed1904e341075'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:19.217775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-312ea41b-b605-4fb8-8852-a0476eba881f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82da3f62d45149cda26ed1904e341075'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:19.241048 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1181/2375] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:39:19 2022] DELETE /identity/v3/users/82da3f62d45149cda26ed1904e341075 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:39:19.995841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe32635-ac56-4e5e-9350-8a7933d8b953 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:19.997392 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-dbe32635-ac56-4e5e-9350-8a7933d8b953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:20.040751 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe32635-ac56-4e5e-9350-8a7933d8b953 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:20.126803 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d1f71-ece1-43d8-a308-18120f962cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:20.129990 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d1f71-ece1-43d8-a308-18120f962cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:20.130438 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d1f71-ece1-43d8-a308-18120f962cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:20.130872 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d1f71-ece1-43d8-a308-18120f962cc7 admin admin] PATH_INFO: `/v3/projects/5745bdb41a8849fea7c7b27955a7fdc6` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:20.132833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d1f71-ece1-43d8-a308-18120f962cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5745bdb41a8849fea7c7b27955a7fdc6)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:20.135089 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d1f71-ece1-43d8-a308-18120f962cc7 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:20.198654 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-4e4d1f71-ece1-43d8-a308-18120f962cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5745bdb41a8849fea7c7b27955a7fdc6', 'request_id': 'req-4e4d1f71-ece1-43d8-a308-18120f962cc7'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:20.207784 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-4e4d1f71-ece1-43d8-a308-18120f962cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5745bdb41a8849fea7c7b27955a7fdc6', 'request_id': 'req-4e4d1f71-ece1-43d8-a308-18120f962cc7'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:20.214996 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-4e4d1f71-ece1-43d8-a308-18120f962cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5745bdb41a8849fea7c7b27955a7fdc6', 'request_id': 'req-4e4d1f71-ece1-43d8-a308-18120f962cc7'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:20.250387 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-4e4d1f71-ece1-43d8-a308-18120f962cc7 admin admin] The token cache is being invalidate because project 5745bdb41a8849fea7c7b27955a7fdc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:39:20.250702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-4e4d1f71-ece1-43d8-a308-18120f962cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:20.251736 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-4e4d1f71-ece1-43d8-a308-18120f962cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:20.254660 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1195/2376] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:39:19 2022] DELETE /identity/v3/projects/5745bdb41a8849fea7c7b27955a7fdc6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:39:20.261474 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a46e9b-9e20-467e-b234-122710cfc390 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:20.262210 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a46e9b-9e20-467e-b234-122710cfc390 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:20.263093 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a46e9b-9e20-467e-b234-122710cfc390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:20.299015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-25a46e9b-9e20-467e-b234-122710cfc390 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:20.301126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-25a46e9b-9e20-467e-b234-122710cfc390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:20.370232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1182/2377] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:39:20.377941 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398a1f2-1b0d-4099-8ca5-b4c72514783a None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:20.378234 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398a1f2-1b0d-4099-8ca5-b4c72514783a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:20.378531 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398a1f2-1b0d-4099-8ca5-b4c72514783a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:20.420353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-2398a1f2-1b0d-4099-8ca5-b4c72514783a None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:20.421589 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-2398a1f2-1b0d-4099-8ca5-b4c72514783a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:20.433361 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1196/2378] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:39:20.437699 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a46e9b-9e20-467e-b234-122710cfc390 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:20.450899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a46e9b-9e20-467e-b234-122710cfc390 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:20.460702 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44ca76-d099-4573-a282-2412d05194b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:20.461993 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44ca76-d099-4573-a282-2412d05194b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:20.462424 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44ca76-d099-4573-a282-2412d05194b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:20.462858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44ca76-d099-4573-a282-2412d05194b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:20.464358 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44ca76-d099-4573-a282-2412d05194b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:39:20.468353 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44ca76-d099-4573-a282-2412d05194b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:20.470239 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44ca76-d099-4573-a282-2412d05194b0 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:20.505025 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398a1f2-1b0d-4099-8ca5-b4c72514783a None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:20.516961 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398a1f2-1b0d-4099-8ca5-b4c72514783a None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:20.522236 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1183/2379] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:39:20.529247 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d0354-725a-4dd4-8913-c6b6696b2a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:20.530652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d0354-725a-4dd4-8913-c6b6696b2a04 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:20.530935 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d0354-725a-4dd4-8913-c6b6696b2a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:20.531208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d0354-725a-4dd4-8913-c6b6696b2a04 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:20.531925 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d0354-725a-4dd4-8913-c6b6696b2a04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:20.533977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d0354-725a-4dd4-8913-c6b6696b2a04 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:20.577052 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44ca76-d099-4573-a282-2412d05194b0 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:20.583355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1197/2380] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:39:20 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:39:20.606398 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44ca76-d099-4573-a282-2412d05194b0 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:20.793032 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0c82c-71d0-4d8b-a745-73bc532646c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:20.793821 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0c82c-71d0-4d8b-a745-73bc532646c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:20.794161 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0c82c-71d0-4d8b-a745-73bc532646c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:20.794644 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0c82c-71d0-4d8b-a745-73bc532646c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:20.795437 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0c82c-71d0-4d8b-a745-73bc532646c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:20.797613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0c82c-71d0-4d8b-a745-73bc532646c6 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:20.828487 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1184/2381] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:39:20 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:39:20.829570 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d0354-725a-4dd4-8913-c6b6696b2a04 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:20.848620 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d0354-725a-4dd4-8913-c6b6696b2a04 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:20.854149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f46232-48b5-4071-af76-7ba83d5b4d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:20.855265 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f46232-48b5-4071-af76-7ba83d5b4d23 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:20.855548 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f46232-48b5-4071-af76-7ba83d5b4d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:20.855835 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f46232-48b5-4071-af76-7ba83d5b4d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:20.856579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f46232-48b5-4071-af76-7ba83d5b4d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:20.858557 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f46232-48b5-4071-af76-7ba83d5b4d23 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:20.884125 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0c82c-71d0-4d8b-a745-73bc532646c6 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:20.908419 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0c82c-71d0-4d8b-a745-73bc532646c6 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:20.909283 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1198/2382] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:39:20.921638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950cbac-0298-4cb5-acc4-ce77b71d7fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:20.922314 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950cbac-0298-4cb5-acc4-ce77b71d7fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:20.922592 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950cbac-0298-4cb5-acc4-ce77b71d7fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:20.922864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950cbac-0298-4cb5-acc4-ce77b71d7fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:20.924006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950cbac-0298-4cb5-acc4-ce77b71d7fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:20.925817 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950cbac-0298-4cb5-acc4-ce77b71d7fd9 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:20.940821 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1185/2383] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:39:20.945731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f46232-48b5-4071-af76-7ba83d5b4d23 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:20.957916 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f46232-48b5-4071-af76-7ba83d5b4d23 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:20.972255 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942e2be-2b9d-4169-8e2f-2104fcdda008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:20.973169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942e2be-2b9d-4169-8e2f-2104fcdda008 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:20.973435 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942e2be-2b9d-4169-8e2f-2104fcdda008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:20.973668 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942e2be-2b9d-4169-8e2f-2104fcdda008 admin admin] PATH_INFO: `/v3/projects/1c265dd1c10042a08e7f9cbcf093b73a/users/77c65439df9e46f2a5632e6006233b50/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:20.993353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942e2be-2b9d-4169-8e2f-2104fcdda008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c265dd1c10042a08e7f9cbcf093b73a, user_id=77c65439df9e46f2a5632e6006233b50, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:20.996039 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942e2be-2b9d-4169-8e2f-2104fcdda008 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:21.028626 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1199/2384] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:39:20 2022] PUT /identity/v3/projects/1c265dd1c10042a08e7f9cbcf093b73a/users/77c65439df9e46f2a5632e6006233b50/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:39:21.030720 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29814351-b2e6-4bef-8df9-ab37decc9966 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:21.030992 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29814351-b2e6-4bef-8df9-ab37decc9966 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:21.031269 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29814351-b2e6-4bef-8df9-ab37decc9966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:21.076316 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-29814351-b2e6-4bef-8df9-ab37decc9966 None None] MFA Rules not processed for user `77c65439df9e46f2a5632e6006233b50`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:21.078315 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-29814351-b2e6-4bef-8df9-ab37decc9966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:21.168753 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1186/2385] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:39:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:39:21.183310 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942e2be-2b9d-4169-8e2f-2104fcdda008 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:21.183310 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-7942e2be-2b9d-4169-8e2f-2104fcdda008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:21.248912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942e2be-2b9d-4169-8e2f-2104fcdda008 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:21.252972 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa1673-4443-4b23-b9f4-4e805ac2f33f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:21.253669 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1673-4443-4b23-b9f4-4e805ac2f33f service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:21.253951 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1673-4443-4b23-b9f4-4e805ac2f33f service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:21.254227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1673-4443-4b23-b9f4-4e805ac2f33f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:21.264729 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa1673-4443-4b23-b9f4-4e805ac2f33f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:21.266334 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa1673-4443-4b23-b9f4-4e805ac2f33f service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:21.276127 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1200/2386] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:39:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:39:21.295948 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29814351-b2e6-4bef-8df9-ab37decc9966 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:21.381817 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29814351-b2e6-4bef-8df9-ab37decc9966 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:21.392008 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67995449-d759-4f55-901b-34a2479dda65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:21.393243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67995449-d759-4f55-901b-34a2479dda65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:21.393727 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67995449-d759-4f55-901b-34a2479dda65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:21.394249 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67995449-d759-4f55-901b-34a2479dda65 admin admin] PATH_INFO: `/v3/users/77c65439df9e46f2a5632e6006233b50` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:21.395698 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67995449-d759-4f55-901b-34a2479dda65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77c65439df9e46f2a5632e6006233b50)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:21.398165 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67995449-d759-4f55-901b-34a2479dda65 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:21.459446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-67995449-d759-4f55-901b-34a2479dda65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77c65439df9e46f2a5632e6006233b50'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:21.466406 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-67995449-d759-4f55-901b-34a2479dda65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77c65439df9e46f2a5632e6006233b50'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:21.474759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-67995449-d759-4f55-901b-34a2479dda65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77c65439df9e46f2a5632e6006233b50'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:21.475641 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-67995449-d759-4f55-901b-34a2479dda65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77c65439df9e46f2a5632e6006233b50'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:21.475977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-67995449-d759-4f55-901b-34a2479dda65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77c65439df9e46f2a5632e6006233b50'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:21.493538 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1187/2387] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:39:21 2022] DELETE /identity/v3/users/77c65439df9e46f2a5632e6006233b50 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:39:21.497829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8a7c7-1f55-4439-87bd-49d7e4807382 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:21.498122 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8a7c7-1f55-4439-87bd-49d7e4807382 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:21.498405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8a7c7-1f55-4439-87bd-49d7e4807382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:21.516360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-6ab8a7c7-1f55-4439-87bd-49d7e4807382 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:21.517506 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-6ab8a7c7-1f55-4439-87bd-49d7e4807382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:21.584582 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1201/2388] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:39:21.596762 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67995449-d759-4f55-901b-34a2479dda65 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:21.598824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-67995449-d759-4f55-901b-34a2479dda65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:21.655629 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67995449-d759-4f55-901b-34a2479dda65 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:21.659250 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409edcd4-e6c8-4524-bf96-b1609677b4e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:21.660476 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409edcd4-e6c8-4524-bf96-b1609677b4e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:21.660776 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409edcd4-e6c8-4524-bf96-b1609677b4e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:21.661046 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409edcd4-e6c8-4524-bf96-b1609677b4e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:21.670039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409edcd4-e6c8-4524-bf96-b1609677b4e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:21.671544 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409edcd4-e6c8-4524-bf96-b1609677b4e1 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:21.680982 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1188/2389] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:39:22.324486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8a7c7-1f55-4439-87bd-49d7e4807382 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:22.326833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-6ab8a7c7-1f55-4439-87bd-49d7e4807382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:22.343279 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8a7c7-1f55-4439-87bd-49d7e4807382 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:22.350449 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29c635-031b-46e9-b34a-e349e6039aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:22.351694 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29c635-031b-46e9-b34a-e349e6039aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:22.352165 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29c635-031b-46e9-b34a-e349e6039aed admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:22.352553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29c635-031b-46e9-b34a-e349e6039aed admin admin] PATH_INFO: `/v3/projects/1c265dd1c10042a08e7f9cbcf093b73a` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:22.354280 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29c635-031b-46e9-b34a-e349e6039aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c265dd1c10042a08e7f9cbcf093b73a)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:22.356503 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29c635-031b-46e9-b34a-e349e6039aed admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:22.444714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-9d29c635-031b-46e9-b34a-e349e6039aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c265dd1c10042a08e7f9cbcf093b73a', 'request_id': 'req-9d29c635-031b-46e9-b34a-e349e6039aed'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:22.453211 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-9d29c635-031b-46e9-b34a-e349e6039aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c265dd1c10042a08e7f9cbcf093b73a', 'request_id': 'req-9d29c635-031b-46e9-b34a-e349e6039aed'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:22.476760 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-9d29c635-031b-46e9-b34a-e349e6039aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c265dd1c10042a08e7f9cbcf093b73a', 'request_id': 'req-9d29c635-031b-46e9-b34a-e349e6039aed'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:22.497830 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-9d29c635-031b-46e9-b34a-e349e6039aed admin admin] The token cache is being invalidate because project 1c265dd1c10042a08e7f9cbcf093b73a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:39:22.498384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-9d29c635-031b-46e9-b34a-e349e6039aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:22.499329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-9d29c635-031b-46e9-b34a-e349e6039aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:22.501248 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1202/2390] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:39:22 2022] DELETE /identity/v3/projects/1c265dd1c10042a08e7f9cbcf093b73a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:39:22.506087 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8584d37-1f9c-418f-afeb-c00e4dc1e728 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:22.506554 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8584d37-1f9c-418f-afeb-c00e4dc1e728 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:22.506638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8584d37-1f9c-418f-afeb-c00e4dc1e728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:22.527025 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-d8584d37-1f9c-418f-afeb-c00e4dc1e728 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:22.528727 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-d8584d37-1f9c-418f-afeb-c00e4dc1e728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:22.606242 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1189/2391] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:39:22.608316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca41bf0-4d7c-417d-bb95-62cbba2c2b5b None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:22.608689 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca41bf0-4d7c-417d-bb95-62cbba2c2b5b None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:22.609255 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca41bf0-4d7c-417d-bb95-62cbba2c2b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:22.633291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-1ca41bf0-4d7c-417d-bb95-62cbba2c2b5b None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:22.634778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-1ca41bf0-4d7c-417d-bb95-62cbba2c2b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:22.648165 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1203/2392] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:39:22.649418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8584d37-1f9c-418f-afeb-c00e4dc1e728 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:22.659460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8584d37-1f9c-418f-afeb-c00e4dc1e728 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:22.665434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2543c-9df7-4cba-a79e-6237a826e09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:22.666258 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2543c-9df7-4cba-a79e-6237a826e09a admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:22.666681 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2543c-9df7-4cba-a79e-6237a826e09a admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:22.667132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2543c-9df7-4cba-a79e-6237a826e09a admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:22.667979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2543c-9df7-4cba-a79e-6237a826e09a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:39:22.668386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2543c-9df7-4cba-a79e-6237a826e09a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:22.670352 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2543c-9df7-4cba-a79e-6237a826e09a admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:22.684367 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1190/2393] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:39:22.688284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca41bf0-4d7c-417d-bb95-62cbba2c2b5b None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:22.698377 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca41bf0-4d7c-417d-bb95-62cbba2c2b5b None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:22.703586 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07b56f-d062-476a-ab56-45aec8be8926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:22.704577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07b56f-d062-476a-ab56-45aec8be8926 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:22.704924 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07b56f-d062-476a-ab56-45aec8be8926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:22.705110 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07b56f-d062-476a-ab56-45aec8be8926 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:22.705907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07b56f-d062-476a-ab56-45aec8be8926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:22.708853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07b56f-d062-476a-ab56-45aec8be8926 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:22.743322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1204/2394] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:39:22 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:39:22.744686 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2543c-9df7-4cba-a79e-6237a826e09a admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:22.756269 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2543c-9df7-4cba-a79e-6237a826e09a admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:22.821550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b6e3d-a26f-4c07-8198-d9def94863c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:22.822328 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b6e3d-a26f-4c07-8198-d9def94863c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:22.822686 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b6e3d-a26f-4c07-8198-d9def94863c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:22.823447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b6e3d-a26f-4c07-8198-d9def94863c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:22.824230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b6e3d-a26f-4c07-8198-d9def94863c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:22.826176 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b6e3d-a26f-4c07-8198-d9def94863c9 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:22.859721 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1191/2395] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:39:22 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:39:22.863465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07b56f-d062-476a-ab56-45aec8be8926 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:22.876596 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07b56f-d062-476a-ab56-45aec8be8926 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:22.883555 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8409c-ff02-4446-97a5-aa4718517c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:22.884351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8409c-ff02-4446-97a5-aa4718517c5c admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:22.884809 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8409c-ff02-4446-97a5-aa4718517c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:22.885221 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8409c-ff02-4446-97a5-aa4718517c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:22.886105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8409c-ff02-4446-97a5-aa4718517c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:22.887847 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8409c-ff02-4446-97a5-aa4718517c5c admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:22.904355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1205/2396] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:39:22.905967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b6e3d-a26f-4c07-8198-d9def94863c9 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:22.921276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b6e3d-a26f-4c07-8198-d9def94863c9 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:22.929396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940f06a-1aac-4b86-bfa1-c84f0712d378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:22.930173 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940f06a-1aac-4b86-bfa1-c84f0712d378 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:22.930815 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940f06a-1aac-4b86-bfa1-c84f0712d378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:22.931288 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940f06a-1aac-4b86-bfa1-c84f0712d378 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:22.932493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940f06a-1aac-4b86-bfa1-c84f0712d378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:22.934235 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940f06a-1aac-4b86-bfa1-c84f0712d378 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:22.954273 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1192/2397] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:39:22.958584 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8409c-ff02-4446-97a5-aa4718517c5c admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:22.970677 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8409c-ff02-4446-97a5-aa4718517c5c admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:22.976514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4c58c-c736-44f5-9d49-a21ecabd1e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:22.977065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49348011-b74b-48dd-ad2d-d74355d57fa8 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:22.977560 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4c58c-c736-44f5-9d49-a21ecabd1e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:22.977787 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49348011-b74b-48dd-ad2d-d74355d57fa8 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:22.977983 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4c58c-c736-44f5-9d49-a21ecabd1e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:22.978314 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4c58c-c736-44f5-9d49-a21ecabd1e39 admin admin] PATH_INFO: `/v3/projects/227f81e03c0a4d9fb59a70b7d24f748b/users/363592b4c9f7464e94624778a9ba2c1f/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:22.978537 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49348011-b74b-48dd-ad2d-d74355d57fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:22.995614 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4c58c-c736-44f5-9d49-a21ecabd1e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=227f81e03c0a4d9fb59a70b7d24f748b, user_id=363592b4c9f7464e94624778a9ba2c1f, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:22.998722 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4c58c-c736-44f5-9d49-a21ecabd1e39 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:23.000110 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-49348011-b74b-48dd-ad2d-d74355d57fa8 None None] MFA Rules not processed for user `d211582f9fc34b0e815e27db081c50c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:23.001407 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-49348011-b74b-48dd-ad2d-d74355d57fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:23.013864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1206/2398] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:39:22 2022] PUT /identity/v3/projects/227f81e03c0a4d9fb59a70b7d24f748b/users/363592b4c9f7464e94624778a9ba2c1f/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:39:23.025133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea664ce-a23f-4294-a0ec-95ceaf45c693 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:23.025654 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea664ce-a23f-4294-a0ec-95ceaf45c693 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:23.026196 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea664ce-a23f-4294-a0ec-95ceaf45c693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:23.054398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-fea664ce-a23f-4294-a0ec-95ceaf45c693 None None] MFA Rules not processed for user `363592b4c9f7464e94624778a9ba2c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:23.055602 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-fea664ce-a23f-4294-a0ec-95ceaf45c693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:23.066698 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1193/2399] 10.222.0.60 () {58 vars in 1009 bytes} [Fri May 6 23:39:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:39:23.078939 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49348011-b74b-48dd-ad2d-d74355d57fa8 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:23.081842 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-49348011-b74b-48dd-ad2d-d74355d57fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:23.133675 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1207/2400] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:39:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:39:23.145077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea664ce-a23f-4294-a0ec-95ceaf45c693 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:23.146446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-fea664ce-a23f-4294-a0ec-95ceaf45c693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:23.159645 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49348011-b74b-48dd-ad2d-d74355d57fa8 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:23.218646 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea664ce-a23f-4294-a0ec-95ceaf45c693 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:23.224955 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85875a0a-4356-4d2c-8ce7-fb79c3294a32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:23.226428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85875a0a-4356-4d2c-8ce7-fb79c3294a32 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:23.226716 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85875a0a-4356-4d2c-8ce7-fb79c3294a32 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:23.226990 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85875a0a-4356-4d2c-8ce7-fb79c3294a32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:23.230130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5e001-2176-4506-9119-d1259a0c4086 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b3ec57aee94b87889d578e114fa0db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:23.231554 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5e001-2176-4506-9119-d1259a0c4086 service swift] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:23.231839 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5e001-2176-4506-9119-d1259a0c4086 service swift] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:23.232422 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5e001-2176-4506-9119-d1259a0c4086 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:23.243082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85875a0a-4356-4d2c-8ce7-fb79c3294a32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:23.244965 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85875a0a-4356-4d2c-8ce7-fb79c3294a32 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:23.271960 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1208/2401] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:39:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:39:23.331797 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5e001-2176-4506-9119-d1259a0c4086 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:23.335733 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5e001-2176-4506-9119-d1259a0c4086 service swift] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:23.348032 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1194/2402] 10.222.0.60 () {60 vars in 1384 bytes} [Fri May 6 23:39:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 06 23:39:24.511531 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85875a0a-4356-4d2c-8ce7-fb79c3294a32 service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:24.513390 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-85875a0a-4356-4d2c-8ce7-fb79c3294a32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:24.616454 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85875a0a-4356-4d2c-8ce7-fb79c3294a32 service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:24.621497 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41238722-4c5a-4315-acd8-3c25bf573fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:24.622230 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41238722-4c5a-4315-acd8-3c25bf573fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:24.622508 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41238722-4c5a-4315-acd8-3c25bf573fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:24.622780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41238722-4c5a-4315-acd8-3c25bf573fc6 admin admin] PATH_INFO: `/v3/users/a27d8cb56cc742cebedeb2d78fc73e2b` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:24.630122 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41238722-4c5a-4315-acd8-3c25bf573fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a27d8cb56cc742cebedeb2d78fc73e2b)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:24.632344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41238722-4c5a-4315-acd8-3c25bf573fc6 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:24.701533 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-41238722-4c5a-4315-acd8-3c25bf573fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a27d8cb56cc742cebedeb2d78fc73e2b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:24.711348 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-41238722-4c5a-4315-acd8-3c25bf573fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a27d8cb56cc742cebedeb2d78fc73e2b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:24.713013 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-41238722-4c5a-4315-acd8-3c25bf573fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a27d8cb56cc742cebedeb2d78fc73e2b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:24.727621 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-41238722-4c5a-4315-acd8-3c25bf573fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a27d8cb56cc742cebedeb2d78fc73e2b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:24.728492 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-41238722-4c5a-4315-acd8-3c25bf573fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a27d8cb56cc742cebedeb2d78fc73e2b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:24.759909 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1209/2403] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:39:24 2022] DELETE /identity/v3/users/a27d8cb56cc742cebedeb2d78fc73e2b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:39:25.027163 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5e001-2176-4506-9119-d1259a0c4086 service swift] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:25.042220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5e001-2176-4506-9119-d1259a0c4086 service swift] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:25.134171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b343b-ca8d-43e9-8b53-199aa9cf7120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:25.135041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b343b-ca8d-43e9-8b53-199aa9cf7120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:25.135348 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b343b-ca8d-43e9-8b53-199aa9cf7120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:25.135732 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b343b-ca8d-43e9-8b53-199aa9cf7120 admin admin] PATH_INFO: `/v3/projects/e945e78585194b4c8ceff8affbfe7962` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:25.137105 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b343b-ca8d-43e9-8b53-199aa9cf7120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e945e78585194b4c8ceff8affbfe7962)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:25.141585 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b343b-ca8d-43e9-8b53-199aa9cf7120 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:25.245678 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-5b6b343b-ca8d-43e9-8b53-199aa9cf7120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e945e78585194b4c8ceff8affbfe7962', 'request_id': 'req-5b6b343b-ca8d-43e9-8b53-199aa9cf7120'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:25.253820 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-5b6b343b-ca8d-43e9-8b53-199aa9cf7120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e945e78585194b4c8ceff8affbfe7962', 'request_id': 'req-5b6b343b-ca8d-43e9-8b53-199aa9cf7120'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:25.261562 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-5b6b343b-ca8d-43e9-8b53-199aa9cf7120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e945e78585194b4c8ceff8affbfe7962', 'request_id': 'req-5b6b343b-ca8d-43e9-8b53-199aa9cf7120'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:25.275206 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-5b6b343b-ca8d-43e9-8b53-199aa9cf7120 admin admin] The token cache is being invalidate because project e945e78585194b4c8ceff8affbfe7962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:39:25.275499 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-5b6b343b-ca8d-43e9-8b53-199aa9cf7120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:25.276426 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-5b6b343b-ca8d-43e9-8b53-199aa9cf7120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:25.280607 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1195/2404] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:39:25 2022] DELETE /identity/v3/projects/e945e78585194b4c8ceff8affbfe7962 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:39:25.282327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41238722-4c5a-4315-acd8-3c25bf573fc6 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:25.283766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-41238722-4c5a-4315-acd8-3c25bf573fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:25.311844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41238722-4c5a-4315-acd8-3c25bf573fc6 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:25.375419 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620fc27-4b25-4b5b-abc4-d7281ed74c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:25.376321 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620fc27-4b25-4b5b-abc4-d7281ed74c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:25.376842 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620fc27-4b25-4b5b-abc4-d7281ed74c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:25.377120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620fc27-4b25-4b5b-abc4-d7281ed74c39 admin admin] PATH_INFO: `/v3/users/a983fe8761e34ebc99bade37b18fb5f0` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:25.378700 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620fc27-4b25-4b5b-abc4-d7281ed74c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a983fe8761e34ebc99bade37b18fb5f0)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:25.380901 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620fc27-4b25-4b5b-abc4-d7281ed74c39 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:25.436164 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-e620fc27-4b25-4b5b-abc4-d7281ed74c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a983fe8761e34ebc99bade37b18fb5f0'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:25.450959 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-e620fc27-4b25-4b5b-abc4-d7281ed74c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a983fe8761e34ebc99bade37b18fb5f0'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:25.452065 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-e620fc27-4b25-4b5b-abc4-d7281ed74c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a983fe8761e34ebc99bade37b18fb5f0'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:25.460801 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-e620fc27-4b25-4b5b-abc4-d7281ed74c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a983fe8761e34ebc99bade37b18fb5f0'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:25.461406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-e620fc27-4b25-4b5b-abc4-d7281ed74c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a983fe8761e34ebc99bade37b18fb5f0'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:25.479662 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1210/2405] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:39:25 2022] DELETE /identity/v3/users/a983fe8761e34ebc99bade37b18fb5f0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:39:25.660364 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b343b-ca8d-43e9-8b53-199aa9cf7120 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:25.661951 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-5b6b343b-ca8d-43e9-8b53-199aa9cf7120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:25.694006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b343b-ca8d-43e9-8b53-199aa9cf7120 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:25.769394 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b19e02-ff5e-4de1-90f0-d2ec8c08b026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:25.770387 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b19e02-ff5e-4de1-90f0-d2ec8c08b026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:25.770760 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b19e02-ff5e-4de1-90f0-d2ec8c08b026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:25.771127 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b19e02-ff5e-4de1-90f0-d2ec8c08b026 admin admin] PATH_INFO: `/v3/projects/38a2d7ed10dd4ff2af66cbc601b8a0e0` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:25.772428 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b19e02-ff5e-4de1-90f0-d2ec8c08b026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38a2d7ed10dd4ff2af66cbc601b8a0e0)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:25.774612 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b19e02-ff5e-4de1-90f0-d2ec8c08b026 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:25.822298 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-48b19e02-ff5e-4de1-90f0-d2ec8c08b026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38a2d7ed10dd4ff2af66cbc601b8a0e0', 'request_id': 'req-48b19e02-ff5e-4de1-90f0-d2ec8c08b026'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:25.829219 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-48b19e02-ff5e-4de1-90f0-d2ec8c08b026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38a2d7ed10dd4ff2af66cbc601b8a0e0', 'request_id': 'req-48b19e02-ff5e-4de1-90f0-d2ec8c08b026'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:25.838296 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-48b19e02-ff5e-4de1-90f0-d2ec8c08b026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38a2d7ed10dd4ff2af66cbc601b8a0e0', 'request_id': 'req-48b19e02-ff5e-4de1-90f0-d2ec8c08b026'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:25.853129 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-48b19e02-ff5e-4de1-90f0-d2ec8c08b026 admin admin] The token cache is being invalidate because project 38a2d7ed10dd4ff2af66cbc601b8a0e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:39:25.853418 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-48b19e02-ff5e-4de1-90f0-d2ec8c08b026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:25.854059 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-48b19e02-ff5e-4de1-90f0-d2ec8c08b026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:25.855924 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1196/2406] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:39:25 2022] DELETE /identity/v3/projects/38a2d7ed10dd4ff2af66cbc601b8a0e0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:39:41.804480 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca68507-9df3-40e1-80ea-853df9fc0f59 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:41.805011 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca68507-9df3-40e1-80ea-853df9fc0f59 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:41.805113 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca68507-9df3-40e1-80ea-853df9fc0f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:41.823112 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-4ca68507-9df3-40e1-80ea-853df9fc0f59 None None] MFA Rules not processed for user `d211582f9fc34b0e815e27db081c50c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:41.824317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-4ca68507-9df3-40e1-80ea-853df9fc0f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:41.878357 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1211/2407] 10.222.0.60 () {58 vars in 967 bytes} [Fri May 6 23:39:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:39:41.891192 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b19e02-ff5e-4de1-90f0-d2ec8c08b026 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:41.892596 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-48b19e02-ff5e-4de1-90f0-d2ec8c08b026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:41.963006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b19e02-ff5e-4de1-90f0-d2ec8c08b026 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:41.967971 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f37b8e-f434-41af-87fb-b56263d7bec3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b3ec57aee94b87889d578e114fa0db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:41.968645 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f37b8e-f434-41af-87fb-b56263d7bec3 service swift] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:41.968928 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f37b8e-f434-41af-87fb-b56263d7bec3 service swift] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:41.969203 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f37b8e-f434-41af-87fb-b56263d7bec3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:41.977416 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f37b8e-f434-41af-87fb-b56263d7bec3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:41.978999 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f37b8e-f434-41af-87fb-b56263d7bec3 service swift] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:41.986923 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1197/2408] 10.222.0.60 () {60 vars in 1384 bytes} [Fri May 6 23:39:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 06 23:39:43.270126 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca68507-9df3-40e1-80ea-853df9fc0f59 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:43.271511 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-4ca68507-9df3-40e1-80ea-853df9fc0f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:43.335743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca68507-9df3-40e1-80ea-853df9fc0f59 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:43.340467 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66495e88-6eb2-4fe3-a2f2-fa9436a69956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:43.341383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66495e88-6eb2-4fe3-a2f2-fa9436a69956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:43.341666 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66495e88-6eb2-4fe3-a2f2-fa9436a69956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:43.341942 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66495e88-6eb2-4fe3-a2f2-fa9436a69956 admin admin] PATH_INFO: `/v3/users/363592b4c9f7464e94624778a9ba2c1f` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:43.343179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66495e88-6eb2-4fe3-a2f2-fa9436a69956 admin admin] RBAC: Authorizing `identity:delete_user(user_id=363592b4c9f7464e94624778a9ba2c1f)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:43.345210 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66495e88-6eb2-4fe3-a2f2-fa9436a69956 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:43.415298 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-66495e88-6eb2-4fe3-a2f2-fa9436a69956 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '363592b4c9f7464e94624778a9ba2c1f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:43.422023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-66495e88-6eb2-4fe3-a2f2-fa9436a69956 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '363592b4c9f7464e94624778a9ba2c1f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:43.422695 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-66495e88-6eb2-4fe3-a2f2-fa9436a69956 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '363592b4c9f7464e94624778a9ba2c1f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:43.430878 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-66495e88-6eb2-4fe3-a2f2-fa9436a69956 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '363592b4c9f7464e94624778a9ba2c1f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:43.431540 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-66495e88-6eb2-4fe3-a2f2-fa9436a69956 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '363592b4c9f7464e94624778a9ba2c1f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:43.450212 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1212/2409] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:39:43 2022] DELETE /identity/v3/users/363592b4c9f7464e94624778a9ba2c1f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:39:43.454013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0933411-e29c-470e-bb71-28bd635ff36f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:43.454478 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0933411-e29c-470e-bb71-28bd635ff36f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:43.454660 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0933411-e29c-470e-bb71-28bd635ff36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:43.473910 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-f0933411-e29c-470e-bb71-28bd635ff36f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:43.475169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f0933411-e29c-470e-bb71-28bd635ff36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:43.538285 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1198/2410] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:39:43.548226 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66495e88-6eb2-4fe3-a2f2-fa9436a69956 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:43.550379 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-66495e88-6eb2-4fe3-a2f2-fa9436a69956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:43.612256 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66495e88-6eb2-4fe3-a2f2-fa9436a69956 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:43.617490 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd8a6e-a461-4f02-8ad4-ff4f49defe6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:43.618495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd8a6e-a461-4f02-8ad4-ff4f49defe6b service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:43.618947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd8a6e-a461-4f02-8ad4-ff4f49defe6b service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:43.619376 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd8a6e-a461-4f02-8ad4-ff4f49defe6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:43.631097 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd8a6e-a461-4f02-8ad4-ff4f49defe6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:43.632529 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd8a6e-a461-4f02-8ad4-ff4f49defe6b service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:43.641971 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1213/2411] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:39:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:39:43.938638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0933411-e29c-470e-bb71-28bd635ff36f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:43.940025 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f0933411-e29c-470e-bb71-28bd635ff36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:43.956832 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0933411-e29c-470e-bb71-28bd635ff36f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:43.961772 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f34deb-474a-4c1c-b21a-7aac03059d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:43.962691 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f34deb-474a-4c1c-b21a-7aac03059d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:43.963031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f34deb-474a-4c1c-b21a-7aac03059d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:43.963310 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f34deb-474a-4c1c-b21a-7aac03059d5e admin admin] PATH_INFO: `/v3/projects/227f81e03c0a4d9fb59a70b7d24f748b` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:43.964553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f34deb-474a-4c1c-b21a-7aac03059d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=227f81e03c0a4d9fb59a70b7d24f748b)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:43.966476 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f34deb-474a-4c1c-b21a-7aac03059d5e admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:44.023051 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a5f34deb-474a-4c1c-b21a-7aac03059d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '227f81e03c0a4d9fb59a70b7d24f748b', 'request_id': 'req-a5f34deb-474a-4c1c-b21a-7aac03059d5e'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:44.028999 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a5f34deb-474a-4c1c-b21a-7aac03059d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '227f81e03c0a4d9fb59a70b7d24f748b', 'request_id': 'req-a5f34deb-474a-4c1c-b21a-7aac03059d5e'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:44.034118 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a5f34deb-474a-4c1c-b21a-7aac03059d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '227f81e03c0a4d9fb59a70b7d24f748b', 'request_id': 'req-a5f34deb-474a-4c1c-b21a-7aac03059d5e'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:44.045392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a5f34deb-474a-4c1c-b21a-7aac03059d5e admin admin] The token cache is being invalidate because project 227f81e03c0a4d9fb59a70b7d24f748b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:39:44.045673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a5f34deb-474a-4c1c-b21a-7aac03059d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:44.046281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a5f34deb-474a-4c1c-b21a-7aac03059d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:44.047830 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1199/2412] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:39:43 2022] DELETE /identity/v3/projects/227f81e03c0a4d9fb59a70b7d24f748b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:39:44.053163 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2996-bb78-4f40-8c44-59981433cd7f None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:44.053446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2996-bb78-4f40-8c44-59981433cd7f None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:44.053743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2996-bb78-4f40-8c44-59981433cd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:44.072145 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-70fd2996-bb78-4f40-8c44-59981433cd7f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:44.073349 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-70fd2996-bb78-4f40-8c44-59981433cd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:44.128020 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1214/2413] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:39:44.136266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1090530-085b-407f-a521-e2928bf9a920 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:44.136581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1090530-085b-407f-a521-e2928bf9a920 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:44.136866 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1090530-085b-407f-a521-e2928bf9a920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:44.155880 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-f1090530-085b-407f-a521-e2928bf9a920 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:44.157104 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f1090530-085b-407f-a521-e2928bf9a920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:44.164922 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1200/2414] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:39:44.169095 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd2996-bb78-4f40-8c44-59981433cd7f None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:44.179063 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd2996-bb78-4f40-8c44-59981433cd7f None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:44.183663 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea1680-3e30-42f2-a29c-466f233cbab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:44.184245 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea1680-3e30-42f2-a29c-466f233cbab7 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:44.184527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea1680-3e30-42f2-a29c-466f233cbab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:44.184830 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea1680-3e30-42f2-a29c-466f233cbab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:44.185550 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea1680-3e30-42f2-a29c-466f233cbab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:39:44.185856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea1680-3e30-42f2-a29c-466f233cbab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:44.187444 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea1680-3e30-42f2-a29c-466f233cbab7 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:44.199190 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1215/2415] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:39:44.203298 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1090530-085b-407f-a521-e2928bf9a920 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:44.212166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1090530-085b-407f-a521-e2928bf9a920 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:44.216795 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2cc16-2fa1-4e38-99c5-c6d8f80435ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:44.217426 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2cc16-2fa1-4e38-99c5-c6d8f80435ed admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:44.217710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2cc16-2fa1-4e38-99c5-c6d8f80435ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:44.217986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2cc16-2fa1-4e38-99c5-c6d8f80435ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:44.218673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2cc16-2fa1-4e38-99c5-c6d8f80435ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:44.220639 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2cc16-2fa1-4e38-99c5-c6d8f80435ed admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:44.260570 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1201/2416] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:39:44 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:39:44.264877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea1680-3e30-42f2-a29c-466f233cbab7 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:44.274706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea1680-3e30-42f2-a29c-466f233cbab7 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:44.328351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f7dd0-eee7-475e-9871-8dd603928806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:44.329083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f7dd0-eee7-475e-9871-8dd603928806 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:44.329362 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f7dd0-eee7-475e-9871-8dd603928806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:44.329638 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f7dd0-eee7-475e-9871-8dd603928806 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:44.330319 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f7dd0-eee7-475e-9871-8dd603928806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:44.332263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f7dd0-eee7-475e-9871-8dd603928806 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:44.351526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1216/2417] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:39:44 2022] POST /identity/v3/users => generated 283 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:39:44.355585 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2cc16-2fa1-4e38-99c5-c6d8f80435ed admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:44.366350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2cc16-2fa1-4e38-99c5-c6d8f80435ed admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:44.370986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd558b-051d-4a8d-ad9a-b7f7441cd425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:44.371637 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd558b-051d-4a8d-ad9a-b7f7441cd425 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:44.371919 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd558b-051d-4a8d-ad9a-b7f7441cd425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:44.372193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd558b-051d-4a8d-ad9a-b7f7441cd425 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:44.372962 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd558b-051d-4a8d-ad9a-b7f7441cd425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:44.374566 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd558b-051d-4a8d-ad9a-b7f7441cd425 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:44.384172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1202/2418] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:39:44.387919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f7dd0-eee7-475e-9871-8dd603928806 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:44.397587 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f7dd0-eee7-475e-9871-8dd603928806 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:44.402298 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf8469-3123-4429-beba-91f6665abfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:44.403049 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf8469-3123-4429-beba-91f6665abfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:44.403356 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf8469-3123-4429-beba-91f6665abfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:44.403632 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf8469-3123-4429-beba-91f6665abfa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:44.404589 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf8469-3123-4429-beba-91f6665abfa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:44.406547 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf8469-3123-4429-beba-91f6665abfa2 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:44.417653 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1217/2419] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:39:44.421628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd558b-051d-4a8d-ad9a-b7f7441cd425 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:44.431959 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd558b-051d-4a8d-ad9a-b7f7441cd425 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:44.436885 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee382fe-e7ab-4618-b920-6bd31baa2bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:44.437687 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee382fe-e7ab-4618-b920-6bd31baa2bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:44.437965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee382fe-e7ab-4618-b920-6bd31baa2bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:44.438676 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee382fe-e7ab-4618-b920-6bd31baa2bfa admin admin] PATH_INFO: `/v3/projects/34abecb06da4488592d85838fbfa7eef/users/f3c8a5c7dc2941d3a117789589ea9b04/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:44.453668 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee382fe-e7ab-4618-b920-6bd31baa2bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=34abecb06da4488592d85838fbfa7eef, user_id=f3c8a5c7dc2941d3a117789589ea9b04, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:44.456331 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee382fe-e7ab-4618-b920-6bd31baa2bfa admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:44.474109 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1203/2420] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:39:44 2022] PUT /identity/v3/projects/34abecb06da4488592d85838fbfa7eef/users/f3c8a5c7dc2941d3a117789589ea9b04/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:39:44.485290 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aafc7e-6e9c-45c5-88ff-c05c73969b8c None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:44.485578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aafc7e-6e9c-45c5-88ff-c05c73969b8c None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:44.485854 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aafc7e-6e9c-45c5-88ff-c05c73969b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:44.512773 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-71aafc7e-6e9c-45c5-88ff-c05c73969b8c None None] MFA Rules not processed for user `f3c8a5c7dc2941d3a117789589ea9b04`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:44.513998 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-71aafc7e-6e9c-45c5-88ff-c05c73969b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:44.578229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1218/2421] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:39:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:39:44.589584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee382fe-e7ab-4618-b920-6bd31baa2bfa admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:44.591527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-7ee382fe-e7ab-4618-b920-6bd31baa2bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:44.648664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee382fe-e7ab-4618-b920-6bd31baa2bfa admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:44.652213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc437e3a-4406-424b-bd5e-2a0d9f798891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:44.652878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc437e3a-4406-424b-bd5e-2a0d9f798891 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:44.653184 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc437e3a-4406-424b-bd5e-2a0d9f798891 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:44.653456 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc437e3a-4406-424b-bd5e-2a0d9f798891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:44.662307 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc437e3a-4406-424b-bd5e-2a0d9f798891 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:44.663754 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc437e3a-4406-424b-bd5e-2a0d9f798891 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:44.672587 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1204/2422] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:39:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:39:56.072469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aafc7e-6e9c-45c5-88ff-c05c73969b8c None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:56.074184 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-71aafc7e-6e9c-45c5-88ff-c05c73969b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:56.133021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aafc7e-6e9c-45c5-88ff-c05c73969b8c None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:56.136850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb5bb3-5b24-45f3-a325-0e90c6ae547d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:56.137497 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb5bb3-5b24-45f3-a325-0e90c6ae547d service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:56.137776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb5bb3-5b24-45f3-a325-0e90c6ae547d service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:56.138139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb5bb3-5b24-45f3-a325-0e90c6ae547d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:56.139842 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-a3eb5bb3-5b24-45f3-a325-0e90c6ae547d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:56.205267 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb5bb3-5b24-45f3-a325-0e90c6ae547d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:56.206717 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb5bb3-5b24-45f3-a325-0e90c6ae547d service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:56.216385 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1219/2423] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:39:59.358868 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc437e3a-4406-424b-bd5e-2a0d9f798891 service cinder] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:59.360352 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-bc437e3a-4406-424b-bd5e-2a0d9f798891 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:59.374456 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc437e3a-4406-424b-bd5e-2a0d9f798891 service cinder] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:59.379758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9b6bc-9dc5-4571-9db1-0d510d1a61f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:59.380633 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9b6bc-9dc5-4571-9db1-0d510d1a61f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:59.380909 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9b6bc-9dc5-4571-9db1-0d510d1a61f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:59.381183 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9b6bc-9dc5-4571-9db1-0d510d1a61f6 admin admin] PATH_INFO: `/v3/users/f8f765f9b7104604b1ea1ec482932814` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:59.382356 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9b6bc-9dc5-4571-9db1-0d510d1a61f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f765f9b7104604b1ea1ec482932814)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:59.384526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9b6bc-9dc5-4571-9db1-0d510d1a61f6 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:59.429181 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b4b9b6bc-9dc5-4571-9db1-0d510d1a61f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f765f9b7104604b1ea1ec482932814'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:59.435699 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b4b9b6bc-9dc5-4571-9db1-0d510d1a61f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f765f9b7104604b1ea1ec482932814'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:59.442960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b4b9b6bc-9dc5-4571-9db1-0d510d1a61f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f765f9b7104604b1ea1ec482932814'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:59.443805 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b4b9b6bc-9dc5-4571-9db1-0d510d1a61f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f765f9b7104604b1ea1ec482932814'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:59.444492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-b4b9b6bc-9dc5-4571-9db1-0d510d1a61f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f765f9b7104604b1ea1ec482932814'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:59.461676 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1205/2424] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:39:59 2022] DELETE /identity/v3/users/f8f765f9b7104604b1ea1ec482932814 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:39:59.640278 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb5bb3-5b24-45f3-a325-0e90c6ae547d service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:59.651327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb5bb3-5b24-45f3-a325-0e90c6ae547d service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:59.710790 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cbc10-e7e0-411f-9684-1edbf0ff666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:59.711652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cbc10-e7e0-411f-9684-1edbf0ff666d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:59.711938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cbc10-e7e0-411f-9684-1edbf0ff666d admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:59.712216 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cbc10-e7e0-411f-9684-1edbf0ff666d admin admin] PATH_INFO: `/v3/projects/4b17157ada2144d18f2332c894a2f5e4` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:59.713434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cbc10-e7e0-411f-9684-1edbf0ff666d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b17157ada2144d18f2332c894a2f5e4)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:59.715363 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cbc10-e7e0-411f-9684-1edbf0ff666d admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:59.763172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c17cbc10-e7e0-411f-9684-1edbf0ff666d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b17157ada2144d18f2332c894a2f5e4', 'request_id': 'req-c17cbc10-e7e0-411f-9684-1edbf0ff666d'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:59.770159 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c17cbc10-e7e0-411f-9684-1edbf0ff666d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b17157ada2144d18f2332c894a2f5e4', 'request_id': 'req-c17cbc10-e7e0-411f-9684-1edbf0ff666d'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:59.776143 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c17cbc10-e7e0-411f-9684-1edbf0ff666d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b17157ada2144d18f2332c894a2f5e4', 'request_id': 'req-c17cbc10-e7e0-411f-9684-1edbf0ff666d'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:59.790442 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c17cbc10-e7e0-411f-9684-1edbf0ff666d admin admin] The token cache is being invalidate because project 4b17157ada2144d18f2332c894a2f5e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:39:59.790744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c17cbc10-e7e0-411f-9684-1edbf0ff666d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:59.791556 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c17cbc10-e7e0-411f-9684-1edbf0ff666d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:39:59.793224 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1220/2425] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:39:59 2022] DELETE /identity/v3/projects/4b17157ada2144d18f2332c894a2f5e4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:39:59.798422 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf49254-7d10-4216-9487-5912140943c7 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:59.798556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf49254-7d10-4216-9487-5912140943c7 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:59.798818 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf49254-7d10-4216-9487-5912140943c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:59.816940 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-ebf49254-7d10-4216-9487-5912140943c7 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:59.827274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-ebf49254-7d10-4216-9487-5912140943c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:59.896908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1206/2426] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:39:59.905119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f63c5c-3993-44be-a46f-04f8d1c8b055 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:59.905626 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f63c5c-3993-44be-a46f-04f8d1c8b055 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:59.905956 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f63c5c-3993-44be-a46f-04f8d1c8b055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:59.926722 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-e9f63c5c-3993-44be-a46f-04f8d1c8b055 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:39:59.928040 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-e9f63c5c-3993-44be-a46f-04f8d1c8b055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:39:59.936800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1221/2427] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:39:59.941941 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf49254-7d10-4216-9487-5912140943c7 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:59.951415 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf49254-7d10-4216-9487-5912140943c7 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:59.956353 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce8323-c2bc-4bf9-84d4-23badeb20f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:59.957771 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce8323-c2bc-4bf9-84d4-23badeb20f53 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:59.958057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce8323-c2bc-4bf9-84d4-23badeb20f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:59.958332 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce8323-c2bc-4bf9-84d4-23badeb20f53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:59.959056 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce8323-c2bc-4bf9-84d4-23badeb20f53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:39:59.959450 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce8323-c2bc-4bf9-84d4-23badeb20f53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:39:59.962129 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce8323-c2bc-4bf9-84d4-23badeb20f53 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:39:59.976787 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1207/2428] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:39:59.978068 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f63c5c-3993-44be-a46f-04f8d1c8b055 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:39:59.989637 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f63c5c-3993-44be-a46f-04f8d1c8b055 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:39:59.994838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb27492-8023-4442-8cc9-9fbfa9dd5e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:39:59.995586 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb27492-8023-4442-8cc9-9fbfa9dd5e0c admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:39:59.995968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb27492-8023-4442-8cc9-9fbfa9dd5e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:39:59.996359 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb27492-8023-4442-8cc9-9fbfa9dd5e0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:39:59.997338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb27492-8023-4442-8cc9-9fbfa9dd5e0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:00.007738 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb27492-8023-4442-8cc9-9fbfa9dd5e0c admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:00.048405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1222/2429] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:39:59 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:00.052661 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce8323-c2bc-4bf9-84d4-23badeb20f53 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:00.062860 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce8323-c2bc-4bf9-84d4-23badeb20f53 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:00.120645 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e2bc5-35de-4270-9100-f6715d4f4c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:00.121249 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e2bc5-35de-4270-9100-f6715d4f4c6b admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:00.121529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e2bc5-35de-4270-9100-f6715d4f4c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:00.121804 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e2bc5-35de-4270-9100-f6715d4f4c6b admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:00.122489 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e2bc5-35de-4270-9100-f6715d4f4c6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:00.124386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e2bc5-35de-4270-9100-f6715d4f4c6b admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:00.147274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1208/2430] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:00 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:00.148646 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb27492-8023-4442-8cc9-9fbfa9dd5e0c admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:00.158726 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb27492-8023-4442-8cc9-9fbfa9dd5e0c admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:00.163428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d67f9c-3fb4-455a-9d6e-92c93a229c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:00.164109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d67f9c-3fb4-455a-9d6e-92c93a229c82 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:00.164391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d67f9c-3fb4-455a-9d6e-92c93a229c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:00.164702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d67f9c-3fb4-455a-9d6e-92c93a229c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:00.165429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d67f9c-3fb4-455a-9d6e-92c93a229c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:00.167146 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d67f9c-3fb4-455a-9d6e-92c93a229c82 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:00.177486 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1223/2431] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:00.181329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e2bc5-35de-4270-9100-f6715d4f4c6b admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:00.191806 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e2bc5-35de-4270-9100-f6715d4f4c6b admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:00.196407 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06057488-b983-41d1-8a02-84b17e83987f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:00.197101 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06057488-b983-41d1-8a02-84b17e83987f admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:00.197384 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06057488-b983-41d1-8a02-84b17e83987f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:00.197661 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06057488-b983-41d1-8a02-84b17e83987f admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:00.198378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06057488-b983-41d1-8a02-84b17e83987f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:00.199986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06057488-b983-41d1-8a02-84b17e83987f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:00.211185 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1209/2432] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:00.215226 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d67f9c-3fb4-455a-9d6e-92c93a229c82 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:00.225088 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d67f9c-3fb4-455a-9d6e-92c93a229c82 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:00.230075 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da578117-d02f-4123-ac4a-6e5da2fe5ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:00.230943 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da578117-d02f-4123-ac4a-6e5da2fe5ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:00.231225 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da578117-d02f-4123-ac4a-6e5da2fe5ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:00.231500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da578117-d02f-4123-ac4a-6e5da2fe5ca3 admin admin] PATH_INFO: `/v3/projects/386b4253ff284395ab656ff6ba941362/users/2de1fade0352499b8a5eaeec5abff2fc/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:00.247006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da578117-d02f-4123-ac4a-6e5da2fe5ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=386b4253ff284395ab656ff6ba941362, user_id=2de1fade0352499b8a5eaeec5abff2fc, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:00.249791 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da578117-d02f-4123-ac4a-6e5da2fe5ca3 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:00.264444 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1224/2433] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:00 2022] PUT /identity/v3/projects/386b4253ff284395ab656ff6ba941362/users/2de1fade0352499b8a5eaeec5abff2fc/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:00.275921 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b967c-cf3b-4a2e-9049-f2735e5d47ea None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:00.276210 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b967c-cf3b-4a2e-9049-f2735e5d47ea None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:00.276525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b967c-cf3b-4a2e-9049-f2735e5d47ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:00.303532 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-059b967c-cf3b-4a2e-9049-f2735e5d47ea None None] MFA Rules not processed for user `2de1fade0352499b8a5eaeec5abff2fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:00.304781 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-059b967c-cf3b-4a2e-9049-f2735e5d47ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:00.367020 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1210/2434] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:00.379543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da578117-d02f-4123-ac4a-6e5da2fe5ca3 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:00.381164 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-da578117-d02f-4123-ac4a-6e5da2fe5ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:00.454618 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da578117-d02f-4123-ac4a-6e5da2fe5ca3 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:00.460266 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9c9f0-e359-47b1-bee6-5fbbfe9317d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:00.460937 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9c9f0-e359-47b1-bee6-5fbbfe9317d8 service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:00.461222 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9c9f0-e359-47b1-bee6-5fbbfe9317d8 service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:00.461502 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9c9f0-e359-47b1-bee6-5fbbfe9317d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:00.469205 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9c9f0-e359-47b1-bee6-5fbbfe9317d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:00.470919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9c9f0-e359-47b1-bee6-5fbbfe9317d8 service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:00.480368 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1225/2435] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:08.778550 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b967c-cf3b-4a2e-9049-f2735e5d47ea None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:08.842401 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b967c-cf3b-4a2e-9049-f2735e5d47ea None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:08.846917 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf3cde-926e-4dd8-92e9-b08778a7d642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:08.847811 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf3cde-926e-4dd8-92e9-b08778a7d642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:08.848143 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf3cde-926e-4dd8-92e9-b08778a7d642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:08.848355 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf3cde-926e-4dd8-92e9-b08778a7d642 admin admin] PATH_INFO: `/v3/users/2de1fade0352499b8a5eaeec5abff2fc` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:08.849723 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf3cde-926e-4dd8-92e9-b08778a7d642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de1fade0352499b8a5eaeec5abff2fc)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:08.851907 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf3cde-926e-4dd8-92e9-b08778a7d642 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:08.903085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cacf3cde-926e-4dd8-92e9-b08778a7d642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de1fade0352499b8a5eaeec5abff2fc'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:08.910366 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cacf3cde-926e-4dd8-92e9-b08778a7d642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de1fade0352499b8a5eaeec5abff2fc'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:08.917006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cacf3cde-926e-4dd8-92e9-b08778a7d642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de1fade0352499b8a5eaeec5abff2fc'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:08.917726 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cacf3cde-926e-4dd8-92e9-b08778a7d642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de1fade0352499b8a5eaeec5abff2fc'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:08.918345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cacf3cde-926e-4dd8-92e9-b08778a7d642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de1fade0352499b8a5eaeec5abff2fc'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:08.937912 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1211/2436] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:08 2022] DELETE /identity/v3/users/2de1fade0352499b8a5eaeec5abff2fc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:08.942770 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3a563-4cb8-46a6-9696-59dcba133e90 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:08.943288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3a563-4cb8-46a6-9696-59dcba133e90 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:08.943463 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3a563-4cb8-46a6-9696-59dcba133e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:08.961381 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-cdb3a563-4cb8-46a6-9696-59dcba133e90 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:08.962676 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-cdb3a563-4cb8-46a6-9696-59dcba133e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:09.026818 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1226/2437] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:09.036963 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf3cde-926e-4dd8-92e9-b08778a7d642 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:09.038411 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-cacf3cde-926e-4dd8-92e9-b08778a7d642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:09.098442 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf3cde-926e-4dd8-92e9-b08778a7d642 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:09.102773 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f5891-4332-4b26-8146-071bb572690c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:09.103414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f5891-4332-4b26-8146-071bb572690c service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:09.103938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f5891-4332-4b26-8146-071bb572690c service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:09.103938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f5891-4332-4b26-8146-071bb572690c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:09.113732 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f5891-4332-4b26-8146-071bb572690c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:09.115170 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f5891-4332-4b26-8146-071bb572690c service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:09.124686 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1212/2438] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:09.577450 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3a563-4cb8-46a6-9696-59dcba133e90 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:09.579049 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-cdb3a563-4cb8-46a6-9696-59dcba133e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:09.591603 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3a563-4cb8-46a6-9696-59dcba133e90 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:09.596338 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87f59e-864a-4561-8e68-a397d8566575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:09.598039 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87f59e-864a-4561-8e68-a397d8566575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:09.598473 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87f59e-864a-4561-8e68-a397d8566575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:09.598754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87f59e-864a-4561-8e68-a397d8566575 admin admin] PATH_INFO: `/v3/projects/386b4253ff284395ab656ff6ba941362` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:09.600254 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87f59e-864a-4561-8e68-a397d8566575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=386b4253ff284395ab656ff6ba941362)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:09.604304 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87f59e-864a-4561-8e68-a397d8566575 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:09.690734 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ba87f59e-864a-4561-8e68-a397d8566575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386b4253ff284395ab656ff6ba941362', 'request_id': 'req-ba87f59e-864a-4561-8e68-a397d8566575'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:09.699911 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ba87f59e-864a-4561-8e68-a397d8566575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386b4253ff284395ab656ff6ba941362', 'request_id': 'req-ba87f59e-864a-4561-8e68-a397d8566575'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:09.707856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ba87f59e-864a-4561-8e68-a397d8566575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386b4253ff284395ab656ff6ba941362', 'request_id': 'req-ba87f59e-864a-4561-8e68-a397d8566575'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:09.735273 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ba87f59e-864a-4561-8e68-a397d8566575 admin admin] The token cache is being invalidate because project 386b4253ff284395ab656ff6ba941362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:09.735576 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ba87f59e-864a-4561-8e68-a397d8566575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:09.738892 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ba87f59e-864a-4561-8e68-a397d8566575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:09.740876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1227/2439] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:09 2022] DELETE /identity/v3/projects/386b4253ff284395ab656ff6ba941362 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:09.746234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf44c7-23ab-4429-bc8a-680724815a4a None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:09.746821 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf44c7-23ab-4429-bc8a-680724815a4a None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:09.747106 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf44c7-23ab-4429-bc8a-680724815a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:09.781000 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-bccf44c7-23ab-4429-bc8a-680724815a4a None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:09.783481 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-bccf44c7-23ab-4429-bc8a-680724815a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:09.872055 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1213/2440] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:09.880722 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b1ead-4b7d-4811-805f-011d48942a1f None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:09.881074 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b1ead-4b7d-4811-805f-011d48942a1f None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:09.881359 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b1ead-4b7d-4811-805f-011d48942a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:09.901452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-0f4b1ead-4b7d-4811-805f-011d48942a1f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:09.903054 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-0f4b1ead-4b7d-4811-805f-011d48942a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:09.915342 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1228/2441] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:09.916497 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf44c7-23ab-4429-bc8a-680724815a4a None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:09.928250 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf44c7-23ab-4429-bc8a-680724815a4a None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:09.932932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8cc22-02ad-4347-8f95-9809cc3cf211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:09.933584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8cc22-02ad-4347-8f95-9809cc3cf211 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:09.933865 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8cc22-02ad-4347-8f95-9809cc3cf211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:09.934136 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8cc22-02ad-4347-8f95-9809cc3cf211 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:09.934856 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8cc22-02ad-4347-8f95-9809cc3cf211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:40:09.935160 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8cc22-02ad-4347-8f95-9809cc3cf211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:09.936794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8cc22-02ad-4347-8f95-9809cc3cf211 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:09.948770 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1214/2442] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:40:09.952992 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b1ead-4b7d-4811-805f-011d48942a1f None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:09.962824 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b1ead-4b7d-4811-805f-011d48942a1f None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:09.967615 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12180f9e-a332-44a7-8a9a-9a15a1207ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:09.968337 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12180f9e-a332-44a7-8a9a-9a15a1207ebe admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:09.968721 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12180f9e-a332-44a7-8a9a-9a15a1207ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:09.969064 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12180f9e-a332-44a7-8a9a-9a15a1207ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:09.969874 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12180f9e-a332-44a7-8a9a-9a15a1207ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:09.971797 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12180f9e-a332-44a7-8a9a-9a15a1207ebe admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:10.003432 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1229/2443] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:09 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:10.009098 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8cc22-02ad-4347-8f95-9809cc3cf211 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:10.019022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8cc22-02ad-4347-8f95-9809cc3cf211 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:10.075147 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7c5e8-ef20-4f88-aa40-127b3135e47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:10.075845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7c5e8-ef20-4f88-aa40-127b3135e47f admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:10.076128 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7c5e8-ef20-4f88-aa40-127b3135e47f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:10.076400 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7c5e8-ef20-4f88-aa40-127b3135e47f admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:10.077302 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7c5e8-ef20-4f88-aa40-127b3135e47f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:10.079234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7c5e8-ef20-4f88-aa40-127b3135e47f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:10.104322 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1215/2444] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:10 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:10.105597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12180f9e-a332-44a7-8a9a-9a15a1207ebe admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:10.118687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12180f9e-a332-44a7-8a9a-9a15a1207ebe admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:10.124830 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93230d99-b2dd-40e3-9dbf-79584493c865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:10.125503 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230d99-b2dd-40e3-9dbf-79584493c865 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:10.125783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230d99-b2dd-40e3-9dbf-79584493c865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:10.126062 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230d99-b2dd-40e3-9dbf-79584493c865 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:10.126801 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93230d99-b2dd-40e3-9dbf-79584493c865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:10.128955 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93230d99-b2dd-40e3-9dbf-79584493c865 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:10.148847 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1230/2445] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:10.151165 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7c5e8-ef20-4f88-aa40-127b3135e47f admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:10.161755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7c5e8-ef20-4f88-aa40-127b3135e47f admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:10.167782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef60392-41e1-4c0f-9de3-a8433f858dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:10.168414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef60392-41e1-4c0f-9de3-a8433f858dcf admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:10.168798 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef60392-41e1-4c0f-9de3-a8433f858dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:10.169176 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef60392-41e1-4c0f-9de3-a8433f858dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:10.169889 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef60392-41e1-4c0f-9de3-a8433f858dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:10.171721 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef60392-41e1-4c0f-9de3-a8433f858dcf admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:10.186243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1216/2446] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:10.190495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93230d99-b2dd-40e3-9dbf-79584493c865 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:10.201482 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93230d99-b2dd-40e3-9dbf-79584493c865 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:10.206432 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1751fb-7e49-411b-84a1-095c358477c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:10.207299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1751fb-7e49-411b-84a1-095c358477c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:10.207575 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1751fb-7e49-411b-84a1-095c358477c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:10.207846 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1751fb-7e49-411b-84a1-095c358477c9 admin admin] PATH_INFO: `/v3/projects/96f270f69f1343d685aef755a3753839/users/9914dd8a21dc468380b6a0080d35516f/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:10.225637 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1751fb-7e49-411b-84a1-095c358477c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f270f69f1343d685aef755a3753839, user_id=9914dd8a21dc468380b6a0080d35516f, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:10.229220 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1751fb-7e49-411b-84a1-095c358477c9 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:10.252049 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1231/2447] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:10 2022] PUT /identity/v3/projects/96f270f69f1343d685aef755a3753839/users/9914dd8a21dc468380b6a0080d35516f/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:10.255165 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2fe9d-d203-402b-9053-66297b79b232 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:10.255482 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2fe9d-d203-402b-9053-66297b79b232 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:10.255752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2fe9d-d203-402b-9053-66297b79b232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:10.284426 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-aad2fe9d-d203-402b-9053-66297b79b232 None None] MFA Rules not processed for user `9914dd8a21dc468380b6a0080d35516f`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:10.286395 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-aad2fe9d-d203-402b-9053-66297b79b232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:10.397469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1217/2448] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:10.398527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1751fb-7e49-411b-84a1-095c358477c9 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:10.474828 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1751fb-7e49-411b-84a1-095c358477c9 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:10.480106 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeabb7f-3406-49c1-ba6e-63f53f8f2ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:10.480908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeabb7f-3406-49c1-ba6e-63f53f8f2ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:10.481305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeabb7f-3406-49c1-ba6e-63f53f8f2ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:10.481672 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeabb7f-3406-49c1-ba6e-63f53f8f2ae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:10.482652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeabb7f-3406-49c1-ba6e-63f53f8f2ae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:10.484721 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeabb7f-3406-49c1-ba6e-63f53f8f2ae2 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:10.521327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1232/2449] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:10 2022] POST /identity/v3/projects => generated 403 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:10.524444 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2fe9d-d203-402b-9053-66297b79b232 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:10.537852 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2fe9d-d203-402b-9053-66297b79b232 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:10.609940 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91b138-a086-43e0-b4b2-12a625775ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:10.610611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91b138-a086-43e0-b4b2-12a625775ebb admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:10.610891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91b138-a086-43e0-b4b2-12a625775ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:10.611163 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91b138-a086-43e0-b4b2-12a625775ebb admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:10.611967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91b138-a086-43e0-b4b2-12a625775ebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:10.614616 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91b138-a086-43e0-b4b2-12a625775ebb admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:10.636069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1218/2450] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:10 2022] POST /identity/v3/users => generated 308 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:10.640036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeabb7f-3406-49c1-ba6e-63f53f8f2ae2 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:10.651871 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeabb7f-3406-49c1-ba6e-63f53f8f2ae2 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:10.659612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735de09-8d91-4e8d-8f79-b3abef4af2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:10.661307 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735de09-8d91-4e8d-8f79-b3abef4af2aa admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:10.661742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735de09-8d91-4e8d-8f79-b3abef4af2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:10.662167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735de09-8d91-4e8d-8f79-b3abef4af2aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:10.663086 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735de09-8d91-4e8d-8f79-b3abef4af2aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:10.664902 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735de09-8d91-4e8d-8f79-b3abef4af2aa admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:10.679165 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1233/2451] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:10.683727 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91b138-a086-43e0-b4b2-12a625775ebb admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:10.694639 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91b138-a086-43e0-b4b2-12a625775ebb admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:10.699526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cb355-d11c-436d-a4bf-e8f78b1f8826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:10.700451 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cb355-d11c-436d-a4bf-e8f78b1f8826 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:10.700760 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cb355-d11c-436d-a4bf-e8f78b1f8826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:10.701041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cb355-d11c-436d-a4bf-e8f78b1f8826 admin admin] PATH_INFO: `/v3/projects/b83c54881f6043b88cd9fa257258d030/users/eb9815c3e1574bb895955309fc890f27/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:10.717675 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cb355-d11c-436d-a4bf-e8f78b1f8826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b83c54881f6043b88cd9fa257258d030, user_id=eb9815c3e1574bb895955309fc890f27, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:10.721664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cb355-d11c-436d-a4bf-e8f78b1f8826 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:10.739722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1219/2452] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:10 2022] PUT /identity/v3/projects/b83c54881f6043b88cd9fa257258d030/users/eb9815c3e1574bb895955309fc890f27/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:10.743484 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735de09-8d91-4e8d-8f79-b3abef4af2aa admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:10.758437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735de09-8d91-4e8d-8f79-b3abef4af2aa admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:10.833476 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2505303-fda6-4a5f-8bb2-b3a5d921b36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:10.834167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2505303-fda6-4a5f-8bb2-b3a5d921b36d admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:10.834447 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2505303-fda6-4a5f-8bb2-b3a5d921b36d admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:10.834719 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2505303-fda6-4a5f-8bb2-b3a5d921b36d admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:10.835658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2505303-fda6-4a5f-8bb2-b3a5d921b36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:10.837318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2505303-fda6-4a5f-8bb2-b3a5d921b36d admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:10.853720 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1234/2453] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:10.857860 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cb355-d11c-436d-a4bf-e8f78b1f8826 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:10.868730 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cb355-d11c-436d-a4bf-e8f78b1f8826 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:10.873651 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb18a6-344c-4031-a0b5-b9522901fb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:10.874529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb18a6-344c-4031-a0b5-b9522901fb8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:10.874807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb18a6-344c-4031-a0b5-b9522901fb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:10.875078 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb18a6-344c-4031-a0b5-b9522901fb8f admin admin] PATH_INFO: `/v3/projects/b83c54881f6043b88cd9fa257258d030/users/eb9815c3e1574bb895955309fc890f27/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:10.877139 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb18a6-344c-4031-a0b5-b9522901fb8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b83c54881f6043b88cd9fa257258d030, user_id=eb9815c3e1574bb895955309fc890f27, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:10.880324 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb18a6-344c-4031-a0b5-b9522901fb8f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:10.893484 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1220/2454] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:10 2022] PUT /identity/v3/projects/b83c54881f6043b88cd9fa257258d030/users/eb9815c3e1574bb895955309fc890f27/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:10.905611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fe279-b3a8-44a2-85ca-70375c309084 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:10.905901 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fe279-b3a8-44a2-85ca-70375c309084 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:10.906322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fe279-b3a8-44a2-85ca-70375c309084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:10.935197 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-250fe279-b3a8-44a2-85ca-70375c309084 None None] MFA Rules not processed for user `eb9815c3e1574bb895955309fc890f27`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:10.936499 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-250fe279-b3a8-44a2-85ca-70375c309084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:11.021131 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1235/2455] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:10 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:11.032984 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb18a6-344c-4031-a0b5-b9522901fb8f admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:11.035639 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-4cdb18a6-344c-4031-a0b5-b9522901fb8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:11.090983 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb18a6-344c-4031-a0b5-b9522901fb8f admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:11.095643 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4125035-cad4-4c9c-981f-b718e3ce72b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:11.096443 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4125035-cad4-4c9c-981f-b718e3ce72b9 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:11.097079 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4125035-cad4-4c9c-981f-b718e3ce72b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:11.097522 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4125035-cad4-4c9c-981f-b718e3ce72b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:11.112074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4125035-cad4-4c9c-981f-b718e3ce72b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:11.114279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4125035-cad4-4c9c-981f-b718e3ce72b9 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:11.123979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1221/2456] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:11 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:11.264442 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fe279-b3a8-44a2-85ca-70375c309084 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:11.327418 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fe279-b3a8-44a2-85ca-70375c309084 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:11.331976 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc855731-6ace-4cdf-9943-7c45f7f3c8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:11.332868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc855731-6ace-4cdf-9943-7c45f7f3c8f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:11.333148 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc855731-6ace-4cdf-9943-7c45f7f3c8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:11.333417 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc855731-6ace-4cdf-9943-7c45f7f3c8f6 admin admin] PATH_INFO: `/v3/users/9914dd8a21dc468380b6a0080d35516f` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:11.334599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc855731-6ace-4cdf-9943-7c45f7f3c8f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9914dd8a21dc468380b6a0080d35516f)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:11.336580 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc855731-6ace-4cdf-9943-7c45f7f3c8f6 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:11.381817 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-cc855731-6ace-4cdf-9943-7c45f7f3c8f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9914dd8a21dc468380b6a0080d35516f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:11.389042 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-cc855731-6ace-4cdf-9943-7c45f7f3c8f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9914dd8a21dc468380b6a0080d35516f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:11.389883 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-cc855731-6ace-4cdf-9943-7c45f7f3c8f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9914dd8a21dc468380b6a0080d35516f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:11.399629 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-cc855731-6ace-4cdf-9943-7c45f7f3c8f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9914dd8a21dc468380b6a0080d35516f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:11.400318 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-cc855731-6ace-4cdf-9943-7c45f7f3c8f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9914dd8a21dc468380b6a0080d35516f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:11.421308 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1236/2457] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:11 2022] DELETE /identity/v3/users/9914dd8a21dc468380b6a0080d35516f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:11.426465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2e95e-5c9c-4669-9209-8e508bffc30f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:11.426819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2e95e-5c9c-4669-9209-8e508bffc30f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:11.427077 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2e95e-5c9c-4669-9209-8e508bffc30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:11.444446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-58e2e95e-5c9c-4669-9209-8e508bffc30f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:11.445738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-58e2e95e-5c9c-4669-9209-8e508bffc30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:11.505412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1222/2458] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:11.515262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc855731-6ace-4cdf-9943-7c45f7f3c8f6 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:11.516724 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-cc855731-6ace-4cdf-9943-7c45f7f3c8f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:11.571817 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc855731-6ace-4cdf-9943-7c45f7f3c8f6 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:11.575503 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95c8d5-f9bb-45fe-99c4-3907ac4556d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:11.576130 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95c8d5-f9bb-45fe-99c4-3907ac4556d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:11.576408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95c8d5-f9bb-45fe-99c4-3907ac4556d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:11.576713 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95c8d5-f9bb-45fe-99c4-3907ac4556d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:11.585487 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95c8d5-f9bb-45fe-99c4-3907ac4556d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:11.586967 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95c8d5-f9bb-45fe-99c4-3907ac4556d7 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:11.596154 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1237/2459] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:11.861371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2e95e-5c9c-4669-9209-8e508bffc30f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:11.862768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-58e2e95e-5c9c-4669-9209-8e508bffc30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:11.879143 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2e95e-5c9c-4669-9209-8e508bffc30f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:11.883892 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd9a0a-63fb-44a0-8357-cec1bd6edeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:11.885211 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd9a0a-63fb-44a0-8357-cec1bd6edeb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:11.885492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd9a0a-63fb-44a0-8357-cec1bd6edeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:11.885761 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd9a0a-63fb-44a0-8357-cec1bd6edeb2 admin admin] PATH_INFO: `/v3/projects/96f270f69f1343d685aef755a3753839` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:11.886927 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd9a0a-63fb-44a0-8357-cec1bd6edeb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f270f69f1343d685aef755a3753839)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:11.889071 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd9a0a-63fb-44a0-8357-cec1bd6edeb2 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:11.935692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6dbd9a0a-63fb-44a0-8357-cec1bd6edeb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f270f69f1343d685aef755a3753839', 'request_id': 'req-6dbd9a0a-63fb-44a0-8357-cec1bd6edeb2'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:11.941617 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6dbd9a0a-63fb-44a0-8357-cec1bd6edeb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f270f69f1343d685aef755a3753839', 'request_id': 'req-6dbd9a0a-63fb-44a0-8357-cec1bd6edeb2'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:11.946754 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6dbd9a0a-63fb-44a0-8357-cec1bd6edeb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f270f69f1343d685aef755a3753839', 'request_id': 'req-6dbd9a0a-63fb-44a0-8357-cec1bd6edeb2'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:11.958863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6dbd9a0a-63fb-44a0-8357-cec1bd6edeb2 admin admin] The token cache is being invalidate because project 96f270f69f1343d685aef755a3753839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:11.959148 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6dbd9a0a-63fb-44a0-8357-cec1bd6edeb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:11.959760 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6dbd9a0a-63fb-44a0-8357-cec1bd6edeb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:11.961382 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1223/2460] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:11 2022] DELETE /identity/v3/projects/96f270f69f1343d685aef755a3753839 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:11.965330 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95c8d5-f9bb-45fe-99c4-3907ac4556d7 service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:11.975284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95c8d5-f9bb-45fe-99c4-3907ac4556d7 service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:12.030327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1b763-4902-453a-b678-e55f1c43cb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:12.031311 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1b763-4902-453a-b678-e55f1c43cb05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:12.031553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1b763-4902-453a-b678-e55f1c43cb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:12.031871 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1b763-4902-453a-b678-e55f1c43cb05 admin admin] PATH_INFO: `/v3/users/eb9815c3e1574bb895955309fc890f27` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:12.033115 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1b763-4902-453a-b678-e55f1c43cb05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb9815c3e1574bb895955309fc890f27)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:12.035653 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1b763-4902-453a-b678-e55f1c43cb05 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:12.078473 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-f9a1b763-4902-453a-b678-e55f1c43cb05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb9815c3e1574bb895955309fc890f27'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:12.085172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-f9a1b763-4902-453a-b678-e55f1c43cb05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb9815c3e1574bb895955309fc890f27'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:12.085839 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-f9a1b763-4902-453a-b678-e55f1c43cb05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb9815c3e1574bb895955309fc890f27'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:12.093483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-f9a1b763-4902-453a-b678-e55f1c43cb05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb9815c3e1574bb895955309fc890f27'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:12.094563 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-f9a1b763-4902-453a-b678-e55f1c43cb05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb9815c3e1574bb895955309fc890f27'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:12.111577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1238/2461] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:11 2022] DELETE /identity/v3/users/eb9815c3e1574bb895955309fc890f27 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:12.380760 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd9a0a-63fb-44a0-8357-cec1bd6edeb2 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:12.382518 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-6dbd9a0a-63fb-44a0-8357-cec1bd6edeb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:12.410314 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd9a0a-63fb-44a0-8357-cec1bd6edeb2 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:12.466495 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ee759-505c-434d-8f6a-078e1ac31a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:12.467352 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ee759-505c-434d-8f6a-078e1ac31a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:12.467634 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ee759-505c-434d-8f6a-078e1ac31a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:12.467906 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ee759-505c-434d-8f6a-078e1ac31a8b admin admin] PATH_INFO: `/v3/projects/b83c54881f6043b88cd9fa257258d030` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:12.469262 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ee759-505c-434d-8f6a-078e1ac31a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b83c54881f6043b88cd9fa257258d030)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:12.471167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ee759-505c-434d-8f6a-078e1ac31a8b admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:12.515390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-7a1ee759-505c-434d-8f6a-078e1ac31a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b83c54881f6043b88cd9fa257258d030', 'request_id': 'req-7a1ee759-505c-434d-8f6a-078e1ac31a8b'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:12.521842 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-7a1ee759-505c-434d-8f6a-078e1ac31a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b83c54881f6043b88cd9fa257258d030', 'request_id': 'req-7a1ee759-505c-434d-8f6a-078e1ac31a8b'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:12.527351 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-7a1ee759-505c-434d-8f6a-078e1ac31a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b83c54881f6043b88cd9fa257258d030', 'request_id': 'req-7a1ee759-505c-434d-8f6a-078e1ac31a8b'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:12.542250 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-7a1ee759-505c-434d-8f6a-078e1ac31a8b admin admin] The token cache is being invalidate because project b83c54881f6043b88cd9fa257258d030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:12.542569 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-7a1ee759-505c-434d-8f6a-078e1ac31a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:12.543322 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-7a1ee759-505c-434d-8f6a-078e1ac31a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:12.545125 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1224/2462] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:12 2022] DELETE /identity/v3/projects/b83c54881f6043b88cd9fa257258d030 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:12.550160 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6334079-0200-4af7-8db7-6cd3ac846c8c None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:12.551089 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6334079-0200-4af7-8db7-6cd3ac846c8c None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:12.551370 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6334079-0200-4af7-8db7-6cd3ac846c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:12.569974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-a6334079-0200-4af7-8db7-6cd3ac846c8c None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:12.571161 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-a6334079-0200-4af7-8db7-6cd3ac846c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:12.632275 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1239/2463] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:12.640312 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1242c9-af5e-43c2-818b-482fb5bacfb8 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:12.640620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1242c9-af5e-43c2-818b-482fb5bacfb8 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:12.640898 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1242c9-af5e-43c2-818b-482fb5bacfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:12.658541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-9b1242c9-af5e-43c2-818b-482fb5bacfb8 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:12.659739 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9b1242c9-af5e-43c2-818b-482fb5bacfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:12.667736 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1225/2464] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:12.671801 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6334079-0200-4af7-8db7-6cd3ac846c8c None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:12.681920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6334079-0200-4af7-8db7-6cd3ac846c8c None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:12.686474 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e952eb-4981-4118-b1ae-edbda0b71317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:12.687124 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e952eb-4981-4118-b1ae-edbda0b71317 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:12.687409 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e952eb-4981-4118-b1ae-edbda0b71317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:12.687683 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e952eb-4981-4118-b1ae-edbda0b71317 admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:12.688433 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e952eb-4981-4118-b1ae-edbda0b71317 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:40:12.688768 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e952eb-4981-4118-b1ae-edbda0b71317 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:12.690379 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e952eb-4981-4118-b1ae-edbda0b71317 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:12.702166 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1240/2465] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:40:12.706633 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1242c9-af5e-43c2-818b-482fb5bacfb8 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:12.715729 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1242c9-af5e-43c2-818b-482fb5bacfb8 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:12.720241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd6058-30c9-49cb-8022-6f798d0501d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:12.720901 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd6058-30c9-49cb-8022-6f798d0501d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:12.721179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd6058-30c9-49cb-8022-6f798d0501d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:12.721449 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd6058-30c9-49cb-8022-6f798d0501d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:12.722153 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd6058-30c9-49cb-8022-6f798d0501d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:12.724027 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd6058-30c9-49cb-8022-6f798d0501d9 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:12.748860 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1226/2466] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:12 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:12.752842 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e952eb-4981-4118-b1ae-edbda0b71317 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:12.763243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e952eb-4981-4118-b1ae-edbda0b71317 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:12.817725 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f13987-ee37-4fa4-8c23-13be0563dc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:12.818388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f13987-ee37-4fa4-8c23-13be0563dc3d admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:12.818663 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f13987-ee37-4fa4-8c23-13be0563dc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:12.818936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f13987-ee37-4fa4-8c23-13be0563dc3d admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:12.819653 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f13987-ee37-4fa4-8c23-13be0563dc3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:12.821578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f13987-ee37-4fa4-8c23-13be0563dc3d admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:12.840191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1241/2467] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:12 2022] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:12.844357 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd6058-30c9-49cb-8022-6f798d0501d9 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:12.855252 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd6058-30c9-49cb-8022-6f798d0501d9 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:12.859829 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77127c-c847-472c-a3d0-765081ec8ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:12.860502 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77127c-c847-472c-a3d0-765081ec8ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:12.860809 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77127c-c847-472c-a3d0-765081ec8ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:12.861085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77127c-c847-472c-a3d0-765081ec8ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:12.861805 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77127c-c847-472c-a3d0-765081ec8ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:12.864021 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77127c-c847-472c-a3d0-765081ec8ff2 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:12.875301 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1227/2468] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:12.879140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f13987-ee37-4fa4-8c23-13be0563dc3d admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:12.888687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f13987-ee37-4fa4-8c23-13be0563dc3d admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:12.893263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef87cbd-504a-4bfb-bf36-ad02de5bbc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:12.893899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef87cbd-504a-4bfb-bf36-ad02de5bbc14 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:12.894175 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef87cbd-504a-4bfb-bf36-ad02de5bbc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:12.894471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef87cbd-504a-4bfb-bf36-ad02de5bbc14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:12.895188 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef87cbd-504a-4bfb-bf36-ad02de5bbc14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:12.896800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef87cbd-504a-4bfb-bf36-ad02de5bbc14 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:12.906407 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1242/2469] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:12.910670 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77127c-c847-472c-a3d0-765081ec8ff2 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:12.920277 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77127c-c847-472c-a3d0-765081ec8ff2 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:12.925084 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4ddc6-34c1-4d55-9245-852a3365c21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:12.926740 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4ddc6-34c1-4d55-9245-852a3365c21e admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:12.927132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4ddc6-34c1-4d55-9245-852a3365c21e admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:12.927414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4ddc6-34c1-4d55-9245-852a3365c21e admin admin] PATH_INFO: `/v3/projects/084fa7015570448a9133c9edc2a1c851/users/7d264fd16cca4622996f8fadcbb6a845/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:12.941132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4ddc6-34c1-4d55-9245-852a3365c21e admin admin] RBAC: Authorizing `identity:create_grant(project_id=084fa7015570448a9133c9edc2a1c851, user_id=7d264fd16cca4622996f8fadcbb6a845, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:12.943792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4ddc6-34c1-4d55-9245-852a3365c21e admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:12.956034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1228/2470] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:12 2022] PUT /identity/v3/projects/084fa7015570448a9133c9edc2a1c851/users/7d264fd16cca4622996f8fadcbb6a845/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:12.966216 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ce3dd-3f7a-41ee-ba23-6f0d9d57e773 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:12.966446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ce3dd-3f7a-41ee-ba23-6f0d9d57e773 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:12.966723 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ce3dd-3f7a-41ee-ba23-6f0d9d57e773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:12.992726 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-f13ce3dd-3f7a-41ee-ba23-6f0d9d57e773 None None] MFA Rules not processed for user `7d264fd16cca4622996f8fadcbb6a845`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:12.995494 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-f13ce3dd-3f7a-41ee-ba23-6f0d9d57e773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:13.062814 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1243/2471] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:13.067882 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4ddc6-34c1-4d55-9245-852a3365c21e admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:13.126606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4ddc6-34c1-4d55-9245-852a3365c21e admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:13.131731 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda0655-31d7-418f-b6c2-1983754af8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:13.132368 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda0655-31d7-418f-b6c2-1983754af8d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:13.132686 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda0655-31d7-418f-b6c2-1983754af8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:13.132959 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda0655-31d7-418f-b6c2-1983754af8d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:13.133628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda0655-31d7-418f-b6c2-1983754af8d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:13.135530 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda0655-31d7-418f-b6c2-1983754af8d6 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:13.159790 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1229/2472] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:13 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:13.163892 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ce3dd-3f7a-41ee-ba23-6f0d9d57e773 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:13.174336 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ce3dd-3f7a-41ee-ba23-6f0d9d57e773 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:13.231216 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da803a71-41b5-4d90-9bf3-0bd34583dd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:13.231819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da803a71-41b5-4d90-9bf3-0bd34583dd35 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:13.232096 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da803a71-41b5-4d90-9bf3-0bd34583dd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:13.232365 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da803a71-41b5-4d90-9bf3-0bd34583dd35 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:13.233249 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da803a71-41b5-4d90-9bf3-0bd34583dd35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:13.235302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da803a71-41b5-4d90-9bf3-0bd34583dd35 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:13.254284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1244/2473] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:13 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:13.258344 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda0655-31d7-418f-b6c2-1983754af8d6 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:13.268186 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda0655-31d7-418f-b6c2-1983754af8d6 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:13.273256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2081c-d2a4-475f-9437-4aa41b947ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:13.273961 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2081c-d2a4-475f-9437-4aa41b947ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:13.274240 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2081c-d2a4-475f-9437-4aa41b947ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:13.274510 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2081c-d2a4-475f-9437-4aa41b947ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:13.275222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2081c-d2a4-475f-9437-4aa41b947ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:13.276834 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2081c-d2a4-475f-9437-4aa41b947ed9 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:13.287397 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1230/2474] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:13.291506 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da803a71-41b5-4d90-9bf3-0bd34583dd35 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:13.301723 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da803a71-41b5-4d90-9bf3-0bd34583dd35 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:13.306443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecfeba-d617-4f30-89cd-727ae71134c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:13.307385 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecfeba-d617-4f30-89cd-727ae71134c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:13.307687 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecfeba-d617-4f30-89cd-727ae71134c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:13.307998 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecfeba-d617-4f30-89cd-727ae71134c5 admin admin] PATH_INFO: `/v3/projects/57437bb58bd54af58ac479516a672737/users/4b286c9fbf96454ca7235d755f73d8da/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:13.322307 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecfeba-d617-4f30-89cd-727ae71134c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57437bb58bd54af58ac479516a672737, user_id=4b286c9fbf96454ca7235d755f73d8da, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:13.325025 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecfeba-d617-4f30-89cd-727ae71134c5 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:13.338564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1245/2475] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:13 2022] PUT /identity/v3/projects/57437bb58bd54af58ac479516a672737/users/4b286c9fbf96454ca7235d755f73d8da/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:13.342520 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2081c-d2a4-475f-9437-4aa41b947ed9 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:13.354008 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2081c-d2a4-475f-9437-4aa41b947ed9 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:13.407018 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff3409-265c-44c6-abac-c19889706397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:13.407901 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff3409-265c-44c6-abac-c19889706397 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:13.408187 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff3409-265c-44c6-abac-c19889706397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:13.408497 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff3409-265c-44c6-abac-c19889706397 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:13.409398 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff3409-265c-44c6-abac-c19889706397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:13.411979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff3409-265c-44c6-abac-c19889706397 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:13.425011 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1231/2476] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:40:13.426065 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecfeba-d617-4f30-89cd-727ae71134c5 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:13.436317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecfeba-d617-4f30-89cd-727ae71134c5 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:13.441445 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f74236-e387-410a-8407-d842775f467d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:13.442319 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f74236-e387-410a-8407-d842775f467d admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:13.442596 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f74236-e387-410a-8407-d842775f467d admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:13.442868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f74236-e387-410a-8407-d842775f467d admin admin] PATH_INFO: `/v3/projects/57437bb58bd54af58ac479516a672737/users/4b286c9fbf96454ca7235d755f73d8da/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:13.444891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f74236-e387-410a-8407-d842775f467d admin admin] RBAC: Authorizing `identity:create_grant(project_id=57437bb58bd54af58ac479516a672737, user_id=4b286c9fbf96454ca7235d755f73d8da, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:13.447528 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f74236-e387-410a-8407-d842775f467d admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:13.458403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1246/2477] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:13 2022] PUT /identity/v3/projects/57437bb58bd54af58ac479516a672737/users/4b286c9fbf96454ca7235d755f73d8da/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:13.469558 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad2bc2-2ab4-4c35-8ece-e552e62d919a None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:13.469855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad2bc2-2ab4-4c35-8ece-e552e62d919a None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:13.470123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad2bc2-2ab4-4c35-8ece-e552e62d919a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:13.497458 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-1fad2bc2-2ab4-4c35-8ece-e552e62d919a None None] MFA Rules not processed for user `4b286c9fbf96454ca7235d755f73d8da`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:13.499024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-1fad2bc2-2ab4-4c35-8ece-e552e62d919a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:13.572040 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1232/2478] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:13.583332 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f74236-e387-410a-8407-d842775f467d admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:13.585081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-e0f74236-e387-410a-8407-d842775f467d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:13.650335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f74236-e387-410a-8407-d842775f467d admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:13.655301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0013969-6f49-4aa5-b19c-e07219dd994a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:13.656027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0013969-6f49-4aa5-b19c-e07219dd994a service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:13.656309 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0013969-6f49-4aa5-b19c-e07219dd994a service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:13.656637 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0013969-6f49-4aa5-b19c-e07219dd994a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:13.666582 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0013969-6f49-4aa5-b19c-e07219dd994a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:13.668177 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0013969-6f49-4aa5-b19c-e07219dd994a service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:13.681470 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1247/2479] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:13.751001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad2bc2-2ab4-4c35-8ece-e552e62d919a None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:13.760251 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad2bc2-2ab4-4c35-8ece-e552e62d919a None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:13.763800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee70e2f-46c8-479f-95b5-adc14d15f8a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:13.764417 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee70e2f-46c8-479f-95b5-adc14d15f8a3 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:13.764730 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee70e2f-46c8-479f-95b5-adc14d15f8a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:13.765000 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee70e2f-46c8-479f-95b5-adc14d15f8a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:13.819772 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee70e2f-46c8-479f-95b5-adc14d15f8a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:13.821226 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee70e2f-46c8-479f-95b5-adc14d15f8a3 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:13.830010 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1233/2480] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:14.773285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0013969-6f49-4aa5-b19c-e07219dd994a service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:14.774745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-a0013969-6f49-4aa5-b19c-e07219dd994a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:14.828619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0013969-6f49-4aa5-b19c-e07219dd994a service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:14.832680 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b7636-8718-4f8e-961d-6217d7d8a66a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:14.833328 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b7636-8718-4f8e-961d-6217d7d8a66a service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:14.833609 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b7636-8718-4f8e-961d-6217d7d8a66a service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:14.833880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b7636-8718-4f8e-961d-6217d7d8a66a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:14.835618 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-2e4b7636-8718-4f8e-961d-6217d7d8a66a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:14.895348 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b7636-8718-4f8e-961d-6217d7d8a66a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:14.896798 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b7636-8718-4f8e-961d-6217d7d8a66a service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:14.906183 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1248/2481] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:17.877083 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee70e2f-46c8-479f-95b5-adc14d15f8a3 service cinder] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:17.878645 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-bee70e2f-46c8-479f-95b5-adc14d15f8a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:17.901777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee70e2f-46c8-479f-95b5-adc14d15f8a3 service cinder] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:17.915793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fb574-dcf6-45d5-b469-c7f1d9958477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:17.916729 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fb574-dcf6-45d5-b469-c7f1d9958477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:17.917011 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fb574-dcf6-45d5-b469-c7f1d9958477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:17.917281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fb574-dcf6-45d5-b469-c7f1d9958477 admin admin] PATH_INFO: `/v3/users/d9fff6faa4cd424fb86378738e54d6fd` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:17.918848 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376fb574-dcf6-45d5-b469-c7f1d9958477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9fff6faa4cd424fb86378738e54d6fd)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:17.921155 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376fb574-dcf6-45d5-b469-c7f1d9958477 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:17.971918 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-376fb574-dcf6-45d5-b469-c7f1d9958477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9fff6faa4cd424fb86378738e54d6fd'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:17.980082 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-376fb574-dcf6-45d5-b469-c7f1d9958477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9fff6faa4cd424fb86378738e54d6fd'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:17.988292 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-376fb574-dcf6-45d5-b469-c7f1d9958477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9fff6faa4cd424fb86378738e54d6fd'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:17.989111 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-376fb574-dcf6-45d5-b469-c7f1d9958477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9fff6faa4cd424fb86378738e54d6fd'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:17.989713 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-376fb574-dcf6-45d5-b469-c7f1d9958477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9fff6faa4cd424fb86378738e54d6fd'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:18.008170 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1234/2482] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:17 2022] DELETE /identity/v3/users/d9fff6faa4cd424fb86378738e54d6fd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:18.183550 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b7636-8718-4f8e-961d-6217d7d8a66a service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:18.196905 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b7636-8718-4f8e-961d-6217d7d8a66a service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:18.259617 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3fb0b-49a4-4790-b6d7-8157d04b88f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:18.260477 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3fb0b-49a4-4790-b6d7-8157d04b88f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:18.260778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3fb0b-49a4-4790-b6d7-8157d04b88f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:18.261053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3fb0b-49a4-4790-b6d7-8157d04b88f7 admin admin] PATH_INFO: `/v3/projects/1db8614122ac4e068e093b3ee4dc9c0a` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:18.262227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3fb0b-49a4-4790-b6d7-8157d04b88f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db8614122ac4e068e093b3ee4dc9c0a)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:18.264201 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3fb0b-49a4-4790-b6d7-8157d04b88f7 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:18.308202 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2de3fb0b-49a4-4790-b6d7-8157d04b88f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db8614122ac4e068e093b3ee4dc9c0a', 'request_id': 'req-2de3fb0b-49a4-4790-b6d7-8157d04b88f7'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:18.314094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2de3fb0b-49a4-4790-b6d7-8157d04b88f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db8614122ac4e068e093b3ee4dc9c0a', 'request_id': 'req-2de3fb0b-49a4-4790-b6d7-8157d04b88f7'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:18.319877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2de3fb0b-49a4-4790-b6d7-8157d04b88f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db8614122ac4e068e093b3ee4dc9c0a', 'request_id': 'req-2de3fb0b-49a4-4790-b6d7-8157d04b88f7'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:18.333411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2de3fb0b-49a4-4790-b6d7-8157d04b88f7 admin admin] The token cache is being invalidate because project 1db8614122ac4e068e093b3ee4dc9c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:18.333688 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2de3fb0b-49a4-4790-b6d7-8157d04b88f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:18.334298 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2de3fb0b-49a4-4790-b6d7-8157d04b88f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:18.335828 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1249/2483] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:18 2022] DELETE /identity/v3/projects/1db8614122ac4e068e093b3ee4dc9c0a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:18.340777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a0758-d623-4ada-ac4b-2ce89d2619e4 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:18.341070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a0758-d623-4ada-ac4b-2ce89d2619e4 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:18.341352 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a0758-d623-4ada-ac4b-2ce89d2619e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:18.358618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-c66a0758-d623-4ada-ac4b-2ce89d2619e4 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:18.359805 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c66a0758-d623-4ada-ac4b-2ce89d2619e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:18.432665 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1235/2484] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:18.440341 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98361d93-944e-4d55-bf4a-08b76911c1e8 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:18.440685 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98361d93-944e-4d55-bf4a-08b76911c1e8 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:18.441545 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98361d93-944e-4d55-bf4a-08b76911c1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:18.461080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-98361d93-944e-4d55-bf4a-08b76911c1e8 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:18.462389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-98361d93-944e-4d55-bf4a-08b76911c1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:18.470875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1250/2485] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:18.475135 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a0758-d623-4ada-ac4b-2ce89d2619e4 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:18.485117 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a0758-d623-4ada-ac4b-2ce89d2619e4 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:18.490223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450c98b-767d-4cfc-af16-73b8df6b203c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:18.490867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450c98b-767d-4cfc-af16-73b8df6b203c admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:18.491152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450c98b-767d-4cfc-af16-73b8df6b203c admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:18.491427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450c98b-767d-4cfc-af16-73b8df6b203c admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:18.492149 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450c98b-767d-4cfc-af16-73b8df6b203c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:40:18.492456 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450c98b-767d-4cfc-af16-73b8df6b203c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:18.494112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450c98b-767d-4cfc-af16-73b8df6b203c admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:18.506945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1236/2486] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:40:18.510352 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98361d93-944e-4d55-bf4a-08b76911c1e8 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:18.519645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98361d93-944e-4d55-bf4a-08b76911c1e8 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:18.524324 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca933a82-6e07-4d10-9a14-d250ccfa4f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:18.525115 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca933a82-6e07-4d10-9a14-d250ccfa4f27 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:18.525394 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca933a82-6e07-4d10-9a14-d250ccfa4f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:18.525663 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca933a82-6e07-4d10-9a14-d250ccfa4f27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:18.526354 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca933a82-6e07-4d10-9a14-d250ccfa4f27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:18.528247 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca933a82-6e07-4d10-9a14-d250ccfa4f27 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:18.553401 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1251/2487] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:18 2022] POST /identity/v3/projects => generated 367 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:18.557643 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450c98b-767d-4cfc-af16-73b8df6b203c admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:18.567973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450c98b-767d-4cfc-af16-73b8df6b203c admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:18.621410 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c57ee2-6293-426e-9d7d-7cec1e9b5846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:18.622051 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c57ee2-6293-426e-9d7d-7cec1e9b5846 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:18.622327 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c57ee2-6293-426e-9d7d-7cec1e9b5846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:18.622596 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c57ee2-6293-426e-9d7d-7cec1e9b5846 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:18.623279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c57ee2-6293-426e-9d7d-7cec1e9b5846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:18.625224 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c57ee2-6293-426e-9d7d-7cec1e9b5846 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:18.644598 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1237/2488] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:18 2022] POST /identity/v3/users => generated 284 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:18.648494 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca933a82-6e07-4d10-9a14-d250ccfa4f27 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:18.658607 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca933a82-6e07-4d10-9a14-d250ccfa4f27 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:18.663169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880b6ca-635a-4ec3-b332-4889528fadbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:18.663812 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880b6ca-635a-4ec3-b332-4889528fadbc admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:18.664091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880b6ca-635a-4ec3-b332-4889528fadbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:18.664362 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880b6ca-635a-4ec3-b332-4889528fadbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:18.665116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880b6ca-635a-4ec3-b332-4889528fadbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:18.666707 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880b6ca-635a-4ec3-b332-4889528fadbc admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:18.678440 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1252/2489] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:18.682257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c57ee2-6293-426e-9d7d-7cec1e9b5846 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:18.692753 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c57ee2-6293-426e-9d7d-7cec1e9b5846 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:18.697307 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ce839-1a43-4d20-ad12-5ae135079605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:18.697953 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ce839-1a43-4d20-ad12-5ae135079605 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:18.698235 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ce839-1a43-4d20-ad12-5ae135079605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:18.698536 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ce839-1a43-4d20-ad12-5ae135079605 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:18.699275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ce839-1a43-4d20-ad12-5ae135079605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:18.700921 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ce839-1a43-4d20-ad12-5ae135079605 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:18.710615 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1238/2490] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:40:18.714526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880b6ca-635a-4ec3-b332-4889528fadbc admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:18.724349 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880b6ca-635a-4ec3-b332-4889528fadbc admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:18.729094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da82ea-de67-4f8a-b696-033a977ba8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:18.729945 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da82ea-de67-4f8a-b696-033a977ba8b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:18.730219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da82ea-de67-4f8a-b696-033a977ba8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:18.730488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da82ea-de67-4f8a-b696-033a977ba8b9 admin admin] PATH_INFO: `/v3/projects/6b653227f15742b28b8f87863772d94d/users/f8ec33f30b274c2d933fc03f3f5ddb39/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:18.746415 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da82ea-de67-4f8a-b696-033a977ba8b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b653227f15742b28b8f87863772d94d, user_id=f8ec33f30b274c2d933fc03f3f5ddb39, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:18.749208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da82ea-de67-4f8a-b696-033a977ba8b9 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:18.763532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1253/2491] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:18 2022] PUT /identity/v3/projects/6b653227f15742b28b8f87863772d94d/users/f8ec33f30b274c2d933fc03f3f5ddb39/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:18.774047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f31227-0d2f-48b7-af51-4062cda02346 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:18.774334 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f31227-0d2f-48b7-af51-4062cda02346 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:18.774612 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f31227-0d2f-48b7-af51-4062cda02346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:18.801232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-f7f31227-0d2f-48b7-af51-4062cda02346 None None] MFA Rules not processed for user `f8ec33f30b274c2d933fc03f3f5ddb39`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:18.802429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f7f31227-0d2f-48b7-af51-4062cda02346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:18.866013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1239/2492] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:18.876582 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da82ea-de67-4f8a-b696-033a977ba8b9 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:18.878378 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c5da82ea-de67-4f8a-b696-033a977ba8b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:18.934081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da82ea-de67-4f8a-b696-033a977ba8b9 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:18.937719 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7e38e-93b7-4c91-98da-1647d7fc0a2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:18.938361 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7e38e-93b7-4c91-98da-1647d7fc0a2e service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:18.938644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7e38e-93b7-4c91-98da-1647d7fc0a2e service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:18.938917 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7e38e-93b7-4c91-98da-1647d7fc0a2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:18.947039 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7e38e-93b7-4c91-98da-1647d7fc0a2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:18.948461 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7e38e-93b7-4c91-98da-1647d7fc0a2e service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:18.957059 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1254/2493] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:23.626044 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f31227-0d2f-48b7-af51-4062cda02346 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:23.627469 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f7f31227-0d2f-48b7-af51-4062cda02346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:23.691948 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f31227-0d2f-48b7-af51-4062cda02346 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:23.696995 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f480e82-b48b-418f-87b8-5a7a577c19b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:23.697846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f480e82-b48b-418f-87b8-5a7a577c19b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:23.698124 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f480e82-b48b-418f-87b8-5a7a577c19b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:23.698396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f480e82-b48b-418f-87b8-5a7a577c19b9 admin admin] PATH_INFO: `/v3/users/7d264fd16cca4622996f8fadcbb6a845` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:23.699572 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f480e82-b48b-418f-87b8-5a7a577c19b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d264fd16cca4622996f8fadcbb6a845)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:23.701519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f480e82-b48b-418f-87b8-5a7a577c19b9 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:23.749537 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-9f480e82-b48b-418f-87b8-5a7a577c19b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d264fd16cca4622996f8fadcbb6a845'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:23.759981 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-9f480e82-b48b-418f-87b8-5a7a577c19b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d264fd16cca4622996f8fadcbb6a845'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:23.761381 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7e38e-93b7-4c91-98da-1647d7fc0a2e service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:23.763773 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-82d7e38e-93b7-4c91-98da-1647d7fc0a2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:23.766411 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-9f480e82-b48b-418f-87b8-5a7a577c19b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d264fd16cca4622996f8fadcbb6a845'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:23.767116 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-9f480e82-b48b-418f-87b8-5a7a577c19b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d264fd16cca4622996f8fadcbb6a845'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:23.767748 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-9f480e82-b48b-418f-87b8-5a7a577c19b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d264fd16cca4622996f8fadcbb6a845'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:23.778197 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7e38e-93b7-4c91-98da-1647d7fc0a2e service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:23.783243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72c40d-f4f1-42fd-9b19-1de035b5efde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:23.784207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72c40d-f4f1-42fd-9b19-1de035b5efde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:23.784625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72c40d-f4f1-42fd-9b19-1de035b5efde admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:23.785000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72c40d-f4f1-42fd-9b19-1de035b5efde admin admin] PATH_INFO: `/v3/users/f3c8a5c7dc2941d3a117789589ea9b04` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:23.786117 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1240/2494] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:23 2022] DELETE /identity/v3/users/7d264fd16cca4622996f8fadcbb6a845 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:23.786403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72c40d-f4f1-42fd-9b19-1de035b5efde admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3c8a5c7dc2941d3a117789589ea9b04)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:23.788432 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72c40d-f4f1-42fd-9b19-1de035b5efde admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:23.790654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334555f6-2458-424b-a6f4-77aaa308cb0f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:23.791336 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334555f6-2458-424b-a6f4-77aaa308cb0f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:23.791617 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334555f6-2458-424b-a6f4-77aaa308cb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:23.811192 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-334555f6-2458-424b-a6f4-77aaa308cb0f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:23.812400 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-334555f6-2458-424b-a6f4-77aaa308cb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:23.845821 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-8c72c40d-f4f1-42fd-9b19-1de035b5efde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3c8a5c7dc2941d3a117789589ea9b04'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:23.851437 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-8c72c40d-f4f1-42fd-9b19-1de035b5efde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3c8a5c7dc2941d3a117789589ea9b04'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:23.852648 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-8c72c40d-f4f1-42fd-9b19-1de035b5efde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3c8a5c7dc2941d3a117789589ea9b04'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:23.862321 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-8c72c40d-f4f1-42fd-9b19-1de035b5efde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3c8a5c7dc2941d3a117789589ea9b04'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:23.862982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-8c72c40d-f4f1-42fd-9b19-1de035b5efde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3c8a5c7dc2941d3a117789589ea9b04'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:23.882404 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1255/2495] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:23 2022] DELETE /identity/v3/users/f3c8a5c7dc2941d3a117789589ea9b04 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:23.887104 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a3da4-259b-4b2b-9055-df7ce679dbef None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:23.887579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a3da4-259b-4b2b-9055-df7ce679dbef None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:23.887934 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a3da4-259b-4b2b-9055-df7ce679dbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:23.892471 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1241/2496] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:23.899665 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334555f6-2458-424b-a6f4-77aaa308cb0f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:23.901178 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-334555f6-2458-424b-a6f4-77aaa308cb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:23.907831 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-206a3da4-259b-4b2b-9055-df7ce679dbef None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:23.909395 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-206a3da4-259b-4b2b-9055-df7ce679dbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:23.964365 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334555f6-2458-424b-a6f4-77aaa308cb0f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:23.970858 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1256/2497] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:23.983065 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a3da4-259b-4b2b-9055-df7ce679dbef None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:23.984502 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-206a3da4-259b-4b2b-9055-df7ce679dbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:24.021504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ce0fc-70a0-4cf3-bbc0-3ff0907115a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:24.022389 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ce0fc-70a0-4cf3-bbc0-3ff0907115a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:24.022786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ce0fc-70a0-4cf3-bbc0-3ff0907115a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:24.023162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ce0fc-70a0-4cf3-bbc0-3ff0907115a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:24.033681 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ce0fc-70a0-4cf3-bbc0-3ff0907115a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:24.035213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ce0fc-70a0-4cf3-bbc0-3ff0907115a8 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:24.045837 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1242/2498] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:40:24.047112 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a3da4-259b-4b2b-9055-df7ce679dbef None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:24.050887 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a115e-ad95-42bc-86a8-c2ce8ec8fd8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:24.051537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a115e-ad95-42bc-86a8-c2ce8ec8fd8e service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:24.051820 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a115e-ad95-42bc-86a8-c2ce8ec8fd8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:24.052123 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a115e-ad95-42bc-86a8-c2ce8ec8fd8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:24.062461 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a115e-ad95-42bc-86a8-c2ce8ec8fd8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:24.063997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a115e-ad95-42bc-86a8-c2ce8ec8fd8e service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:24.074304 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1257/2499] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:24.361569 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ce0fc-70a0-4cf3-bbc0-3ff0907115a8 service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:24.363557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-2c0ce0fc-70a0-4cf3-bbc0-3ff0907115a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:24.377545 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ce0fc-70a0-4cf3-bbc0-3ff0907115a8 service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:24.386026 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14337072-5f60-4123-a69e-edf75d82061c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:24.386191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a115e-ad95-42bc-86a8-c2ce8ec8fd8e service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:24.387062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14337072-5f60-4123-a69e-edf75d82061c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:24.387425 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14337072-5f60-4123-a69e-edf75d82061c admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:24.387542 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-5b4a115e-ad95-42bc-86a8-c2ce8ec8fd8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:24.388345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14337072-5f60-4123-a69e-edf75d82061c admin admin] PATH_INFO: `/v3/projects/084fa7015570448a9133c9edc2a1c851` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:24.389890 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14337072-5f60-4123-a69e-edf75d82061c admin admin] RBAC: Authorizing `identity:delete_project(project_id=084fa7015570448a9133c9edc2a1c851)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:24.392065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14337072-5f60-4123-a69e-edf75d82061c admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:24.402754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a115e-ad95-42bc-86a8-c2ce8ec8fd8e service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:24.409789 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854179dc-07ef-4399-9832-5d2f5ef98a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:24.410573 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854179dc-07ef-4399-9832-5d2f5ef98a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:24.410907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854179dc-07ef-4399-9832-5d2f5ef98a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:24.411167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854179dc-07ef-4399-9832-5d2f5ef98a0d admin admin] PATH_INFO: `/v3/projects/34abecb06da4488592d85838fbfa7eef` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:24.413310 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854179dc-07ef-4399-9832-5d2f5ef98a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=34abecb06da4488592d85838fbfa7eef)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:24.415544 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854179dc-07ef-4399-9832-5d2f5ef98a0d admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:24.447197 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-14337072-5f60-4123-a69e-edf75d82061c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '084fa7015570448a9133c9edc2a1c851', 'request_id': 'req-14337072-5f60-4123-a69e-edf75d82061c'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:24.453241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-14337072-5f60-4123-a69e-edf75d82061c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '084fa7015570448a9133c9edc2a1c851', 'request_id': 'req-14337072-5f60-4123-a69e-edf75d82061c'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:24.458570 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-14337072-5f60-4123-a69e-edf75d82061c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '084fa7015570448a9133c9edc2a1c851', 'request_id': 'req-14337072-5f60-4123-a69e-edf75d82061c'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:24.461677 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-854179dc-07ef-4399-9832-5d2f5ef98a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34abecb06da4488592d85838fbfa7eef', 'request_id': 'req-854179dc-07ef-4399-9832-5d2f5ef98a0d'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:24.468293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-854179dc-07ef-4399-9832-5d2f5ef98a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34abecb06da4488592d85838fbfa7eef', 'request_id': 'req-854179dc-07ef-4399-9832-5d2f5ef98a0d'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:24.471242 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-14337072-5f60-4123-a69e-edf75d82061c admin admin] The token cache is being invalidate because project 084fa7015570448a9133c9edc2a1c851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:24.471528 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-14337072-5f60-4123-a69e-edf75d82061c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:24.472131 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-14337072-5f60-4123-a69e-edf75d82061c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:24.473785 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1243/2500] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:24 2022] DELETE /identity/v3/projects/084fa7015570448a9133c9edc2a1c851 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:24.474117 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-854179dc-07ef-4399-9832-5d2f5ef98a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34abecb06da4488592d85838fbfa7eef', 'request_id': 'req-854179dc-07ef-4399-9832-5d2f5ef98a0d'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:24.478487 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14337072-5f60-4123-a69e-edf75d82061c admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:24.479930 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-14337072-5f60-4123-a69e-edf75d82061c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:24.486900 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-854179dc-07ef-4399-9832-5d2f5ef98a0d admin admin] The token cache is being invalidate because project 34abecb06da4488592d85838fbfa7eef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:24.487127 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-854179dc-07ef-4399-9832-5d2f5ef98a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:24.487758 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-854179dc-07ef-4399-9832-5d2f5ef98a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:24.489594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1258/2501] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:24 2022] DELETE /identity/v3/projects/34abecb06da4488592d85838fbfa7eef => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:24.493960 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2ce1e-2a4e-4976-8354-17df3a4e2763 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:24.494242 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2ce1e-2a4e-4976-8354-17df3a4e2763 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:24.494523 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2ce1e-2a4e-4976-8354-17df3a4e2763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:24.512562 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-f1e2ce1e-2a4e-4976-8354-17df3a4e2763 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:24.514451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-f1e2ce1e-2a4e-4976-8354-17df3a4e2763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:24.543449 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14337072-5f60-4123-a69e-edf75d82061c admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:24.575181 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1259/2502] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:24.583077 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdf1c1-087e-4a64-9e89-e4c6b0cb048c None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:24.583366 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdf1c1-087e-4a64-9e89-e4c6b0cb048c None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:24.583643 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdf1c1-087e-4a64-9e89-e4c6b0cb048c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:24.597422 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ee1bc-844e-45d3-bc91-a80658376d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:24.598285 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ee1bc-844e-45d3-bc91-a80658376d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:24.598562 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ee1bc-844e-45d3-bc91-a80658376d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:24.598833 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ee1bc-844e-45d3-bc91-a80658376d0b admin admin] PATH_INFO: `/v3/users/4b286c9fbf96454ca7235d755f73d8da` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:24.600633 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ee1bc-844e-45d3-bc91-a80658376d0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b286c9fbf96454ca7235d755f73d8da)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:24.602711 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-8fcdf1c1-087e-4a64-9e89-e4c6b0cb048c None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:24.602836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ee1bc-844e-45d3-bc91-a80658376d0b admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:24.603942 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-8fcdf1c1-087e-4a64-9e89-e4c6b0cb048c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:24.611768 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1260/2503] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:24.615978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdf1c1-087e-4a64-9e89-e4c6b0cb048c None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:24.624653 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdf1c1-087e-4a64-9e89-e4c6b0cb048c None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:24.629621 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccc59f-e935-4baa-a4e3-e056ec939858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:24.630334 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccc59f-e935-4baa-a4e3-e056ec939858 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:24.630615 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccc59f-e935-4baa-a4e3-e056ec939858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:24.630890 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccc59f-e935-4baa-a4e3-e056ec939858 admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:24.631623 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccc59f-e935-4baa-a4e3-e056ec939858 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:40:24.631983 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccc59f-e935-4baa-a4e3-e056ec939858 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:24.633853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccc59f-e935-4baa-a4e3-e056ec939858 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:24.645309 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1261/2504] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:40:24.648111 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cf9ee1bc-844e-45d3-bc91-a80658376d0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b286c9fbf96454ca7235d755f73d8da'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:24.649756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccc59f-e935-4baa-a4e3-e056ec939858 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:24.655774 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cf9ee1bc-844e-45d3-bc91-a80658376d0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b286c9fbf96454ca7235d755f73d8da'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:24.658825 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccc59f-e935-4baa-a4e3-e056ec939858 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:24.664778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168290fd-4a62-4e2c-bc91-b76adfefb7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:24.664965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cf9ee1bc-844e-45d3-bc91-a80658376d0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b286c9fbf96454ca7235d755f73d8da'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:24.665203 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168290fd-4a62-4e2c-bc91-b76adfefb7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:24.665490 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168290fd-4a62-4e2c-bc91-b76adfefb7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:24.665782 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168290fd-4a62-4e2c-bc91-b76adfefb7f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:24.666341 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cf9ee1bc-844e-45d3-bc91-a80658376d0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b286c9fbf96454ca7235d755f73d8da'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:24.666600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168290fd-4a62-4e2c-bc91-b76adfefb7f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:24.667497 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cf9ee1bc-844e-45d3-bc91-a80658376d0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b286c9fbf96454ca7235d755f73d8da'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:24.668588 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168290fd-4a62-4e2c-bc91-b76adfefb7f3 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:24.686243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1244/2505] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:24 2022] DELETE /identity/v3/users/4b286c9fbf96454ca7235d755f73d8da => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:24.704096 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1262/2506] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:24 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:24.708067 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ee1bc-844e-45d3-bc91-a80658376d0b admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:24.721398 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-cf9ee1bc-844e-45d3-bc91-a80658376d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:24.789466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ee1bc-844e-45d3-bc91-a80658376d0b admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:24.866455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb72816-0c7c-4ec6-a2b2-38a16e640436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:24.867140 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb72816-0c7c-4ec6-a2b2-38a16e640436 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:24.867421 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb72816-0c7c-4ec6-a2b2-38a16e640436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:24.867693 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb72816-0c7c-4ec6-a2b2-38a16e640436 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:24.868730 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb72816-0c7c-4ec6-a2b2-38a16e640436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:24.870625 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb72816-0c7c-4ec6-a2b2-38a16e640436 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:24.893234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1245/2507] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:24 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:24.896632 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168290fd-4a62-4e2c-bc91-b76adfefb7f3 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:24.908845 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168290fd-4a62-4e2c-bc91-b76adfefb7f3 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:24.914454 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e46cf2-b766-4383-a9c8-7f4e597a5249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:24.915429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e46cf2-b766-4383-a9c8-7f4e597a5249 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:24.915968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e46cf2-b766-4383-a9c8-7f4e597a5249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:24.916485 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e46cf2-b766-4383-a9c8-7f4e597a5249 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:24.917395 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e46cf2-b766-4383-a9c8-7f4e597a5249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:24.919454 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e46cf2-b766-4383-a9c8-7f4e597a5249 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:24.932988 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1263/2508] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:40:24.936732 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb72816-0c7c-4ec6-a2b2-38a16e640436 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:24.947641 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb72816-0c7c-4ec6-a2b2-38a16e640436 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:24.953089 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760e7fb-6ee8-41ad-a719-7fb00c1e4192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:24.953760 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760e7fb-6ee8-41ad-a719-7fb00c1e4192 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:24.954043 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760e7fb-6ee8-41ad-a719-7fb00c1e4192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:24.954317 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760e7fb-6ee8-41ad-a719-7fb00c1e4192 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:24.955581 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760e7fb-6ee8-41ad-a719-7fb00c1e4192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:24.957772 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760e7fb-6ee8-41ad-a719-7fb00c1e4192 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:24.970814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1246/2509] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:24.975468 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e46cf2-b766-4383-a9c8-7f4e597a5249 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:24.987265 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e46cf2-b766-4383-a9c8-7f4e597a5249 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:24.993457 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b0554-bf88-402f-a459-1cc7e9a3f0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:24.994429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b0554-bf88-402f-a459-1cc7e9a3f0ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:24.994806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b0554-bf88-402f-a459-1cc7e9a3f0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:24.995164 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b0554-bf88-402f-a459-1cc7e9a3f0ed admin admin] PATH_INFO: `/v3/projects/fbfdc805dcba4bbb8a0918f41c0d38c7/users/4404cebe9b304ede809878dfb26d5e66/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:24.999681 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760e7fb-6ee8-41ad-a719-7fb00c1e4192 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:25.001604 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f760e7fb-6ee8-41ad-a719-7fb00c1e4192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:25.023252 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760e7fb-6ee8-41ad-a719-7fb00c1e4192 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:25.033045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b0554-bf88-402f-a459-1cc7e9a3f0ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbfdc805dcba4bbb8a0918f41c0d38c7, user_id=4404cebe9b304ede809878dfb26d5e66, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:25.036010 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b0554-bf88-402f-a459-1cc7e9a3f0ed admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:25.037024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54bd1e-d372-4a44-b87a-a09c679ee2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:25.038032 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54bd1e-d372-4a44-b87a-a09c679ee2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:25.038317 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54bd1e-d372-4a44-b87a-a09c679ee2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:25.038594 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54bd1e-d372-4a44-b87a-a09c679ee2bc admin admin] PATH_INFO: `/v3/projects/57437bb58bd54af58ac479516a672737` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:25.039846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54bd1e-d372-4a44-b87a-a09c679ee2bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=57437bb58bd54af58ac479516a672737)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:25.042097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54bd1e-d372-4a44-b87a-a09c679ee2bc admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:25.051714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1264/2510] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:24 2022] PUT /identity/v3/projects/fbfdc805dcba4bbb8a0918f41c0d38c7/users/4404cebe9b304ede809878dfb26d5e66/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:25.056979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e278c-cd2e-4754-97ca-0437fdb8a007 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:25.057262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e278c-cd2e-4754-97ca-0437fdb8a007 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:25.057658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e278c-cd2e-4754-97ca-0437fdb8a007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:25.078896 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-8f9e278c-cd2e-4754-97ca-0437fdb8a007 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:25.080327 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-8f9e278c-cd2e-4754-97ca-0437fdb8a007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:25.093623 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cc54bd1e-d372-4a44-b87a-a09c679ee2bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57437bb58bd54af58ac479516a672737', 'request_id': 'req-cc54bd1e-d372-4a44-b87a-a09c679ee2bc'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:25.102023 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cc54bd1e-d372-4a44-b87a-a09c679ee2bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57437bb58bd54af58ac479516a672737', 'request_id': 'req-cc54bd1e-d372-4a44-b87a-a09c679ee2bc'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:25.109495 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cc54bd1e-d372-4a44-b87a-a09c679ee2bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57437bb58bd54af58ac479516a672737', 'request_id': 'req-cc54bd1e-d372-4a44-b87a-a09c679ee2bc'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:25.128072 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cc54bd1e-d372-4a44-b87a-a09c679ee2bc admin admin] The token cache is being invalidate because project 57437bb58bd54af58ac479516a672737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:25.128267 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cc54bd1e-d372-4a44-b87a-a09c679ee2bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:25.129006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cc54bd1e-d372-4a44-b87a-a09c679ee2bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:25.131362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1247/2511] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:24 2022] DELETE /identity/v3/projects/57437bb58bd54af58ac479516a672737 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:25.136904 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc9734-16d8-4fbd-b471-bee0c1c68ff7 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:25.137257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc9734-16d8-4fbd-b471-bee0c1c68ff7 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:25.137600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc9734-16d8-4fbd-b471-bee0c1c68ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:25.163868 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-8adc9734-16d8-4fbd-b471-bee0c1c68ff7 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:25.165193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-8adc9734-16d8-4fbd-b471-bee0c1c68ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:25.179681 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1265/2512] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:25.193211 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e278c-cd2e-4754-97ca-0437fdb8a007 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:25.195511 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-8f9e278c-cd2e-4754-97ca-0437fdb8a007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:25.247518 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1248/2513] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:25.248197 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab9d86-557a-44bb-8919-34bf426ba4bd None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:25.248496 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab9d86-557a-44bb-8919-34bf426ba4bd None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:25.248805 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab9d86-557a-44bb-8919-34bf426ba4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:25.264403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e278c-cd2e-4754-97ca-0437fdb8a007 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:25.266836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-1bab9d86-557a-44bb-8919-34bf426ba4bd None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:25.268142 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-1bab9d86-557a-44bb-8919-34bf426ba4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:25.268497 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c10b3-1e4c-4ba5-ac48-4a60b3857d97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:25.269213 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c10b3-1e4c-4ba5-ac48-4a60b3857d97 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:25.269490 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c10b3-1e4c-4ba5-ac48-4a60b3857d97 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:25.269765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c10b3-1e4c-4ba5-ac48-4a60b3857d97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:25.278378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1249/2514] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:25.281493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c10b3-1e4c-4ba5-ac48-4a60b3857d97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:25.282452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab9d86-557a-44bb-8919-34bf426ba4bd None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:25.282929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c10b3-1e4c-4ba5-ac48-4a60b3857d97 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:25.292019 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab9d86-557a-44bb-8919-34bf426ba4bd None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:25.293783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1266/2515] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:40:25.296771 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0176f4-2de6-4091-a076-18169c426877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:25.297439 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0176f4-2de6-4091-a076-18169c426877 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:25.297715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0176f4-2de6-4091-a076-18169c426877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:25.298011 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0176f4-2de6-4091-a076-18169c426877 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:25.298746 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0176f4-2de6-4091-a076-18169c426877 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:40:25.299046 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0176f4-2de6-4091-a076-18169c426877 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:25.300671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0176f4-2de6-4091-a076-18169c426877 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:25.312415 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1250/2516] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:40:25.316698 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c10b3-1e4c-4ba5-ac48-4a60b3857d97 service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:25.327364 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c10b3-1e4c-4ba5-ac48-4a60b3857d97 service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:25.331965 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db590bec-6f5f-4c39-b50c-1b7e1eefd21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:25.332651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db590bec-6f5f-4c39-b50c-1b7e1eefd21b admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:25.332939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db590bec-6f5f-4c39-b50c-1b7e1eefd21b admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:25.333219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db590bec-6f5f-4c39-b50c-1b7e1eefd21b admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:25.333927 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db590bec-6f5f-4c39-b50c-1b7e1eefd21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:25.336375 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db590bec-6f5f-4c39-b50c-1b7e1eefd21b admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:25.364022 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1267/2517] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:25 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:25.368274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0176f4-2de6-4091-a076-18169c426877 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:25.378193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0176f4-2de6-4091-a076-18169c426877 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:25.441258 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28398a-bf15-4e58-9b10-09004f814cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:25.441965 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28398a-bf15-4e58-9b10-09004f814cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:25.442250 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28398a-bf15-4e58-9b10-09004f814cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:25.442531 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28398a-bf15-4e58-9b10-09004f814cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:25.443242 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28398a-bf15-4e58-9b10-09004f814cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:25.446391 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28398a-bf15-4e58-9b10-09004f814cf3 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:25.473308 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1251/2518] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:25 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:25.478910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db590bec-6f5f-4c39-b50c-1b7e1eefd21b admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:25.490016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db590bec-6f5f-4c39-b50c-1b7e1eefd21b admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:25.495539 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42afd5d-dfcc-41d7-a840-b898fb690c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:25.496196 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42afd5d-dfcc-41d7-a840-b898fb690c9b admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:25.496476 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42afd5d-dfcc-41d7-a840-b898fb690c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:25.497039 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42afd5d-dfcc-41d7-a840-b898fb690c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:25.497768 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42afd5d-dfcc-41d7-a840-b898fb690c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:25.499365 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42afd5d-dfcc-41d7-a840-b898fb690c9b admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:25.513099 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1268/2519] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:25.514376 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28398a-bf15-4e58-9b10-09004f814cf3 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:25.524039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28398a-bf15-4e58-9b10-09004f814cf3 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:25.528614 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431e9ca-fe4c-4a0e-83a8-4ba66bbaae4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:25.529214 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431e9ca-fe4c-4a0e-83a8-4ba66bbaae4f admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:25.529492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431e9ca-fe4c-4a0e-83a8-4ba66bbaae4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:25.529768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431e9ca-fe4c-4a0e-83a8-4ba66bbaae4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:25.530854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431e9ca-fe4c-4a0e-83a8-4ba66bbaae4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:25.532074 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431e9ca-fe4c-4a0e-83a8-4ba66bbaae4f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:25.543168 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1252/2520] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:25.547200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42afd5d-dfcc-41d7-a840-b898fb690c9b admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:25.557669 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42afd5d-dfcc-41d7-a840-b898fb690c9b admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:25.562749 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da7167-ed0b-4f24-8628-32459251dd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:25.563720 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da7167-ed0b-4f24-8628-32459251dd3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:25.564002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da7167-ed0b-4f24-8628-32459251dd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:25.564294 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da7167-ed0b-4f24-8628-32459251dd3d admin admin] PATH_INFO: `/v3/projects/8d04f81bb2674bbe80269c94d0aef0c8/users/d07e90817b5e4334b59373784d5d8d1a/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:25.578480 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da7167-ed0b-4f24-8628-32459251dd3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d04f81bb2674bbe80269c94d0aef0c8, user_id=d07e90817b5e4334b59373784d5d8d1a, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:25.581237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da7167-ed0b-4f24-8628-32459251dd3d admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:25.595933 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1269/2521] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:25 2022] PUT /identity/v3/projects/8d04f81bb2674bbe80269c94d0aef0c8/users/d07e90817b5e4334b59373784d5d8d1a/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:25.607794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23313e-6513-4afa-ab80-c21f4b24f040 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:25.608086 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23313e-6513-4afa-ab80-c21f4b24f040 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:25.608363 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23313e-6513-4afa-ab80-c21f4b24f040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:25.650459 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-fb23313e-6513-4afa-ab80-c21f4b24f040 None None] MFA Rules not processed for user `d07e90817b5e4334b59373784d5d8d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:25.651673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-fb23313e-6513-4afa-ab80-c21f4b24f040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:25.724083 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1253/2522] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:25.729177 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da7167-ed0b-4f24-8628-32459251dd3d admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:25.794176 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da7167-ed0b-4f24-8628-32459251dd3d admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:25.799249 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a921e-5734-4bc0-bc31-5599b1cc89a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:25.800059 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a921e-5734-4bc0-bc31-5599b1cc89a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:25.800340 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a921e-5734-4bc0-bc31-5599b1cc89a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:25.800693 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a921e-5734-4bc0-bc31-5599b1cc89a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:25.801447 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a921e-5734-4bc0-bc31-5599b1cc89a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:25.803682 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a921e-5734-4bc0-bc31-5599b1cc89a5 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:25.843006 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1270/2523] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:25 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:25.847224 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23313e-6513-4afa-ab80-c21f4b24f040 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:25.859751 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23313e-6513-4afa-ab80-c21f4b24f040 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:25.926245 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c893ea-737c-4eb5-89ad-e594fa5dd5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:25.927498 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c893ea-737c-4eb5-89ad-e594fa5dd5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:25.927834 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c893ea-737c-4eb5-89ad-e594fa5dd5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:25.928378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c893ea-737c-4eb5-89ad-e594fa5dd5c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:25.929141 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c893ea-737c-4eb5-89ad-e594fa5dd5c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:25.932049 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c893ea-737c-4eb5-89ad-e594fa5dd5c9 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:25.932720 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad215848-e318-41a6-8439-923a6f086488 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:25.933222 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad215848-e318-41a6-8439-923a6f086488 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:25.933525 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad215848-e318-41a6-8439-923a6f086488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:25.956155 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1254/2524] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:25 2022] POST /identity/v3/users => generated 300 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:25.959518 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c893ea-737c-4eb5-89ad-e594fa5dd5c9 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:25.966664 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-ad215848-e318-41a6-8439-923a6f086488 None None] MFA Rules not processed for user `4404cebe9b304ede809878dfb26d5e66`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:25.968034 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-ad215848-e318-41a6-8439-923a6f086488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:25.969840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c893ea-737c-4eb5-89ad-e594fa5dd5c9 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:25.975531 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b534e6-2600-4567-9fcb-52050e7c0247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:25.976175 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b534e6-2600-4567-9fcb-52050e7c0247 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:25.976455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b534e6-2600-4567-9fcb-52050e7c0247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:25.977097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b534e6-2600-4567-9fcb-52050e7c0247 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:25.977824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b534e6-2600-4567-9fcb-52050e7c0247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:25.979521 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b534e6-2600-4567-9fcb-52050e7c0247 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:25.990561 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1255/2525] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:25.994932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b534e6-2600-4567-9fcb-52050e7c0247 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:26.005706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b534e6-2600-4567-9fcb-52050e7c0247 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:26.014027 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba230e4-bff8-47c7-a133-3616daa52c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:26.015220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba230e4-bff8-47c7-a133-3616daa52c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:26.015638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba230e4-bff8-47c7-a133-3616daa52c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:26.015914 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba230e4-bff8-47c7-a133-3616daa52c63 admin admin] PATH_INFO: `/v3/projects/fe83abc586ea4ed1b708c0beac7b7c6c/users/c51f3ab0469345d689df5351ffee6964/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:26.033320 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba230e4-bff8-47c7-a133-3616daa52c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe83abc586ea4ed1b708c0beac7b7c6c, user_id=c51f3ab0469345d689df5351ffee6964, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:26.036013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba230e4-bff8-47c7-a133-3616daa52c63 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:26.041615 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1271/2526] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:26.052812 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad215848-e318-41a6-8439-923a6f086488 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:26.054305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-ad215848-e318-41a6-8439-923a6f086488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:26.055701 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1256/2527] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:25 2022] PUT /identity/v3/projects/fe83abc586ea4ed1b708c0beac7b7c6c/users/c51f3ab0469345d689df5351ffee6964/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:26.059013 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba230e4-bff8-47c7-a133-3616daa52c63 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:26.116641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad215848-e318-41a6-8439-923a6f086488 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:26.126847 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba230e4-bff8-47c7-a133-3616daa52c63 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:26.131858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996d949-6bf0-424a-a2b3-eddc4b03d1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:26.132529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996d949-6bf0-424a-a2b3-eddc4b03d1bd admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:26.133141 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996d949-6bf0-424a-a2b3-eddc4b03d1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:26.133439 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996d949-6bf0-424a-a2b3-eddc4b03d1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:26.134642 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996d949-6bf0-424a-a2b3-eddc4b03d1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:26.137808 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996d949-6bf0-424a-a2b3-eddc4b03d1bd admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:26.149159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1257/2528] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:40:26.153205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996d949-6bf0-424a-a2b3-eddc4b03d1bd admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:26.162985 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996d949-6bf0-424a-a2b3-eddc4b03d1bd admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:26.168386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bd021-c162-4466-b1f7-322ddf86284e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:26.169290 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bd021-c162-4466-b1f7-322ddf86284e admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:26.169576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bd021-c162-4466-b1f7-322ddf86284e admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:26.169854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bd021-c162-4466-b1f7-322ddf86284e admin admin] PATH_INFO: `/v3/projects/fe83abc586ea4ed1b708c0beac7b7c6c/users/c51f3ab0469345d689df5351ffee6964/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:26.171911 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bd021-c162-4466-b1f7-322ddf86284e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe83abc586ea4ed1b708c0beac7b7c6c, user_id=c51f3ab0469345d689df5351ffee6964, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:26.173808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0843aa-c4d7-4261-810a-e7f182da2258 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:26.174467 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0843aa-c4d7-4261-810a-e7f182da2258 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:26.174658 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bd021-c162-4466-b1f7-322ddf86284e admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:26.174777 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0843aa-c4d7-4261-810a-e7f182da2258 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:26.175082 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0843aa-c4d7-4261-810a-e7f182da2258 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:26.185313 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1258/2529] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:26 2022] PUT /identity/v3/projects/fe83abc586ea4ed1b708c0beac7b7c6c/users/c51f3ab0469345d689df5351ffee6964/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:26.196181 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe830c-8c2d-406a-a539-eee7dc410dfc None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:26.196464 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe830c-8c2d-406a-a539-eee7dc410dfc None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:26.196778 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe830c-8c2d-406a-a539-eee7dc410dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:26.230530 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-b8fe830c-8c2d-406a-a539-eee7dc410dfc None None] MFA Rules not processed for user `c51f3ab0469345d689df5351ffee6964`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:26.231881 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-b8fe830c-8c2d-406a-a539-eee7dc410dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:26.243011 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0843aa-c4d7-4261-810a-e7f182da2258 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:26.244733 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0843aa-c4d7-4261-810a-e7f182da2258 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:26.257085 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1272/2530] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:40:26.319227 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1259/2531] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:26.349596 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0843aa-c4d7-4261-810a-e7f182da2258 service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:26.351178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-3f0843aa-c4d7-4261-810a-e7f182da2258 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:26.364334 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0843aa-c4d7-4261-810a-e7f182da2258 service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:26.432714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f3cb6-9f03-41fc-868a-975ec63468f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:26.433540 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f3cb6-9f03-41fc-868a-975ec63468f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:26.433884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f3cb6-9f03-41fc-868a-975ec63468f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:26.434099 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f3cb6-9f03-41fc-868a-975ec63468f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:26.445156 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f3cb6-9f03-41fc-868a-975ec63468f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:26.446584 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f3cb6-9f03-41fc-868a-975ec63468f3 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:26.458979 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1273/2532] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:26.487945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe830c-8c2d-406a-a539-eee7dc410dfc None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:26.576876 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe830c-8c2d-406a-a539-eee7dc410dfc None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:26.585799 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306562ee-9d1c-485f-9978-ae6b6c74f5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:26.587623 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306562ee-9d1c-485f-9978-ae6b6c74f5f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:26.588133 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306562ee-9d1c-485f-9978-ae6b6c74f5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:26.588825 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306562ee-9d1c-485f-9978-ae6b6c74f5f5 admin admin] PATH_INFO: `/v3/users/d07e90817b5e4334b59373784d5d8d1a` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:26.590586 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306562ee-9d1c-485f-9978-ae6b6c74f5f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07e90817b5e4334b59373784d5d8d1a)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:26.592891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306562ee-9d1c-485f-9978-ae6b6c74f5f5 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:26.662198 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-306562ee-9d1c-485f-9978-ae6b6c74f5f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07e90817b5e4334b59373784d5d8d1a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:26.670480 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-306562ee-9d1c-485f-9978-ae6b6c74f5f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07e90817b5e4334b59373784d5d8d1a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:26.679680 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-306562ee-9d1c-485f-9978-ae6b6c74f5f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07e90817b5e4334b59373784d5d8d1a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:26.680311 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-306562ee-9d1c-485f-9978-ae6b6c74f5f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07e90817b5e4334b59373784d5d8d1a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:26.681038 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-306562ee-9d1c-485f-9978-ae6b6c74f5f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07e90817b5e4334b59373784d5d8d1a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:26.701628 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1260/2533] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:26 2022] DELETE /identity/v3/users/d07e90817b5e4334b59373784d5d8d1a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:26.706113 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fb624-906f-4628-be4f-c37efcd3cd3b None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:26.706572 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fb624-906f-4628-be4f-c37efcd3cd3b None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:26.706916 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fb624-906f-4628-be4f-c37efcd3cd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:26.725135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-f87fb624-906f-4628-be4f-c37efcd3cd3b None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:26.726427 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-f87fb624-906f-4628-be4f-c37efcd3cd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:26.790473 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1274/2534] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:26.800000 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306562ee-9d1c-485f-9978-ae6b6c74f5f5 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:26.801491 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-306562ee-9d1c-485f-9978-ae6b6c74f5f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:26.869698 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306562ee-9d1c-485f-9978-ae6b6c74f5f5 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:26.873320 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44cf1b-66c9-464f-988f-445403365d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:26.873960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44cf1b-66c9-464f-988f-445403365d8d service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:26.874239 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44cf1b-66c9-464f-988f-445403365d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:26.874507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44cf1b-66c9-464f-988f-445403365d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:26.885034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44cf1b-66c9-464f-988f-445403365d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:26.886667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44cf1b-66c9-464f-988f-445403365d8d service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:26.897446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1261/2535] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:27.561926 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fb624-906f-4628-be4f-c37efcd3cd3b None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:27.563386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-f87fb624-906f-4628-be4f-c37efcd3cd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:27.576108 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fb624-906f-4628-be4f-c37efcd3cd3b None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:27.581922 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedd34f-4d35-4781-85b9-3639c9cd9cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:27.583137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedd34f-4d35-4781-85b9-3639c9cd9cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:27.583478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedd34f-4d35-4781-85b9-3639c9cd9cea admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:27.583866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedd34f-4d35-4781-85b9-3639c9cd9cea admin admin] PATH_INFO: `/v3/users/f8ec33f30b274c2d933fc03f3f5ddb39` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:27.585784 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedd34f-4d35-4781-85b9-3639c9cd9cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ec33f30b274c2d933fc03f3f5ddb39)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:27.587840 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedd34f-4d35-4781-85b9-3639c9cd9cea admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:27.637258 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2cedd34f-4d35-4781-85b9-3639c9cd9cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ec33f30b274c2d933fc03f3f5ddb39'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:27.645409 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2cedd34f-4d35-4781-85b9-3639c9cd9cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ec33f30b274c2d933fc03f3f5ddb39'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:27.646304 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2cedd34f-4d35-4781-85b9-3639c9cd9cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ec33f30b274c2d933fc03f3f5ddb39'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:27.668790 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2cedd34f-4d35-4781-85b9-3639c9cd9cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ec33f30b274c2d933fc03f3f5ddb39'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:27.668790 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-2cedd34f-4d35-4781-85b9-3639c9cd9cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ec33f30b274c2d933fc03f3f5ddb39'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:27.673584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c130e1-6e44-44d0-9d79-7814c8c2e317 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:27.674092 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c130e1-6e44-44d0-9d79-7814c8c2e317 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:27.674291 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c130e1-6e44-44d0-9d79-7814c8c2e317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:27.685858 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1275/2536] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:27 2022] DELETE /identity/v3/users/f8ec33f30b274c2d933fc03f3f5ddb39 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:27.687711 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96741d-242e-45b4-9611-5433ad6b623e None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:27.688586 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96741d-242e-45b4-9611-5433ad6b623e None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:27.688586 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96741d-242e-45b4-9611-5433ad6b623e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:27.700681 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-31c130e1-6e44-44d0-9d79-7814c8c2e317 None None] MFA Rules not processed for user `4404cebe9b304ede809878dfb26d5e66`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:27.701971 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-31c130e1-6e44-44d0-9d79-7814c8c2e317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:27.707738 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-2c96741d-242e-45b4-9611-5433ad6b623e None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:27.709783 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-2c96741d-242e-45b4-9611-5433ad6b623e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:27.774673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1262/2537] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:27.784711 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1276/2538] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:27.803901 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c130e1-6e44-44d0-9d79-7814c8c2e317 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:27.805973 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-31c130e1-6e44-44d0-9d79-7814c8c2e317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:27.885114 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c130e1-6e44-44d0-9d79-7814c8c2e317 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:27.889019 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52d86b-4ff0-40d7-a9c9-ac65d600f7ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:27.889674 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52d86b-4ff0-40d7-a9c9-ac65d600f7ad service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:27.889958 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52d86b-4ff0-40d7-a9c9-ac65d600f7ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:27.890235 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52d86b-4ff0-40d7-a9c9-ac65d600f7ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:27.904988 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52d86b-4ff0-40d7-a9c9-ac65d600f7ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:27.907137 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52d86b-4ff0-40d7-a9c9-ac65d600f7ad service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:27.917575 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1263/2539] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:28.175528 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96741d-242e-45b4-9611-5433ad6b623e None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:28.177015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-2c96741d-242e-45b4-9611-5433ad6b623e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:28.189470 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96741d-242e-45b4-9611-5433ad6b623e None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:28.194702 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8807a1-51a6-4a9f-907c-621a8870d032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:28.195611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8807a1-51a6-4a9f-907c-621a8870d032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:28.195956 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8807a1-51a6-4a9f-907c-621a8870d032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:28.196368 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8807a1-51a6-4a9f-907c-621a8870d032 admin admin] PATH_INFO: `/v3/projects/8d04f81bb2674bbe80269c94d0aef0c8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:28.197607 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8807a1-51a6-4a9f-907c-621a8870d032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d04f81bb2674bbe80269c94d0aef0c8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:28.199586 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8807a1-51a6-4a9f-907c-621a8870d032 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:28.251946 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-3f8807a1-51a6-4a9f-907c-621a8870d032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d04f81bb2674bbe80269c94d0aef0c8', 'request_id': 'req-3f8807a1-51a6-4a9f-907c-621a8870d032'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:28.259803 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-3f8807a1-51a6-4a9f-907c-621a8870d032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d04f81bb2674bbe80269c94d0aef0c8', 'request_id': 'req-3f8807a1-51a6-4a9f-907c-621a8870d032'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:28.266999 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-3f8807a1-51a6-4a9f-907c-621a8870d032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d04f81bb2674bbe80269c94d0aef0c8', 'request_id': 'req-3f8807a1-51a6-4a9f-907c-621a8870d032'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:28.279016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-3f8807a1-51a6-4a9f-907c-621a8870d032 admin admin] The token cache is being invalidate because project 8d04f81bb2674bbe80269c94d0aef0c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:28.279305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-3f8807a1-51a6-4a9f-907c-621a8870d032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:28.279972 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-3f8807a1-51a6-4a9f-907c-621a8870d032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:28.281605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1277/2540] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:28 2022] DELETE /identity/v3/projects/8d04f81bb2674bbe80269c94d0aef0c8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:28.286076 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52d86b-4ff0-40d7-a9c9-ac65d600f7ad service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:28.295648 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52d86b-4ff0-40d7-a9c9-ac65d600f7ad service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:28.351572 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c5886-054d-454d-9c44-0bf476de014a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:28.352729 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c5886-054d-454d-9c44-0bf476de014a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:28.353009 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c5886-054d-454d-9c44-0bf476de014a admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:28.353279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c5886-054d-454d-9c44-0bf476de014a admin admin] PATH_INFO: `/v3/users/c51f3ab0469345d689df5351ffee6964` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:28.354551 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c5886-054d-454d-9c44-0bf476de014a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c51f3ab0469345d689df5351ffee6964)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:28.356517 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c5886-054d-454d-9c44-0bf476de014a admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:28.410263 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-423c5886-054d-454d-9c44-0bf476de014a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c51f3ab0469345d689df5351ffee6964'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:28.417701 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-423c5886-054d-454d-9c44-0bf476de014a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c51f3ab0469345d689df5351ffee6964'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:28.424796 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-423c5886-054d-454d-9c44-0bf476de014a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c51f3ab0469345d689df5351ffee6964'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:28.425919 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-423c5886-054d-454d-9c44-0bf476de014a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c51f3ab0469345d689df5351ffee6964'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:28.426683 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-423c5886-054d-454d-9c44-0bf476de014a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c51f3ab0469345d689df5351ffee6964'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:28.448746 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1264/2541] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:28 2022] DELETE /identity/v3/users/c51f3ab0469345d689df5351ffee6964 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:28.687115 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8807a1-51a6-4a9f-907c-621a8870d032 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:28.688640 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-3f8807a1-51a6-4a9f-907c-621a8870d032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:28.702651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8807a1-51a6-4a9f-907c-621a8870d032 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:28.794489 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b8b30-537b-4490-99a7-5760cad9d7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:28.795718 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b8b30-537b-4490-99a7-5760cad9d7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:28.796168 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b8b30-537b-4490-99a7-5760cad9d7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:28.796648 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b8b30-537b-4490-99a7-5760cad9d7ec admin admin] PATH_INFO: `/v3/projects/6b653227f15742b28b8f87863772d94d` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:28.798237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b8b30-537b-4490-99a7-5760cad9d7ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b653227f15742b28b8f87863772d94d)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:28.800901 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b8b30-537b-4490-99a7-5760cad9d7ec admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:28.890567 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-341b8b30-537b-4490-99a7-5760cad9d7ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b653227f15742b28b8f87863772d94d', 'request_id': 'req-341b8b30-537b-4490-99a7-5760cad9d7ec'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:28.899890 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-341b8b30-537b-4490-99a7-5760cad9d7ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b653227f15742b28b8f87863772d94d', 'request_id': 'req-341b8b30-537b-4490-99a7-5760cad9d7ec'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:28.915198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-341b8b30-537b-4490-99a7-5760cad9d7ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b653227f15742b28b8f87863772d94d', 'request_id': 'req-341b8b30-537b-4490-99a7-5760cad9d7ec'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:28.933263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-341b8b30-537b-4490-99a7-5760cad9d7ec admin admin] The token cache is being invalidate because project 6b653227f15742b28b8f87863772d94d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:28.933790 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-341b8b30-537b-4490-99a7-5760cad9d7ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:28.934681 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-341b8b30-537b-4490-99a7-5760cad9d7ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:28.937870 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1278/2542] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:28 2022] DELETE /identity/v3/projects/6b653227f15742b28b8f87863772d94d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:28.943541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d0848-1832-4a31-a620-e541c5b18db9 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:28.944075 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d0848-1832-4a31-a620-e541c5b18db9 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:28.944075 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d0848-1832-4a31-a620-e541c5b18db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:28.980848 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-409d0848-1832-4a31-a620-e541c5b18db9 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:28.983560 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-409d0848-1832-4a31-a620-e541c5b18db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:29.034194 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b8b30-537b-4490-99a7-5760cad9d7ec admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:29.035710 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-341b8b30-537b-4490-99a7-5760cad9d7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:29.097987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1265/2543] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:29.101475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edda605-e145-48f2-80f8-a4dad5033065 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:29.102390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edda605-e145-48f2-80f8-a4dad5033065 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:29.102826 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edda605-e145-48f2-80f8-a4dad5033065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:29.127899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-8edda605-e145-48f2-80f8-a4dad5033065 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:29.129456 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-8edda605-e145-48f2-80f8-a4dad5033065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:29.149766 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1266/2544] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:29.154215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edda605-e145-48f2-80f8-a4dad5033065 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:29.164754 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edda605-e145-48f2-80f8-a4dad5033065 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:29.170272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0a21d-7885-41ed-9fa4-326f6f9cb44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:29.171032 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0a21d-7885-41ed-9fa4-326f6f9cb44c admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:29.171412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0a21d-7885-41ed-9fa4-326f6f9cb44c admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:29.171780 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0a21d-7885-41ed-9fa4-326f6f9cb44c admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:29.172631 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0a21d-7885-41ed-9fa4-326f6f9cb44c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:40:29.173032 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0a21d-7885-41ed-9fa4-326f6f9cb44c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:29.173342 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b8b30-537b-4490-99a7-5760cad9d7ec admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:29.174852 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0a21d-7885-41ed-9fa4-326f6f9cb44c admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:29.178412 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36246a4a-3038-4cbc-b28b-2c8998f02000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:29.179208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36246a4a-3038-4cbc-b28b-2c8998f02000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:29.179487 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36246a4a-3038-4cbc-b28b-2c8998f02000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:29.179764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36246a4a-3038-4cbc-b28b-2c8998f02000 admin admin] PATH_INFO: `/v3/projects/fe83abc586ea4ed1b708c0beac7b7c6c` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:29.181106 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36246a4a-3038-4cbc-b28b-2c8998f02000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe83abc586ea4ed1b708c0beac7b7c6c)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:29.183055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36246a4a-3038-4cbc-b28b-2c8998f02000 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:29.187807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1267/2545] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:40:29.192507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0a21d-7885-41ed-9fa4-326f6f9cb44c admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:29.206919 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0a21d-7885-41ed-9fa4-326f6f9cb44c admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:29.213084 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5838bd-f40f-4a1b-b84e-1085a85690d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:29.214005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5838bd-f40f-4a1b-b84e-1085a85690d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:29.214372 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5838bd-f40f-4a1b-b84e-1085a85690d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:29.214846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5838bd-f40f-4a1b-b84e-1085a85690d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:29.215623 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5838bd-f40f-4a1b-b84e-1085a85690d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:29.217726 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5838bd-f40f-4a1b-b84e-1085a85690d2 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:29.253666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1268/2546] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:29 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:29.255590 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5838bd-f40f-4a1b-b84e-1085a85690d2 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:29.272479 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-36246a4a-3038-4cbc-b28b-2c8998f02000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe83abc586ea4ed1b708c0beac7b7c6c', 'request_id': 'req-36246a4a-3038-4cbc-b28b-2c8998f02000'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:29.281121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-36246a4a-3038-4cbc-b28b-2c8998f02000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe83abc586ea4ed1b708c0beac7b7c6c', 'request_id': 'req-36246a4a-3038-4cbc-b28b-2c8998f02000'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:29.289860 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-36246a4a-3038-4cbc-b28b-2c8998f02000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe83abc586ea4ed1b708c0beac7b7c6c', 'request_id': 'req-36246a4a-3038-4cbc-b28b-2c8998f02000'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:29.310108 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-36246a4a-3038-4cbc-b28b-2c8998f02000 admin admin] The token cache is being invalidate because project fe83abc586ea4ed1b708c0beac7b7c6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:29.310407 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-36246a4a-3038-4cbc-b28b-2c8998f02000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:29.313080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-36246a4a-3038-4cbc-b28b-2c8998f02000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:29.319342 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1279/2547] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:29 2022] DELETE /identity/v3/projects/fe83abc586ea4ed1b708c0beac7b7c6c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:29.322837 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a6d91-8aec-4022-8cfe-aa0ad49e4818 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:29.323166 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a6d91-8aec-4022-8cfe-aa0ad49e4818 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:29.323451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a6d91-8aec-4022-8cfe-aa0ad49e4818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:29.333112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5838bd-f40f-4a1b-b84e-1085a85690d2 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:29.344864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-654a6d91-8aec-4022-8cfe-aa0ad49e4818 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:29.346307 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-654a6d91-8aec-4022-8cfe-aa0ad49e4818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:29.403815 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcc1b0-91b9-48d5-b54a-8f3549cba6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:29.404758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcc1b0-91b9-48d5-b54a-8f3549cba6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:29.405122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcc1b0-91b9-48d5-b54a-8f3549cba6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:29.405763 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcc1b0-91b9-48d5-b54a-8f3549cba6d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:29.407990 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcc1b0-91b9-48d5-b54a-8f3549cba6d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:29.410230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcc1b0-91b9-48d5-b54a-8f3549cba6d3 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:29.435726 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1269/2548] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:29 2022] POST /identity/v3/users => generated 283 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:29.439519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcc1b0-91b9-48d5-b54a-8f3549cba6d3 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:29.440184 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1280/2549] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:29.442566 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-3ffcc1b0-91b9-48d5-b54a-8f3549cba6d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:29.449824 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca8d20-a749-40fa-b341-f05c7ee4e8bc None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:29.450253 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca8d20-a749-40fa-b341-f05c7ee4e8bc None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:29.450698 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca8d20-a749-40fa-b341-f05c7ee4e8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:29.460432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcc1b0-91b9-48d5-b54a-8f3549cba6d3 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:29.466987 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edaa403-7f87-4709-888d-f7e5e791bc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:29.467663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaa403-7f87-4709-888d-f7e5e791bc91 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:29.467946 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaa403-7f87-4709-888d-f7e5e791bc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:29.468271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaa403-7f87-4709-888d-f7e5e791bc91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:29.469041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edaa403-7f87-4709-888d-f7e5e791bc91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:29.470726 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edaa403-7f87-4709-888d-f7e5e791bc91 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:29.479474 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-d3ca8d20-a749-40fa-b341-f05c7ee4e8bc None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:29.480699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d3ca8d20-a749-40fa-b341-f05c7ee4e8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:29.481767 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1270/2550] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:40:29.485861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edaa403-7f87-4709-888d-f7e5e791bc91 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:29.498400 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1281/2551] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:29.498607 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edaa403-7f87-4709-888d-f7e5e791bc91 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:29.499682 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca8d20-a749-40fa-b341-f05c7ee4e8bc None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:29.503794 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937d29e-b9f2-4bb6-8997-7bfd4783ae7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:29.504865 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937d29e-b9f2-4bb6-8997-7bfd4783ae7d admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:29.505347 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937d29e-b9f2-4bb6-8997-7bfd4783ae7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:29.505697 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937d29e-b9f2-4bb6-8997-7bfd4783ae7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:29.507186 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937d29e-b9f2-4bb6-8997-7bfd4783ae7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:29.508921 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937d29e-b9f2-4bb6-8997-7bfd4783ae7d admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:29.510697 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca8d20-a749-40fa-b341-f05c7ee4e8bc None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:29.516932 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6aba6c-1dec-4a39-a96c-a1f1dc2578f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:29.517942 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aba6c-1dec-4a39-a96c-a1f1dc2578f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:29.518565 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aba6c-1dec-4a39-a96c-a1f1dc2578f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:29.518944 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aba6c-1dec-4a39-a96c-a1f1dc2578f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:29.520041 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6aba6c-1dec-4a39-a96c-a1f1dc2578f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:40:29.520648 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6aba6c-1dec-4a39-a96c-a1f1dc2578f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:29.522900 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6aba6c-1dec-4a39-a96c-a1f1dc2578f6 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:29.527772 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1271/2552] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:29.528847 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937d29e-b9f2-4bb6-8997-7bfd4783ae7d admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:29.541402 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937d29e-b9f2-4bb6-8997-7bfd4783ae7d admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:29.544686 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1282/2553] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:40:29.546916 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6aba6c-1dec-4a39-a96c-a1f1dc2578f6 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:29.551936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9199e-f503-44c7-b87d-77453108573c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:29.553446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9199e-f503-44c7-b87d-77453108573c admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:29.553890 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9199e-f503-44c7-b87d-77453108573c admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:29.554177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9199e-f503-44c7-b87d-77453108573c admin admin] PATH_INFO: `/v3/projects/b881275ee6584acba5eaa3db52804c69/users/9719053289244a6e97b4448309749b06/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:29.560149 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6aba6c-1dec-4a39-a96c-a1f1dc2578f6 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:29.565272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad52554-d64a-47cc-a2de-d5455c7fe88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:29.565934 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad52554-d64a-47cc-a2de-d5455c7fe88f admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:29.566288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad52554-d64a-47cc-a2de-d5455c7fe88f admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:29.566483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad52554-d64a-47cc-a2de-d5455c7fe88f admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:29.567176 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad52554-d64a-47cc-a2de-d5455c7fe88f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:29.569760 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad52554-d64a-47cc-a2de-d5455c7fe88f admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:29.578974 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9199e-f503-44c7-b87d-77453108573c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b881275ee6584acba5eaa3db52804c69, user_id=9719053289244a6e97b4448309749b06, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:29.583510 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9199e-f503-44c7-b87d-77453108573c admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:29.603571 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1283/2554] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:29 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:29.605892 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1272/2555] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:29 2022] PUT /identity/v3/projects/b881275ee6584acba5eaa3db52804c69/users/9719053289244a6e97b4448309749b06/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:29.607408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad52554-d64a-47cc-a2de-d5455c7fe88f admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:29.617422 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71be0ad-dba0-47b0-a489-82bf99275afb None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:29.617843 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71be0ad-dba0-47b0-a489-82bf99275afb None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:29.618755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71be0ad-dba0-47b0-a489-82bf99275afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:29.660253 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-a71be0ad-dba0-47b0-a489-82bf99275afb None None] MFA Rules not processed for user `9719053289244a6e97b4448309749b06`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:29.661847 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-a71be0ad-dba0-47b0-a489-82bf99275afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:29.674547 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad52554-d64a-47cc-a2de-d5455c7fe88f admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:29.680036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2e964-350d-40f7-88f9-3601fba8c18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:29.680746 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2e964-350d-40f7-88f9-3601fba8c18b admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:29.681027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2e964-350d-40f7-88f9-3601fba8c18b admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:29.681306 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2e964-350d-40f7-88f9-3601fba8c18b admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:29.682011 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2e964-350d-40f7-88f9-3601fba8c18b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:29.684191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2e964-350d-40f7-88f9-3601fba8c18b admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:29.706182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1284/2556] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:29 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:29.710049 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2e964-350d-40f7-88f9-3601fba8c18b admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:29.720569 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2e964-350d-40f7-88f9-3601fba8c18b admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:29.725443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d64879-bcda-420f-935d-9a11616d74a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:29.726105 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d64879-bcda-420f-935d-9a11616d74a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:29.726385 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d64879-bcda-420f-935d-9a11616d74a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:29.726655 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d64879-bcda-420f-935d-9a11616d74a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:29.727640 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d64879-bcda-420f-935d-9a11616d74a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:29.729288 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d64879-bcda-420f-935d-9a11616d74a6 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:29.736063 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1273/2557] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:29.739761 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1285/2558] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:40:29.740935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71be0ad-dba0-47b0-a489-82bf99275afb None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:29.744003 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d64879-bcda-420f-935d-9a11616d74a6 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:29.751992 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71be0ad-dba0-47b0-a489-82bf99275afb None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:29.754529 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d64879-bcda-420f-935d-9a11616d74a6 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:29.757271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71faa40-f777-4c31-ae7d-1dff6a55709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:29.757930 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71faa40-f777-4c31-ae7d-1dff6a55709f admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:29.758209 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71faa40-f777-4c31-ae7d-1dff6a55709f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:29.758539 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71faa40-f777-4c31-ae7d-1dff6a55709f admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:29.759165 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71faa40-f777-4c31-ae7d-1dff6a55709f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:29.760990 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222f049-11ef-41d9-b928-c198d8eface4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:29.761122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71faa40-f777-4c31-ae7d-1dff6a55709f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:29.761656 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222f049-11ef-41d9-b928-c198d8eface4 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:29.761938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222f049-11ef-41d9-b928-c198d8eface4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:29.762224 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222f049-11ef-41d9-b928-c198d8eface4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:29.762957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222f049-11ef-41d9-b928-c198d8eface4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:29.764597 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222f049-11ef-41d9-b928-c198d8eface4 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:29.776582 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1286/2559] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:40:29.780651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222f049-11ef-41d9-b928-c198d8eface4 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:29.791534 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1274/2560] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:29 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:29.795034 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71faa40-f777-4c31-ae7d-1dff6a55709f admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:29.795391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222f049-11ef-41d9-b928-c198d8eface4 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:29.860953 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71faa40-f777-4c31-ae7d-1dff6a55709f admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:29.865791 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187c18a-d436-414a-99b3-64269aaad516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:29.866309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe76398-60bb-493e-8ee6-53d3e3010954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:29.866678 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187c18a-d436-414a-99b3-64269aaad516 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:29.866958 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187c18a-d436-414a-99b3-64269aaad516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:29.867233 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187c18a-d436-414a-99b3-64269aaad516 admin admin] PATH_INFO: `/v3/projects/bd52476edd0644f99d23c78c37c18327/users/d4274ff458fc45f3b9d20cf6fe418bb9/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:29.867347 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe76398-60bb-493e-8ee6-53d3e3010954 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:29.867793 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe76398-60bb-493e-8ee6-53d3e3010954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:29.868140 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe76398-60bb-493e-8ee6-53d3e3010954 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:29.868862 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe76398-60bb-493e-8ee6-53d3e3010954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:29.870933 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe76398-60bb-493e-8ee6-53d3e3010954 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:29.883000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187c18a-d436-414a-99b3-64269aaad516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd52476edd0644f99d23c78c37c18327, user_id=d4274ff458fc45f3b9d20cf6fe418bb9, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:29.886174 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187c18a-d436-414a-99b3-64269aaad516 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:29.897635 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1275/2561] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:29 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:29.899072 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe76398-60bb-493e-8ee6-53d3e3010954 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:29.903445 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1287/2562] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:29 2022] PUT /identity/v3/projects/bd52476edd0644f99d23c78c37c18327/users/d4274ff458fc45f3b9d20cf6fe418bb9/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:29.910273 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe76398-60bb-493e-8ee6-53d3e3010954 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:29.915774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027efbe5-c266-46ff-b5e2-374f96210dc1 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:29.916132 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027efbe5-c266-46ff-b5e2-374f96210dc1 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:29.916475 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027efbe5-c266-46ff-b5e2-374f96210dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:29.955005 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-027efbe5-c266-46ff-b5e2-374f96210dc1 None None] MFA Rules not processed for user `d4274ff458fc45f3b9d20cf6fe418bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:29.956563 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-027efbe5-c266-46ff-b5e2-374f96210dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:30.013690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e415a24-3cac-42aa-9264-f1e96675fa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:30.014390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e415a24-3cac-42aa-9264-f1e96675fa77 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:30.014658 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e415a24-3cac-42aa-9264-f1e96675fa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:30.014931 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e415a24-3cac-42aa-9264-f1e96675fa77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:30.015671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e415a24-3cac-42aa-9264-f1e96675fa77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:30.017437 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e415a24-3cac-42aa-9264-f1e96675fa77 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:30.034571 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1276/2563] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:40:30.038496 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e415a24-3cac-42aa-9264-f1e96675fa77 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:30.049168 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e415a24-3cac-42aa-9264-f1e96675fa77 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:30.055311 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b954777-a207-4b15-bdd8-b367384a55aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:30.056308 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b954777-a207-4b15-bdd8-b367384a55aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:30.056626 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b954777-a207-4b15-bdd8-b367384a55aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:30.056906 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b954777-a207-4b15-bdd8-b367384a55aa admin admin] PATH_INFO: `/v3/projects/0542b022bd0a4e23bb6478bc62622815/users/54a34d03a5d448eabcce35fae65df28b/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:30.075638 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1288/2564] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:30.077395 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027efbe5-c266-46ff-b5e2-374f96210dc1 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:30.097999 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027efbe5-c266-46ff-b5e2-374f96210dc1 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:30.103913 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688bdef-e106-43e6-9c42-5bd632e3d7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:30.104888 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688bdef-e106-43e6-9c42-5bd632e3d7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:30.105289 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688bdef-e106-43e6-9c42-5bd632e3d7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:30.105654 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688bdef-e106-43e6-9c42-5bd632e3d7c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:30.106479 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688bdef-e106-43e6-9c42-5bd632e3d7c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:30.108489 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688bdef-e106-43e6-9c42-5bd632e3d7c3 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:30.115974 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b954777-a207-4b15-bdd8-b367384a55aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0542b022bd0a4e23bb6478bc62622815, user_id=54a34d03a5d448eabcce35fae65df28b, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:30.119622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b954777-a207-4b15-bdd8-b367384a55aa admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:30.140190 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1277/2565] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:30 2022] PUT /identity/v3/projects/0542b022bd0a4e23bb6478bc62622815/users/54a34d03a5d448eabcce35fae65df28b/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:30.143840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b954777-a207-4b15-bdd8-b367384a55aa admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:30.153196 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1289/2566] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:30 2022] POST /identity/v3/projects => generated 391 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:30.166304 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688bdef-e106-43e6-9c42-5bd632e3d7c3 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:30.231814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b954777-a207-4b15-bdd8-b367384a55aa admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:30.280680 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688bdef-e106-43e6-9c42-5bd632e3d7c3 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:30.286159 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14f8c3-fb3f-4c59-b82e-4b9bfc82612a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:30.286840 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14f8c3-fb3f-4c59-b82e-4b9bfc82612a admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:30.289152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14f8c3-fb3f-4c59-b82e-4b9bfc82612a admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:30.291536 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14f8c3-fb3f-4c59-b82e-4b9bfc82612a admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:30.291536 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14f8c3-fb3f-4c59-b82e-4b9bfc82612a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:30.293167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14f8c3-fb3f-4c59-b82e-4b9bfc82612a admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:30.307616 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e3279-3e47-48cb-8d36-c478eb9d0fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:30.309036 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e3279-3e47-48cb-8d36-c478eb9d0fed admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:30.309497 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e3279-3e47-48cb-8d36-c478eb9d0fed admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:30.309638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e3279-3e47-48cb-8d36-c478eb9d0fed admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:30.310481 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e3279-3e47-48cb-8d36-c478eb9d0fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:30.312380 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e3279-3e47-48cb-8d36-c478eb9d0fed admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:30.323482 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1278/2567] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:40:30.327367 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1290/2568] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:30 2022] POST /identity/v3/users => generated 302 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:30.327507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e3279-3e47-48cb-8d36-c478eb9d0fed admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:30.331002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14f8c3-fb3f-4c59-b82e-4b9bfc82612a admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:30.338204 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e3279-3e47-48cb-8d36-c478eb9d0fed admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:30.345147 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14f8c3-fb3f-4c59-b82e-4b9bfc82612a admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:30.350552 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8e104-9396-4acf-9262-400b8ab4a7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:30.351263 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8e104-9396-4acf-9262-400b8ab4a7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:30.351572 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8e104-9396-4acf-9262-400b8ab4a7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:30.352122 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8e104-9396-4acf-9262-400b8ab4a7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:30.352320 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed4304-0649-43d4-b61e-bd58d8ba333a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:30.353066 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8e104-9396-4acf-9262-400b8ab4a7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:30.354686 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8e104-9396-4acf-9262-400b8ab4a7b7 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:30.355190 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed4304-0649-43d4-b61e-bd58d8ba333a admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:30.355475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed4304-0649-43d4-b61e-bd58d8ba333a admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:30.355750 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed4304-0649-43d4-b61e-bd58d8ba333a admin admin] PATH_INFO: `/v3/projects/0542b022bd0a4e23bb6478bc62622815/users/54a34d03a5d448eabcce35fae65df28b/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:30.359085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed4304-0649-43d4-b61e-bd58d8ba333a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0542b022bd0a4e23bb6478bc62622815, user_id=54a34d03a5d448eabcce35fae65df28b, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:30.362532 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed4304-0649-43d4-b61e-bd58d8ba333a admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:30.368572 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1291/2569] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:30.370877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8e104-9396-4acf-9262-400b8ab4a7b7 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:30.374447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1279/2570] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:30 2022] PUT /identity/v3/projects/0542b022bd0a4e23bb6478bc62622815/users/54a34d03a5d448eabcce35fae65df28b/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:30.386833 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7ff82-4b0d-45b8-8c7a-71cdac02dea5 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:30.388847 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7ff82-4b0d-45b8-8c7a-71cdac02dea5 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:30.389153 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7ff82-4b0d-45b8-8c7a-71cdac02dea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:30.395115 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8e104-9396-4acf-9262-400b8ab4a7b7 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:30.432449 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-67c7ff82-4b0d-45b8-8c7a-71cdac02dea5 None None] MFA Rules not processed for user `54a34d03a5d448eabcce35fae65df28b`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:30.434155 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-67c7ff82-4b0d-45b8-8c7a-71cdac02dea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:30.483127 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92fc76-05ac-4c67-887a-85ddc8f5805b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:30.483962 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92fc76-05ac-4c67-887a-85ddc8f5805b admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:30.484248 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92fc76-05ac-4c67-887a-85ddc8f5805b admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:30.484523 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92fc76-05ac-4c67-887a-85ddc8f5805b admin admin] PATH_INFO: `/v3/projects/5b8ed1a7542b4b26bc09668156928228/users/5dd9589c99754e5b9aad6b1b072646ba/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:30.508920 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92fc76-05ac-4c67-887a-85ddc8f5805b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8ed1a7542b4b26bc09668156928228, user_id=5dd9589c99754e5b9aad6b1b072646ba, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:30.512666 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92fc76-05ac-4c67-887a-85ddc8f5805b admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:30.536415 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1280/2571] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:30 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:30.539455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1292/2572] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:30 2022] PUT /identity/v3/projects/5b8ed1a7542b4b26bc09668156928228/users/5dd9589c99754e5b9aad6b1b072646ba/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:30.542341 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7ff82-4b0d-45b8-8c7a-71cdac02dea5 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:30.548053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92fc76-05ac-4c67-887a-85ddc8f5805b admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:30.549899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-8d92fc76-05ac-4c67-887a-85ddc8f5805b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:30.555544 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7ff82-4b0d-45b8-8c7a-71cdac02dea5 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:30.613505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92fc76-05ac-4c67-887a-85ddc8f5805b admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:30.618969 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc97908-d35e-4b6a-8681-f5ddec828fcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:30.619758 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc97908-d35e-4b6a-8681-f5ddec828fcd service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:30.620146 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc97908-d35e-4b6a-8681-f5ddec828fcd service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:30.620561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc97908-d35e-4b6a-8681-f5ddec828fcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:30.622434 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e5f88-f0d9-41f0-8206-c1d75ebca402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:30.623102 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e5f88-f0d9-41f0-8206-c1d75ebca402 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:30.623495 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e5f88-f0d9-41f0-8206-c1d75ebca402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:30.623777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e5f88-f0d9-41f0-8206-c1d75ebca402 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:30.624509 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e5f88-f0d9-41f0-8206-c1d75ebca402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:30.626299 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e5f88-f0d9-41f0-8206-c1d75ebca402 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:30.640732 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1281/2573] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:30.643119 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e5f88-f0d9-41f0-8206-c1d75ebca402 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:30.655627 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e5f88-f0d9-41f0-8206-c1d75ebca402 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:30.664587 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e485994-a53c-4c2a-b8ad-e5dae7090eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:30.665488 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e485994-a53c-4c2a-b8ad-e5dae7090eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:30.665828 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e485994-a53c-4c2a-b8ad-e5dae7090eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:30.666111 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e485994-a53c-4c2a-b8ad-e5dae7090eb3 admin admin] PATH_INFO: `/v3/projects/5b8ed1a7542b4b26bc09668156928228/users/5dd9589c99754e5b9aad6b1b072646ba/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:30.670421 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e485994-a53c-4c2a-b8ad-e5dae7090eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8ed1a7542b4b26bc09668156928228, user_id=5dd9589c99754e5b9aad6b1b072646ba, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:30.674609 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e485994-a53c-4c2a-b8ad-e5dae7090eb3 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:30.694209 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1282/2574] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:30 2022] PUT /identity/v3/projects/5b8ed1a7542b4b26bc09668156928228/users/5dd9589c99754e5b9aad6b1b072646ba/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:30.704184 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347446e-40c8-4df5-b8b1-129b23db071d None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:30.704468 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347446e-40c8-4df5-b8b1-129b23db071d None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:30.704771 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347446e-40c8-4df5-b8b1-129b23db071d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:30.720922 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc97908-d35e-4b6a-8681-f5ddec828fcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:30.725362 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc97908-d35e-4b6a-8681-f5ddec828fcd service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:30.739819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-c347446e-40c8-4df5-b8b1-129b23db071d None None] MFA Rules not processed for user `5dd9589c99754e5b9aad6b1b072646ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:30.741952 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c347446e-40c8-4df5-b8b1-129b23db071d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:30.753491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1293/2575] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:30 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:40:30.854508 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1283/2576] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:30.867534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc97908-d35e-4b6a-8681-f5ddec828fcd service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:30.869176 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-efc97908-d35e-4b6a-8681-f5ddec828fcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:30.887815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc97908-d35e-4b6a-8681-f5ddec828fcd service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:30.968736 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccb3d8-7c2e-42f1-8eaa-82199d24e911 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:30.969432 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccb3d8-7c2e-42f1-8eaa-82199d24e911 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:30.969718 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccb3d8-7c2e-42f1-8eaa-82199d24e911 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:30.969997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccb3d8-7c2e-42f1-8eaa-82199d24e911 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:30.980889 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccb3d8-7c2e-42f1-8eaa-82199d24e911 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:30.987097 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccb3d8-7c2e-42f1-8eaa-82199d24e911 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:30.995534 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1294/2577] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:40:31.088758 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347446e-40c8-4df5-b8b1-129b23db071d None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:31.102763 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347446e-40c8-4df5-b8b1-129b23db071d None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:31.107084 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61c6c8-6494-4435-9453-e6f716040937 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:31.107733 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61c6c8-6494-4435-9453-e6f716040937 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:31.108017 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61c6c8-6494-4435-9453-e6f716040937 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:31.108287 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61c6c8-6494-4435-9453-e6f716040937 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:31.183415 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61c6c8-6494-4435-9453-e6f716040937 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:31.184979 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61c6c8-6494-4435-9453-e6f716040937 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:31.196704 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1284/2578] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:31.319559 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccb3d8-7c2e-42f1-8eaa-82199d24e911 service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:31.392689 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccb3d8-7c2e-42f1-8eaa-82199d24e911 service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:31.400025 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49a776-b717-43e7-815e-1a8addbe903a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:31.400953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49a776-b717-43e7-815e-1a8addbe903a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:31.401284 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49a776-b717-43e7-815e-1a8addbe903a admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:31.401562 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49a776-b717-43e7-815e-1a8addbe903a admin admin] PATH_INFO: `/v3/users/9719053289244a6e97b4448309749b06` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:31.403305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49a776-b717-43e7-815e-1a8addbe903a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9719053289244a6e97b4448309749b06)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:31.406116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49a776-b717-43e7-815e-1a8addbe903a admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:31.482498 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dd49a776-b717-43e7-815e-1a8addbe903a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9719053289244a6e97b4448309749b06'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:31.490020 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dd49a776-b717-43e7-815e-1a8addbe903a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9719053289244a6e97b4448309749b06'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:31.490818 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dd49a776-b717-43e7-815e-1a8addbe903a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9719053289244a6e97b4448309749b06'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:31.500170 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dd49a776-b717-43e7-815e-1a8addbe903a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9719053289244a6e97b4448309749b06'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:31.503734 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dd49a776-b717-43e7-815e-1a8addbe903a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9719053289244a6e97b4448309749b06'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:31.536280 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1295/2579] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:31 2022] DELETE /identity/v3/users/9719053289244a6e97b4448309749b06 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:31.538645 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e27c9d-5013-4185-a04e-0b22565aaf87 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:31.539148 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e27c9d-5013-4185-a04e-0b22565aaf87 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:31.539529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e27c9d-5013-4185-a04e-0b22565aaf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:31.559749 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-26e27c9d-5013-4185-a04e-0b22565aaf87 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:31.561153 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-26e27c9d-5013-4185-a04e-0b22565aaf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:31.621021 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1285/2580] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:31.631151 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49a776-b717-43e7-815e-1a8addbe903a admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:31.633215 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-dd49a776-b717-43e7-815e-1a8addbe903a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:31.689351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49a776-b717-43e7-815e-1a8addbe903a admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:31.693080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44802b-0425-4d2f-8ce6-3970e8d0960e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:31.693756 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44802b-0425-4d2f-8ce6-3970e8d0960e service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:31.694033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44802b-0425-4d2f-8ce6-3970e8d0960e service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:31.694305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44802b-0425-4d2f-8ce6-3970e8d0960e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:31.703381 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44802b-0425-4d2f-8ce6-3970e8d0960e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:31.704870 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44802b-0425-4d2f-8ce6-3970e8d0960e service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:31.714491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1296/2581] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:31.993490 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e27c9d-5013-4185-a04e-0b22565aaf87 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:31.994932 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-26e27c9d-5013-4185-a04e-0b22565aaf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:32.008251 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e27c9d-5013-4185-a04e-0b22565aaf87 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:32.013138 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed04d42-cfc8-406e-85dc-2a2a07d0f9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:32.014082 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed04d42-cfc8-406e-85dc-2a2a07d0f9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:32.014845 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed04d42-cfc8-406e-85dc-2a2a07d0f9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:32.015139 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed04d42-cfc8-406e-85dc-2a2a07d0f9d5 admin admin] PATH_INFO: `/v3/projects/b881275ee6584acba5eaa3db52804c69` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:32.016413 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed04d42-cfc8-406e-85dc-2a2a07d0f9d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b881275ee6584acba5eaa3db52804c69)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:32.018499 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed04d42-cfc8-406e-85dc-2a2a07d0f9d5 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:32.066446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2ed04d42-cfc8-406e-85dc-2a2a07d0f9d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b881275ee6584acba5eaa3db52804c69', 'request_id': 'req-2ed04d42-cfc8-406e-85dc-2a2a07d0f9d5'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:32.072732 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2ed04d42-cfc8-406e-85dc-2a2a07d0f9d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b881275ee6584acba5eaa3db52804c69', 'request_id': 'req-2ed04d42-cfc8-406e-85dc-2a2a07d0f9d5'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:32.078493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2ed04d42-cfc8-406e-85dc-2a2a07d0f9d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b881275ee6584acba5eaa3db52804c69', 'request_id': 'req-2ed04d42-cfc8-406e-85dc-2a2a07d0f9d5'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:32.092180 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2ed04d42-cfc8-406e-85dc-2a2a07d0f9d5 admin admin] The token cache is being invalidate because project b881275ee6584acba5eaa3db52804c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:32.092752 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2ed04d42-cfc8-406e-85dc-2a2a07d0f9d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:32.093150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-2ed04d42-cfc8-406e-85dc-2a2a07d0f9d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:32.094698 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1286/2582] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:31 2022] DELETE /identity/v3/projects/b881275ee6584acba5eaa3db52804c69 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:32.098693 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44802b-0425-4d2f-8ce6-3970e8d0960e service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:32.109154 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44802b-0425-4d2f-8ce6-3970e8d0960e service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:32.165063 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c0610-bd05-4b9c-8de6-31c88a829c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:32.165929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c0610-bd05-4b9c-8de6-31c88a829c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:32.166211 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c0610-bd05-4b9c-8de6-31c88a829c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:32.166491 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c0610-bd05-4b9c-8de6-31c88a829c99 admin admin] PATH_INFO: `/v3/users/54a34d03a5d448eabcce35fae65df28b` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:32.167674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c0610-bd05-4b9c-8de6-31c88a829c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a34d03a5d448eabcce35fae65df28b)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:32.169648 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c0610-bd05-4b9c-8de6-31c88a829c99 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:32.223645 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-3c0c0610-bd05-4b9c-8de6-31c88a829c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a34d03a5d448eabcce35fae65df28b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:32.230839 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-3c0c0610-bd05-4b9c-8de6-31c88a829c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a34d03a5d448eabcce35fae65df28b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:32.231502 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-3c0c0610-bd05-4b9c-8de6-31c88a829c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a34d03a5d448eabcce35fae65df28b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:32.238682 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-3c0c0610-bd05-4b9c-8de6-31c88a829c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a34d03a5d448eabcce35fae65df28b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:32.239502 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-3c0c0610-bd05-4b9c-8de6-31c88a829c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a34d03a5d448eabcce35fae65df28b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:32.257051 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1297/2583] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:32 2022] DELETE /identity/v3/users/54a34d03a5d448eabcce35fae65df28b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:32.545981 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed04d42-cfc8-406e-85dc-2a2a07d0f9d5 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:32.547494 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-2ed04d42-cfc8-406e-85dc-2a2a07d0f9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:32.561892 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed04d42-cfc8-406e-85dc-2a2a07d0f9d5 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:32.639385 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a27138-366a-4b19-aac7-6573abbd3966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:32.640510 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a27138-366a-4b19-aac7-6573abbd3966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:32.640822 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a27138-366a-4b19-aac7-6573abbd3966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:32.641089 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a27138-366a-4b19-aac7-6573abbd3966 admin admin] PATH_INFO: `/v3/projects/0542b022bd0a4e23bb6478bc62622815` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:32.642633 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a27138-366a-4b19-aac7-6573abbd3966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0542b022bd0a4e23bb6478bc62622815)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:32.644873 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a27138-366a-4b19-aac7-6573abbd3966 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:32.695618 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c3a27138-366a-4b19-aac7-6573abbd3966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0542b022bd0a4e23bb6478bc62622815', 'request_id': 'req-c3a27138-366a-4b19-aac7-6573abbd3966'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:32.701536 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c3a27138-366a-4b19-aac7-6573abbd3966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0542b022bd0a4e23bb6478bc62622815', 'request_id': 'req-c3a27138-366a-4b19-aac7-6573abbd3966'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:32.706687 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c3a27138-366a-4b19-aac7-6573abbd3966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0542b022bd0a4e23bb6478bc62622815', 'request_id': 'req-c3a27138-366a-4b19-aac7-6573abbd3966'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:32.718778 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c3a27138-366a-4b19-aac7-6573abbd3966 admin admin] The token cache is being invalidate because project 0542b022bd0a4e23bb6478bc62622815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:32.719066 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c3a27138-366a-4b19-aac7-6573abbd3966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:32.719686 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c3a27138-366a-4b19-aac7-6573abbd3966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:32.721275 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1287/2584] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:32 2022] DELETE /identity/v3/projects/0542b022bd0a4e23bb6478bc62622815 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:32.726765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9b6f-3b7a-4235-8f6d-410a574b6274 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:32.727404 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9b6f-3b7a-4235-8f6d-410a574b6274 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:32.727765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9b6f-3b7a-4235-8f6d-410a574b6274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:32.746184 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-ce4f9b6f-3b7a-4235-8f6d-410a574b6274 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:32.747451 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-ce4f9b6f-3b7a-4235-8f6d-410a574b6274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:32.804785 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1298/2585] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:32.813930 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff495d4f-8b0a-46d9-b7a6-9a17236bcb53 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:32.814278 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff495d4f-8b0a-46d9-b7a6-9a17236bcb53 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:32.814829 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff495d4f-8b0a-46d9-b7a6-9a17236bcb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:32.834600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-ff495d4f-8b0a-46d9-b7a6-9a17236bcb53 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:32.836064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-ff495d4f-8b0a-46d9-b7a6-9a17236bcb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:32.848702 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1288/2586] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:32.853050 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f9b6f-3b7a-4235-8f6d-410a574b6274 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:32.862755 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f9b6f-3b7a-4235-8f6d-410a574b6274 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:32.868828 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a971fdd-e18a-4a47-a3ac-4f6ca162d275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:32.869569 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a971fdd-e18a-4a47-a3ac-4f6ca162d275 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:32.869917 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a971fdd-e18a-4a47-a3ac-4f6ca162d275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:32.870305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a971fdd-e18a-4a47-a3ac-4f6ca162d275 admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:32.871055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a971fdd-e18a-4a47-a3ac-4f6ca162d275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:40:32.871364 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a971fdd-e18a-4a47-a3ac-4f6ca162d275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:32.873035 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a971fdd-e18a-4a47-a3ac-4f6ca162d275 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:32.888500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1299/2587] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:40:32.889602 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff495d4f-8b0a-46d9-b7a6-9a17236bcb53 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:32.898679 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff495d4f-8b0a-46d9-b7a6-9a17236bcb53 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:32.904735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537abf6-de96-4a83-a7f0-b9a095ed8933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:32.904735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537abf6-de96-4a83-a7f0-b9a095ed8933 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:32.904735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537abf6-de96-4a83-a7f0-b9a095ed8933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:32.904735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537abf6-de96-4a83-a7f0-b9a095ed8933 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:32.905455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537abf6-de96-4a83-a7f0-b9a095ed8933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:32.907395 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537abf6-de96-4a83-a7f0-b9a095ed8933 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:32.932894 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1289/2588] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:32 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:32.937052 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a971fdd-e18a-4a47-a3ac-4f6ca162d275 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:32.947511 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a971fdd-e18a-4a47-a3ac-4f6ca162d275 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:33.006233 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57334daf-8c17-4bb5-8edb-7021e0b6d03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:33.006908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57334daf-8c17-4bb5-8edb-7021e0b6d03a admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:33.007218 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57334daf-8c17-4bb5-8edb-7021e0b6d03a admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:33.007495 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57334daf-8c17-4bb5-8edb-7021e0b6d03a admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:33.008231 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57334daf-8c17-4bb5-8edb-7021e0b6d03a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:33.010230 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57334daf-8c17-4bb5-8edb-7021e0b6d03a admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:33.035438 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1300/2589] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:32 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:33.037445 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537abf6-de96-4a83-a7f0-b9a095ed8933 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:33.047576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537abf6-de96-4a83-a7f0-b9a095ed8933 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:33.053314 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584131ca-57db-462b-9e48-ce34d8b1937e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:33.054116 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584131ca-57db-462b-9e48-ce34d8b1937e admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:33.054599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584131ca-57db-462b-9e48-ce34d8b1937e admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:33.055068 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584131ca-57db-462b-9e48-ce34d8b1937e admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:33.055736 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584131ca-57db-462b-9e48-ce34d8b1937e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:33.057567 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584131ca-57db-462b-9e48-ce34d8b1937e admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:33.070899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1290/2590] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:33.075474 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57334daf-8c17-4bb5-8edb-7021e0b6d03a admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:33.086658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57334daf-8c17-4bb5-8edb-7021e0b6d03a admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:33.091758 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2b2a7-0dd1-40aa-91dd-24db2427f452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:33.092525 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2b2a7-0dd1-40aa-91dd-24db2427f452 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:33.092901 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2b2a7-0dd1-40aa-91dd-24db2427f452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:33.093248 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2b2a7-0dd1-40aa-91dd-24db2427f452 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:33.094041 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2b2a7-0dd1-40aa-91dd-24db2427f452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:33.095714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2b2a7-0dd1-40aa-91dd-24db2427f452 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:33.107999 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1301/2591] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:33.112117 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584131ca-57db-462b-9e48-ce34d8b1937e admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:33.123320 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584131ca-57db-462b-9e48-ce34d8b1937e admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:33.130312 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8460538-c1f8-4d13-bd94-f6f15ef46822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:33.131799 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8460538-c1f8-4d13-bd94-f6f15ef46822 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:33.132245 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8460538-c1f8-4d13-bd94-f6f15ef46822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:33.132646 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8460538-c1f8-4d13-bd94-f6f15ef46822 admin admin] PATH_INFO: `/v3/projects/1b45c7e5f5a2461395c9f4d3ceca50c7/users/1338c2d962674fa7aa19d05efe0948ef/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:33.149743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8460538-c1f8-4d13-bd94-f6f15ef46822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b45c7e5f5a2461395c9f4d3ceca50c7, user_id=1338c2d962674fa7aa19d05efe0948ef, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:33.155280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8460538-c1f8-4d13-bd94-f6f15ef46822 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:33.173748 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1291/2592] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:33 2022] PUT /identity/v3/projects/1b45c7e5f5a2461395c9f4d3ceca50c7/users/1338c2d962674fa7aa19d05efe0948ef/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:33.183734 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb95cf6-65d3-4bcc-abfb-adaeaebc0d5c None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:33.184237 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb95cf6-65d3-4bcc-abfb-adaeaebc0d5c None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:33.184514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb95cf6-65d3-4bcc-abfb-adaeaebc0d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:33.214343 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-aeb95cf6-65d3-4bcc-abfb-adaeaebc0d5c None None] MFA Rules not processed for user `1338c2d962674fa7aa19d05efe0948ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:33.215557 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-aeb95cf6-65d3-4bcc-abfb-adaeaebc0d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:33.299847 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1302/2593] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:33.301044 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8460538-c1f8-4d13-bd94-f6f15ef46822 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:33.362169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8460538-c1f8-4d13-bd94-f6f15ef46822 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:33.367448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c6181-a78f-4f1d-8b44-17ec183a4fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:33.368101 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c6181-a78f-4f1d-8b44-17ec183a4fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:33.368386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c6181-a78f-4f1d-8b44-17ec183a4fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:33.368695 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c6181-a78f-4f1d-8b44-17ec183a4fc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:33.369378 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c6181-a78f-4f1d-8b44-17ec183a4fc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:33.371320 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c6181-a78f-4f1d-8b44-17ec183a4fc1 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:33.401028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1292/2594] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:33 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:33.405223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb95cf6-65d3-4bcc-abfb-adaeaebc0d5c None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:33.428938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb95cf6-65d3-4bcc-abfb-adaeaebc0d5c None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:33.503722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c6181-a78f-4f1d-8b44-17ec183a4fc1 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:33.507100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-086c6181-a78f-4f1d-8b44-17ec183a4fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:33.533863 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e8574-28d0-444c-968c-e0d57e7a8bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:33.534574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e8574-28d0-444c-968c-e0d57e7a8bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:33.534853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e8574-28d0-444c-968c-e0d57e7a8bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:33.535137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e8574-28d0-444c-968c-e0d57e7a8bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:33.535857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e8574-28d0-444c-968c-e0d57e7a8bc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:33.537888 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e8574-28d0-444c-968c-e0d57e7a8bc9 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:33.558781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1303/2595] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:33 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:33.562721 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e8574-28d0-444c-968c-e0d57e7a8bc9 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:33.569470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c6181-a78f-4f1d-8b44-17ec183a4fc1 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:33.573186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e8574-28d0-444c-968c-e0d57e7a8bc9 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:33.573703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78786c-ded9-4a03-ba00-55ddcc852db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:33.574349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78786c-ded9-4a03-ba00-55ddcc852db7 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:33.574632 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78786c-ded9-4a03-ba00-55ddcc852db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:33.574911 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78786c-ded9-4a03-ba00-55ddcc852db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:33.576730 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9f78786c-ded9-4a03-ba00-55ddcc852db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:33.577844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f328cc-c060-46a5-ad4d-bbb8fb1c40dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:33.578475 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f328cc-c060-46a5-ad4d-bbb8fb1c40dd admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:33.578752 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f328cc-c060-46a5-ad4d-bbb8fb1c40dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:33.579024 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f328cc-c060-46a5-ad4d-bbb8fb1c40dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:33.579739 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f328cc-c060-46a5-ad4d-bbb8fb1c40dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:33.581368 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f328cc-c060-46a5-ad4d-bbb8fb1c40dd admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:33.588630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78786c-ded9-4a03-ba00-55ddcc852db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:33.590068 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78786c-ded9-4a03-ba00-55ddcc852db7 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:33.591266 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1304/2596] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:40:33.595230 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f328cc-c060-46a5-ad4d-bbb8fb1c40dd admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:33.599945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1293/2597] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:40:33.605191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f328cc-c060-46a5-ad4d-bbb8fb1c40dd admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:33.610151 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00b4da-f445-4e80-b534-71304afeb17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:33.611099 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00b4da-f445-4e80-b534-71304afeb17a admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:33.611482 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00b4da-f445-4e80-b534-71304afeb17a admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:33.611823 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00b4da-f445-4e80-b534-71304afeb17a admin admin] PATH_INFO: `/v3/projects/f41e2f94a98a4fce8bf993acba8e8a5e/users/490a7d019dd8495db759abad5d45e75d/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:33.628160 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00b4da-f445-4e80-b534-71304afeb17a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41e2f94a98a4fce8bf993acba8e8a5e, user_id=490a7d019dd8495db759abad5d45e75d, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:33.631730 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00b4da-f445-4e80-b534-71304afeb17a admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:33.646608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1305/2598] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:33 2022] PUT /identity/v3/projects/f41e2f94a98a4fce8bf993acba8e8a5e/users/490a7d019dd8495db759abad5d45e75d/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:33.650656 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78786c-ded9-4a03-ba00-55ddcc852db7 service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:33.660791 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78786c-ded9-4a03-ba00-55ddcc852db7 service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:33.723387 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7369d-dfc4-49e2-9410-71c0e9a728fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:33.724054 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7369d-dfc4-49e2-9410-71c0e9a728fa admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:33.724331 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7369d-dfc4-49e2-9410-71c0e9a728fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:33.725163 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7369d-dfc4-49e2-9410-71c0e9a728fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:33.725941 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7369d-dfc4-49e2-9410-71c0e9a728fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:33.728017 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7369d-dfc4-49e2-9410-71c0e9a728fa admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:33.738248 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1294/2599] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:33.742976 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00b4da-f445-4e80-b534-71304afeb17a admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:33.753818 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00b4da-f445-4e80-b534-71304afeb17a admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:33.759049 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724253da-2b33-4388-921a-04b068fee85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:33.760042 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724253da-2b33-4388-921a-04b068fee85f admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:33.760417 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724253da-2b33-4388-921a-04b068fee85f admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:33.760815 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724253da-2b33-4388-921a-04b068fee85f admin admin] PATH_INFO: `/v3/projects/f41e2f94a98a4fce8bf993acba8e8a5e/users/490a7d019dd8495db759abad5d45e75d/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:33.763174 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724253da-2b33-4388-921a-04b068fee85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41e2f94a98a4fce8bf993acba8e8a5e, user_id=490a7d019dd8495db759abad5d45e75d, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:33.766361 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724253da-2b33-4388-921a-04b068fee85f admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:33.777857 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1306/2600] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:33 2022] PUT /identity/v3/projects/f41e2f94a98a4fce8bf993acba8e8a5e/users/490a7d019dd8495db759abad5d45e75d/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:33.791538 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109355d8-810d-4671-a764-ad6960be4dab None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:33.791831 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109355d8-810d-4671-a764-ad6960be4dab None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:33.792111 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109355d8-810d-4671-a764-ad6960be4dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:33.819524 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-109355d8-810d-4671-a764-ad6960be4dab None None] MFA Rules not processed for user `490a7d019dd8495db759abad5d45e75d`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:33.820715 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-109355d8-810d-4671-a764-ad6960be4dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:33.893164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1295/2601] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:33 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:33.903668 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724253da-2b33-4388-921a-04b068fee85f admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:33.905408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-724253da-2b33-4388-921a-04b068fee85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:33.962286 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724253da-2b33-4388-921a-04b068fee85f admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:33.965930 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041e3c5-d61b-4ea2-b9f2-9c386461d6ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:33.966568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041e3c5-d61b-4ea2-b9f2-9c386461d6ef service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:33.966846 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041e3c5-d61b-4ea2-b9f2-9c386461d6ef service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:33.967120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041e3c5-d61b-4ea2-b9f2-9c386461d6ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:33.976482 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041e3c5-d61b-4ea2-b9f2-9c386461d6ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:33.978208 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041e3c5-d61b-4ea2-b9f2-9c386461d6ef service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:33.987362 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1307/2602] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:33 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:34.530734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109355d8-810d-4671-a764-ad6960be4dab None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:34.532292 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-109355d8-810d-4671-a764-ad6960be4dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:34.640775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109355d8-810d-4671-a764-ad6960be4dab None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:34.647066 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41c40e-ce85-40e0-bd3c-8e49d8bfd126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:34.648219 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41c40e-ce85-40e0-bd3c-8e49d8bfd126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:34.648706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41c40e-ce85-40e0-bd3c-8e49d8bfd126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:34.648980 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41c40e-ce85-40e0-bd3c-8e49d8bfd126 admin admin] PATH_INFO: `/v3/users/d4274ff458fc45f3b9d20cf6fe418bb9` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:34.650388 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41c40e-ce85-40e0-bd3c-8e49d8bfd126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4274ff458fc45f3b9d20cf6fe418bb9)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:34.653137 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41c40e-ce85-40e0-bd3c-8e49d8bfd126 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:34.752746 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-bb41c40e-ce85-40e0-bd3c-8e49d8bfd126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4274ff458fc45f3b9d20cf6fe418bb9'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:34.768820 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-bb41c40e-ce85-40e0-bd3c-8e49d8bfd126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4274ff458fc45f3b9d20cf6fe418bb9'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:34.786446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-bb41c40e-ce85-40e0-bd3c-8e49d8bfd126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4274ff458fc45f3b9d20cf6fe418bb9'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:34.793940 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-bb41c40e-ce85-40e0-bd3c-8e49d8bfd126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4274ff458fc45f3b9d20cf6fe418bb9'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:34.795958 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-bb41c40e-ce85-40e0-bd3c-8e49d8bfd126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4274ff458fc45f3b9d20cf6fe418bb9'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:34.847962 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1296/2603] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:34 2022] DELETE /identity/v3/users/d4274ff458fc45f3b9d20cf6fe418bb9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:34.852483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d23338-6ec7-4b06-9877-5c26e0051b6e None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:34.852974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d23338-6ec7-4b06-9877-5c26e0051b6e None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:34.853221 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d23338-6ec7-4b06-9877-5c26e0051b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:34.877612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-b1d23338-6ec7-4b06-9877-5c26e0051b6e None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:34.879128 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b1d23338-6ec7-4b06-9877-5c26e0051b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:34.973072 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1308/2604] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:34.995234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41c40e-ce85-40e0-bd3c-8e49d8bfd126 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:34.997516 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-bb41c40e-ce85-40e0-bd3c-8e49d8bfd126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:35.077770 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41c40e-ce85-40e0-bd3c-8e49d8bfd126 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:35.081672 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1240bf7-8f62-43d4-8da1-d5d2ed022798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:35.082328 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1240bf7-8f62-43d4-8da1-d5d2ed022798 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:35.082607 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1240bf7-8f62-43d4-8da1-d5d2ed022798 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:35.082878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1240bf7-8f62-43d4-8da1-d5d2ed022798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:35.093675 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1240bf7-8f62-43d4-8da1-d5d2ed022798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:35.095193 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1240bf7-8f62-43d4-8da1-d5d2ed022798 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:35.106146 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1297/2605] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:40:35.492836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d23338-6ec7-4b06-9877-5c26e0051b6e None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:35.494974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b1d23338-6ec7-4b06-9877-5c26e0051b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:35.511726 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d23338-6ec7-4b06-9877-5c26e0051b6e None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:35.516809 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47540341-5fd6-4ea0-a7d7-532dc04f1476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:35.517794 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47540341-5fd6-4ea0-a7d7-532dc04f1476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:35.518242 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47540341-5fd6-4ea0-a7d7-532dc04f1476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:35.518750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47540341-5fd6-4ea0-a7d7-532dc04f1476 admin admin] PATH_INFO: `/v3/users/1338c2d962674fa7aa19d05efe0948ef` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:35.520352 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47540341-5fd6-4ea0-a7d7-532dc04f1476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1338c2d962674fa7aa19d05efe0948ef)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:35.523057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47540341-5fd6-4ea0-a7d7-532dc04f1476 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:35.576774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-47540341-5fd6-4ea0-a7d7-532dc04f1476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1338c2d962674fa7aa19d05efe0948ef'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:35.584947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-47540341-5fd6-4ea0-a7d7-532dc04f1476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1338c2d962674fa7aa19d05efe0948ef'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:35.585775 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-47540341-5fd6-4ea0-a7d7-532dc04f1476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1338c2d962674fa7aa19d05efe0948ef'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:35.595372 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-47540341-5fd6-4ea0-a7d7-532dc04f1476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1338c2d962674fa7aa19d05efe0948ef'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:35.596024 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-47540341-5fd6-4ea0-a7d7-532dc04f1476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1338c2d962674fa7aa19d05efe0948ef'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:35.617588 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1240bf7-8f62-43d4-8da1-d5d2ed022798 service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:35.619365 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c1240bf7-8f62-43d4-8da1-d5d2ed022798 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:35.623045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1309/2606] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:35 2022] DELETE /identity/v3/users/1338c2d962674fa7aa19d05efe0948ef => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:35.624691 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36650b-7801-47c9-aa72-c2419c448546 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:35.625015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36650b-7801-47c9-aa72-c2419c448546 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:35.625479 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36650b-7801-47c9-aa72-c2419c448546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:35.634199 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1240bf7-8f62-43d4-8da1-d5d2ed022798 service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:35.649763 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-aa36650b-7801-47c9-aa72-c2419c448546 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:35.651611 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-aa36650b-7801-47c9-aa72-c2419c448546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:35.691622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f998d5-426d-49c6-8fc8-2791293d56c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:35.692480 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f998d5-426d-49c6-8fc8-2791293d56c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:35.692780 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f998d5-426d-49c6-8fc8-2791293d56c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:35.693883 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f998d5-426d-49c6-8fc8-2791293d56c6 admin admin] PATH_INFO: `/v3/projects/bd52476edd0644f99d23c78c37c18327` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:35.695590 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f998d5-426d-49c6-8fc8-2791293d56c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd52476edd0644f99d23c78c37c18327)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:35.697772 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f998d5-426d-49c6-8fc8-2791293d56c6 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:35.717162 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1310/2607] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:35.728145 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36650b-7801-47c9-aa72-c2419c448546 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:35.729842 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-aa36650b-7801-47c9-aa72-c2419c448546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:35.762867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-00f998d5-426d-49c6-8fc8-2791293d56c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd52476edd0644f99d23c78c37c18327', 'request_id': 'req-00f998d5-426d-49c6-8fc8-2791293d56c6'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:35.771816 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-00f998d5-426d-49c6-8fc8-2791293d56c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd52476edd0644f99d23c78c37c18327', 'request_id': 'req-00f998d5-426d-49c6-8fc8-2791293d56c6'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:35.779140 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-00f998d5-426d-49c6-8fc8-2791293d56c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd52476edd0644f99d23c78c37c18327', 'request_id': 'req-00f998d5-426d-49c6-8fc8-2791293d56c6'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:35.794576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-00f998d5-426d-49c6-8fc8-2791293d56c6 admin admin] The token cache is being invalidate because project bd52476edd0644f99d23c78c37c18327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:35.795104 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-00f998d5-426d-49c6-8fc8-2791293d56c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:35.796265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-00f998d5-426d-49c6-8fc8-2791293d56c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:35.799890 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1298/2608] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:35 2022] DELETE /identity/v3/projects/bd52476edd0644f99d23c78c37c18327 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:35.800953 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36650b-7801-47c9-aa72-c2419c448546 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:35.804813 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f998d5-426d-49c6-8fc8-2791293d56c6 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:35.806806 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-00f998d5-426d-49c6-8fc8-2791293d56c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:35.876395 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01a331-c3fc-4efa-a7b3-e20954189cc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:35.877139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01a331-c3fc-4efa-a7b3-e20954189cc4 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:35.877559 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01a331-c3fc-4efa-a7b3-e20954189cc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:35.877841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01a331-c3fc-4efa-a7b3-e20954189cc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:35.885706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-ac01a331-c3fc-4efa-a7b3-e20954189cc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:35.899302 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f998d5-426d-49c6-8fc8-2791293d56c6 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:35.904497 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bee81-db6b-4147-b34d-973d314c71c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:35.905689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bee81-db6b-4147-b34d-973d314c71c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:35.906077 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bee81-db6b-4147-b34d-973d314c71c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:35.906447 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bee81-db6b-4147-b34d-973d314c71c7 admin admin] PATH_INFO: `/v3/users/5dd9589c99754e5b9aad6b1b072646ba` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:35.908166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bee81-db6b-4147-b34d-973d314c71c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dd9589c99754e5b9aad6b1b072646ba)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:35.910232 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bee81-db6b-4147-b34d-973d314c71c7 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:35.954536 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01a331-c3fc-4efa-a7b3-e20954189cc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:35.956658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01a331-c3fc-4efa-a7b3-e20954189cc4 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:35.965673 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-aa7bee81-db6b-4147-b34d-973d314c71c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dd9589c99754e5b9aad6b1b072646ba'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:35.968139 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1311/2609] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:40:35.973150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-aa7bee81-db6b-4147-b34d-973d314c71c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dd9589c99754e5b9aad6b1b072646ba'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:35.982181 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-aa7bee81-db6b-4147-b34d-973d314c71c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dd9589c99754e5b9aad6b1b072646ba'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:35.982876 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-aa7bee81-db6b-4147-b34d-973d314c71c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dd9589c99754e5b9aad6b1b072646ba'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:35.983672 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-aa7bee81-db6b-4147-b34d-973d314c71c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dd9589c99754e5b9aad6b1b072646ba'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:36.002552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1299/2610] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:35 2022] DELETE /identity/v3/users/5dd9589c99754e5b9aad6b1b072646ba => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:36.516800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01a331-c3fc-4efa-a7b3-e20954189cc4 service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:36.518872 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-ac01a331-c3fc-4efa-a7b3-e20954189cc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:36.532738 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01a331-c3fc-4efa-a7b3-e20954189cc4 service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:36.605249 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7000ea-47f6-4968-a291-357dd69c1cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:36.605679 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7000ea-47f6-4968-a291-357dd69c1cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:36.605960 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7000ea-47f6-4968-a291-357dd69c1cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:36.606234 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7000ea-47f6-4968-a291-357dd69c1cd5 admin admin] PATH_INFO: `/v3/projects/1b45c7e5f5a2461395c9f4d3ceca50c7` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:36.607442 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7000ea-47f6-4968-a291-357dd69c1cd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b45c7e5f5a2461395c9f4d3ceca50c7)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:36.609571 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7000ea-47f6-4968-a291-357dd69c1cd5 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:36.673470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bee81-db6b-4147-b34d-973d314c71c7 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:36.674954 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-aa7bee81-db6b-4147-b34d-973d314c71c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:36.696163 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bee81-db6b-4147-b34d-973d314c71c7 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:36.702655 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-8a7000ea-47f6-4968-a291-357dd69c1cd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b45c7e5f5a2461395c9f4d3ceca50c7', 'request_id': 'req-8a7000ea-47f6-4968-a291-357dd69c1cd5'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:36.713199 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-8a7000ea-47f6-4968-a291-357dd69c1cd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b45c7e5f5a2461395c9f4d3ceca50c7', 'request_id': 'req-8a7000ea-47f6-4968-a291-357dd69c1cd5'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:36.723900 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-8a7000ea-47f6-4968-a291-357dd69c1cd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b45c7e5f5a2461395c9f4d3ceca50c7', 'request_id': 'req-8a7000ea-47f6-4968-a291-357dd69c1cd5'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:36.743847 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-8a7000ea-47f6-4968-a291-357dd69c1cd5 admin admin] The token cache is being invalidate because project 1b45c7e5f5a2461395c9f4d3ceca50c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:36.744609 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-8a7000ea-47f6-4968-a291-357dd69c1cd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:36.745984 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-8a7000ea-47f6-4968-a291-357dd69c1cd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:36.748558 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1312/2611] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:36 2022] DELETE /identity/v3/projects/1b45c7e5f5a2461395c9f4d3ceca50c7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:36.752819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7000ea-47f6-4968-a291-357dd69c1cd5 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:36.756807 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-8a7000ea-47f6-4968-a291-357dd69c1cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:36.807525 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4b313-80df-4036-8489-72685845c15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:36.809526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4b313-80df-4036-8489-72685845c15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:36.809978 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4b313-80df-4036-8489-72685845c15a admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:36.811020 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4b313-80df-4036-8489-72685845c15a admin admin] PATH_INFO: `/v3/projects/5b8ed1a7542b4b26bc09668156928228` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:36.812477 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4b313-80df-4036-8489-72685845c15a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b8ed1a7542b4b26bc09668156928228)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:36.815043 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4b313-80df-4036-8489-72685845c15a admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:36.871532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7000ea-47f6-4968-a291-357dd69c1cd5 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:36.874332 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-93b4b313-80df-4036-8489-72685845c15a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b8ed1a7542b4b26bc09668156928228', 'request_id': 'req-93b4b313-80df-4036-8489-72685845c15a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:36.899444 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-93b4b313-80df-4036-8489-72685845c15a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b8ed1a7542b4b26bc09668156928228', 'request_id': 'req-93b4b313-80df-4036-8489-72685845c15a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:36.915953 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-93b4b313-80df-4036-8489-72685845c15a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b8ed1a7542b4b26bc09668156928228', 'request_id': 'req-93b4b313-80df-4036-8489-72685845c15a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:36.941388 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-93b4b313-80df-4036-8489-72685845c15a admin admin] The token cache is being invalidate because project 5b8ed1a7542b4b26bc09668156928228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:36.942466 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-93b4b313-80df-4036-8489-72685845c15a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:36.944615 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-93b4b313-80df-4036-8489-72685845c15a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:36.952020 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1300/2612] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:36 2022] DELETE /identity/v3/projects/5b8ed1a7542b4b26bc09668156928228 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:36.956830 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e68524-594c-4620-9952-06f4ed91b9bb None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:36.957835 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e68524-594c-4620-9952-06f4ed91b9bb None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:36.959476 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e68524-594c-4620-9952-06f4ed91b9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:36.987914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951b0fd-96a9-43b6-9845-0ba04a5a9b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:36.990270 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951b0fd-96a9-43b6-9845-0ba04a5a9b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:36.990562 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951b0fd-96a9-43b6-9845-0ba04a5a9b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:36.990840 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951b0fd-96a9-43b6-9845-0ba04a5a9b3b admin admin] PATH_INFO: `/v3/users/490a7d019dd8495db759abad5d45e75d` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:36.993333 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951b0fd-96a9-43b6-9845-0ba04a5a9b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=490a7d019dd8495db759abad5d45e75d)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:36.995295 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951b0fd-96a9-43b6-9845-0ba04a5a9b3b admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:37.001753 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-48e68524-594c-4620-9952-06f4ed91b9bb None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:37.004075 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-48e68524-594c-4620-9952-06f4ed91b9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:37.025713 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1301/2613] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:37.028882 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155c0b5-7dd6-41ce-bf25-00338c5100a8 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:37.029179 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155c0b5-7dd6-41ce-bf25-00338c5100a8 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:37.029463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155c0b5-7dd6-41ce-bf25-00338c5100a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:37.075100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-2155c0b5-7dd6-41ce-bf25-00338c5100a8 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:37.076369 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-2155c0b5-7dd6-41ce-bf25-00338c5100a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:37.077184 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c951b0fd-96a9-43b6-9845-0ba04a5a9b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490a7d019dd8495db759abad5d45e75d'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:37.095083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c951b0fd-96a9-43b6-9845-0ba04a5a9b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490a7d019dd8495db759abad5d45e75d'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:37.098315 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c951b0fd-96a9-43b6-9845-0ba04a5a9b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490a7d019dd8495db759abad5d45e75d'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:37.101445 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1302/2614] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:37.105642 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155c0b5-7dd6-41ce-bf25-00338c5100a8 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:37.114655 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c951b0fd-96a9-43b6-9845-0ba04a5a9b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490a7d019dd8495db759abad5d45e75d'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:37.116274 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-c951b0fd-96a9-43b6-9845-0ba04a5a9b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490a7d019dd8495db759abad5d45e75d'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:37.122187 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155c0b5-7dd6-41ce-bf25-00338c5100a8 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:37.133385 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634adf4-cb9c-41f8-b663-7845173d8ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:37.134310 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634adf4-cb9c-41f8-b663-7845173d8ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:37.134587 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634adf4-cb9c-41f8-b663-7845173d8ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:37.134862 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634adf4-cb9c-41f8-b663-7845173d8ee3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:37.135587 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634adf4-cb9c-41f8-b663-7845173d8ee3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:40:37.135894 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634adf4-cb9c-41f8-b663-7845173d8ee3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:37.137539 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634adf4-cb9c-41f8-b663-7845173d8ee3 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:37.144969 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1313/2615] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:36 2022] DELETE /identity/v3/users/490a7d019dd8495db759abad5d45e75d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:37.168653 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1303/2616] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:40:37.172268 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951b0fd-96a9-43b6-9845-0ba04a5a9b3b admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:37.174631 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c951b0fd-96a9-43b6-9845-0ba04a5a9b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:37.278164 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951b0fd-96a9-43b6-9845-0ba04a5a9b3b admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:37.283955 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d7570-97dd-43ec-b1df-d4903a948225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:37.285003 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d7570-97dd-43ec-b1df-d4903a948225 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:37.285281 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d7570-97dd-43ec-b1df-d4903a948225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:37.285551 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d7570-97dd-43ec-b1df-d4903a948225 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:37.286252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d7570-97dd-43ec-b1df-d4903a948225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:37.288835 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d7570-97dd-43ec-b1df-d4903a948225 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:37.332179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1314/2617] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:37 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:37.337458 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634adf4-cb9c-41f8-b663-7845173d8ee3 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:37.356145 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634adf4-cb9c-41f8-b663-7845173d8ee3 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:37.449480 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8206d66-25dd-4076-bf33-e67bf0beac8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:37.451229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8206d66-25dd-4076-bf33-e67bf0beac8b admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:37.451786 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8206d66-25dd-4076-bf33-e67bf0beac8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:37.452081 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8206d66-25dd-4076-bf33-e67bf0beac8b admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:37.452861 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8206d66-25dd-4076-bf33-e67bf0beac8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:37.455810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8206d66-25dd-4076-bf33-e67bf0beac8b admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:37.498955 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1304/2618] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:37 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:37.513565 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d7570-97dd-43ec-b1df-d4903a948225 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:37.536064 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d7570-97dd-43ec-b1df-d4903a948225 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:37.537651 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8206d66-25dd-4076-bf33-e67bf0beac8b admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:37.540223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-d8206d66-25dd-4076-bf33-e67bf0beac8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:37.542643 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e29f9-9c2c-4f3f-ab49-c0a5b2ae708f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:37.543328 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e29f9-9c2c-4f3f-ab49-c0a5b2ae708f admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:37.544051 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e29f9-9c2c-4f3f-ab49-c0a5b2ae708f admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:37.544320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e29f9-9c2c-4f3f-ab49-c0a5b2ae708f admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:37.544910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e29f9-9c2c-4f3f-ab49-c0a5b2ae708f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:37.546726 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e29f9-9c2c-4f3f-ab49-c0a5b2ae708f admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:37.567383 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1315/2619] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:37.567555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8206d66-25dd-4076-bf33-e67bf0beac8b admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:37.570947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e29f9-9c2c-4f3f-ab49-c0a5b2ae708f admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:37.575770 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc2ad2-1bba-4c9b-8ace-56cc45dbbc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:37.577006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc2ad2-1bba-4c9b-8ace-56cc45dbbc14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:37.578529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc2ad2-1bba-4c9b-8ace-56cc45dbbc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:37.578883 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc2ad2-1bba-4c9b-8ace-56cc45dbbc14 admin admin] PATH_INFO: `/v3/projects/f41e2f94a98a4fce8bf993acba8e8a5e` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:37.581295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc2ad2-1bba-4c9b-8ace-56cc45dbbc14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f41e2f94a98a4fce8bf993acba8e8a5e)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:37.584724 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc2ad2-1bba-4c9b-8ace-56cc45dbbc14 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:37.592069 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e29f9-9c2c-4f3f-ab49-c0a5b2ae708f admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:37.596925 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f085ae-2c9f-4191-9f6a-eb4c652c694c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:37.597601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f085ae-2c9f-4191-9f6a-eb4c652c694c admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:37.597884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f085ae-2c9f-4191-9f6a-eb4c652c694c admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:37.598159 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f085ae-2c9f-4191-9f6a-eb4c652c694c admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:37.598903 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f085ae-2c9f-4191-9f6a-eb4c652c694c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:37.600778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f085ae-2c9f-4191-9f6a-eb4c652c694c admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:37.615353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1316/2620] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:37.616449 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f085ae-2c9f-4191-9f6a-eb4c652c694c admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:37.643804 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f085ae-2c9f-4191-9f6a-eb4c652c694c admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:37.653780 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9a415-3799-4506-bd0f-1a1d55c117c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:37.654628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9a415-3799-4506-bd0f-1a1d55c117c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:37.654854 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9a415-3799-4506-bd0f-1a1d55c117c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:37.655270 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9a415-3799-4506-bd0f-1a1d55c117c8 admin admin] PATH_INFO: `/v3/projects/fde907dde45848808adbd733e7acd818/users/526901f3614344c6a299fb4478b451e7/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:37.675675 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9a415-3799-4506-bd0f-1a1d55c117c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde907dde45848808adbd733e7acd818, user_id=526901f3614344c6a299fb4478b451e7, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:37.678569 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9a415-3799-4506-bd0f-1a1d55c117c8 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:37.681844 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-68fc2ad2-1bba-4c9b-8ace-56cc45dbbc14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f41e2f94a98a4fce8bf993acba8e8a5e', 'request_id': 'req-68fc2ad2-1bba-4c9b-8ace-56cc45dbbc14'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:37.690175 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-68fc2ad2-1bba-4c9b-8ace-56cc45dbbc14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f41e2f94a98a4fce8bf993acba8e8a5e', 'request_id': 'req-68fc2ad2-1bba-4c9b-8ace-56cc45dbbc14'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:37.696509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1317/2621] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:37 2022] PUT /identity/v3/projects/fde907dde45848808adbd733e7acd818/users/526901f3614344c6a299fb4478b451e7/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:37.698122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-68fc2ad2-1bba-4c9b-8ace-56cc45dbbc14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f41e2f94a98a4fce8bf993acba8e8a5e', 'request_id': 'req-68fc2ad2-1bba-4c9b-8ace-56cc45dbbc14'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:37.712797 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df48c03-b89a-4092-94f0-eea61c48781a None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:37.713135 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df48c03-b89a-4092-94f0-eea61c48781a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:37.713418 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df48c03-b89a-4092-94f0-eea61c48781a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:37.718001 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-68fc2ad2-1bba-4c9b-8ace-56cc45dbbc14 admin admin] The token cache is being invalidate because project f41e2f94a98a4fce8bf993acba8e8a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:37.718364 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-68fc2ad2-1bba-4c9b-8ace-56cc45dbbc14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:37.719249 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-68fc2ad2-1bba-4c9b-8ace-56cc45dbbc14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:37.721065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1305/2622] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:37 2022] DELETE /identity/v3/projects/f41e2f94a98a4fce8bf993acba8e8a5e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:37.726307 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e473a5-21c3-4e7c-b42c-d3d7e8d73b2f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:37.726665 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e473a5-21c3-4e7c-b42c-d3d7e8d73b2f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:37.727286 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e473a5-21c3-4e7c-b42c-d3d7e8d73b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:37.745767 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-0df48c03-b89a-4092-94f0-eea61c48781a None None] MFA Rules not processed for user `526901f3614344c6a299fb4478b451e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:37.747739 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-0df48c03-b89a-4092-94f0-eea61c48781a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:37.758301 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-d1e473a5-21c3-4e7c-b42c-d3d7e8d73b2f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:37.759943 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-d1e473a5-21c3-4e7c-b42c-d3d7e8d73b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:37.833352 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1306/2623] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:37.834641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1318/2624] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:37.839348 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e473a5-21c3-4e7c-b42c-d3d7e8d73b2f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:37.841064 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1fc9-31e6-4d25-a567-9e66f0effefe None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:37.841183 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-d1e473a5-21c3-4e7c-b42c-d3d7e8d73b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:37.841595 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1fc9-31e6-4d25-a567-9e66f0effefe None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:37.842045 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1fc9-31e6-4d25-a567-9e66f0effefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:37.856096 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e473a5-21c3-4e7c-b42c-d3d7e8d73b2f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:37.861917 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-848f1fc9-31e6-4d25-a567-9e66f0effefe None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:37.863171 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-848f1fc9-31e6-4d25-a567-9e66f0effefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:37.863812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0ed76-b691-4239-95a1-6cce0d4074ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:37.864556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0ed76-b691-4239-95a1-6cce0d4074ff admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:37.864851 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0ed76-b691-4239-95a1-6cce0d4074ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:37.865662 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0ed76-b691-4239-95a1-6cce0d4074ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:37.866355 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0ed76-b691-4239-95a1-6cce0d4074ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:37.868376 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0ed76-b691-4239-95a1-6cce0d4074ff admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:37.876683 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1319/2625] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:37.877811 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f1fc9-31e6-4d25-a567-9e66f0effefe None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:37.879184 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-848f1fc9-31e6-4d25-a567-9e66f0effefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:37.892477 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f1fc9-31e6-4d25-a567-9e66f0effefe None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:37.896556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1307/2626] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:37 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:37.897399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54855b80-4811-45ca-96e7-39502c69e7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:37.898355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54855b80-4811-45ca-96e7-39502c69e7d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:37.898707 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54855b80-4811-45ca-96e7-39502c69e7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:37.899059 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54855b80-4811-45ca-96e7-39502c69e7d6 admin admin] PATH_INFO: `/v3/users/dd4e3bdb8957489b95d48c6f9bd91ca3` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:37.900132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0ed76-b691-4239-95a1-6cce0d4074ff admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:37.900462 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54855b80-4811-45ca-96e7-39502c69e7d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd4e3bdb8957489b95d48c6f9bd91ca3)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:37.902505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54855b80-4811-45ca-96e7-39502c69e7d6 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:37.951915 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-54855b80-4811-45ca-96e7-39502c69e7d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd4e3bdb8957489b95d48c6f9bd91ca3'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:37.958787 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-54855b80-4811-45ca-96e7-39502c69e7d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd4e3bdb8957489b95d48c6f9bd91ca3'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:37.959460 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-54855b80-4811-45ca-96e7-39502c69e7d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd4e3bdb8957489b95d48c6f9bd91ca3'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:37.967289 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0ed76-b691-4239-95a1-6cce0d4074ff admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:37.968485 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-54855b80-4811-45ca-96e7-39502c69e7d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd4e3bdb8957489b95d48c6f9bd91ca3'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:37.969145 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-54855b80-4811-45ca-96e7-39502c69e7d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd4e3bdb8957489b95d48c6f9bd91ca3'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:37.972846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef23d6-34ec-42a0-9856-72190c5584a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:37.973605 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef23d6-34ec-42a0-9856-72190c5584a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:37.973808 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef23d6-34ec-42a0-9856-72190c5584a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:37.974095 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef23d6-34ec-42a0-9856-72190c5584a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:37.974913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef23d6-34ec-42a0-9856-72190c5584a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:40:37.975196 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef23d6-34ec-42a0-9856-72190c5584a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:37.976768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef23d6-34ec-42a0-9856-72190c5584a1 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:37.987700 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1320/2627] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:37 2022] DELETE /identity/v3/users/dd4e3bdb8957489b95d48c6f9bd91ca3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:37.988601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54855b80-4811-45ca-96e7-39502c69e7d6 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:37.989462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1308/2628] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:40:37.994159 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-54855b80-4811-45ca-96e7-39502c69e7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:37.994364 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef23d6-34ec-42a0-9856-72190c5584a1 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:37.996222 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-afef23d6-34ec-42a0-9856-72190c5584a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:38.012205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef23d6-34ec-42a0-9856-72190c5584a1 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:38.074800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54855b80-4811-45ca-96e7-39502c69e7d6 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:38.080350 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a72c7b-26a8-4e24-99b3-b0d3f1445c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:38.080881 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a72c7b-26a8-4e24-99b3-b0d3f1445c21 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.081273 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a72c7b-26a8-4e24-99b3-b0d3f1445c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.081792 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a72c7b-26a8-4e24-99b3-b0d3f1445c21 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.082439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a72c7b-26a8-4e24-99b3-b0d3f1445c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:38.084490 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a72c7b-26a8-4e24-99b3-b0d3f1445c21 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:38.094654 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ef697-c7ed-459d-8dcd-7cab835ea22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:38.095570 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ef697-c7ed-459d-8dcd-7cab835ea22f admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.095854 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ef697-c7ed-459d-8dcd-7cab835ea22f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.096185 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ef697-c7ed-459d-8dcd-7cab835ea22f admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.097048 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ef697-c7ed-459d-8dcd-7cab835ea22f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:38.099453 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ef697-c7ed-459d-8dcd-7cab835ea22f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:38.110816 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1321/2629] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:37 2022] POST /identity/v3/users => generated 298 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:38.113898 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a72c7b-26a8-4e24-99b3-b0d3f1445c21 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:38.125747 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a72c7b-26a8-4e24-99b3-b0d3f1445c21 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:38.131606 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b12180-ab26-4a9e-acd3-a600da50cbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:38.132269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b12180-ab26-4a9e-acd3-a600da50cbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.132576 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b12180-ab26-4a9e-acd3-a600da50cbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.132862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b12180-ab26-4a9e-acd3-a600da50cbe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.133766 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b12180-ab26-4a9e-acd3-a600da50cbe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:38.135402 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b12180-ab26-4a9e-acd3-a600da50cbe7 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:38.136190 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1309/2630] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:37 2022] POST /identity/v3/projects => generated 399 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:38.137295 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ef697-c7ed-459d-8dcd-7cab835ea22f admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:38.145871 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1322/2631] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:40:38.149795 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b12180-ab26-4a9e-acd3-a600da50cbe7 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:38.166036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b12180-ab26-4a9e-acd3-a600da50cbe7 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:38.220559 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ef697-c7ed-459d-8dcd-7cab835ea22f admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:38.225824 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ebdd7-71fe-4c48-b715-e6199847dff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:38.226489 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ebdd7-71fe-4c48-b715-e6199847dff0 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.226770 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ebdd7-71fe-4c48-b715-e6199847dff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.227312 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ebdd7-71fe-4c48-b715-e6199847dff0 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.228003 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ebdd7-71fe-4c48-b715-e6199847dff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:38.229969 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ebdd7-71fe-4c48-b715-e6199847dff0 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:38.239075 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeb15a-3ada-4ae3-b624-4be677dc6f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:38.240708 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeb15a-3ada-4ae3-b624-4be677dc6f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.240937 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeb15a-3ada-4ae3-b624-4be677dc6f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.241250 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeb15a-3ada-4ae3-b624-4be677dc6f7c admin admin] PATH_INFO: `/v3/projects/459474be3c384d288f782c11e1d6653e/users/1e8e124cfcdb4cbcbe402cefb416d593/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.250061 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1310/2632] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:38 2022] POST /identity/v3/users => generated 300 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:38.250879 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ebdd7-71fe-4c48-b715-e6199847dff0 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:38.252589 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c10ebdd7-71fe-4c48-b715-e6199847dff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:38.258232 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbeb15a-3ada-4ae3-b624-4be677dc6f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=459474be3c384d288f782c11e1d6653e, user_id=1e8e124cfcdb4cbcbe402cefb416d593, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:38.261017 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbeb15a-3ada-4ae3-b624-4be677dc6f7c admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:38.264879 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ebdd7-71fe-4c48-b715-e6199847dff0 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:38.269783 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ba9f2-cd73-4eb9-a17d-86ee163277bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:38.270621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ba9f2-cd73-4eb9-a17d-86ee163277bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.270898 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ba9f2-cd73-4eb9-a17d-86ee163277bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.271197 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ba9f2-cd73-4eb9-a17d-86ee163277bd admin admin] PATH_INFO: `/v3/projects/d822816898904cd89c9565cad32a3000` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.272358 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ba9f2-cd73-4eb9-a17d-86ee163277bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d822816898904cd89c9565cad32a3000)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:38.274032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1323/2633] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:38 2022] PUT /identity/v3/projects/459474be3c384d288f782c11e1d6653e/users/1e8e124cfcdb4cbcbe402cefb416d593/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:38.277097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ba9f2-cd73-4eb9-a17d-86ee163277bd admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:38.277245 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeb15a-3ada-4ae3-b624-4be677dc6f7c admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:38.321680 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4e5ba9f2-cd73-4eb9-a17d-86ee163277bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd822816898904cd89c9565cad32a3000', 'request_id': 'req-4e5ba9f2-cd73-4eb9-a17d-86ee163277bd'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:38.329396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4e5ba9f2-cd73-4eb9-a17d-86ee163277bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd822816898904cd89c9565cad32a3000', 'request_id': 'req-4e5ba9f2-cd73-4eb9-a17d-86ee163277bd'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:38.333862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeb15a-3ada-4ae3-b624-4be677dc6f7c admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:38.334892 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4e5ba9f2-cd73-4eb9-a17d-86ee163277bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd822816898904cd89c9565cad32a3000', 'request_id': 'req-4e5ba9f2-cd73-4eb9-a17d-86ee163277bd'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:38.346975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4e5ba9f2-cd73-4eb9-a17d-86ee163277bd admin admin] The token cache is being invalidate because project d822816898904cd89c9565cad32a3000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:38.347261 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4e5ba9f2-cd73-4eb9-a17d-86ee163277bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:38.347894 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4e5ba9f2-cd73-4eb9-a17d-86ee163277bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:38.350015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1311/2634] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:38 2022] DELETE /identity/v3/projects/d822816898904cd89c9565cad32a3000 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:38.350893 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ba9f2-cd73-4eb9-a17d-86ee163277bd admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:38.352460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-4e5ba9f2-cd73-4eb9-a17d-86ee163277bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:38.390474 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd72909-e56a-429f-b96c-dc9e44f88ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:38.391148 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd72909-e56a-429f-b96c-dc9e44f88ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.391435 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd72909-e56a-429f-b96c-dc9e44f88ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.391697 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd72909-e56a-429f-b96c-dc9e44f88ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.392426 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd72909-e56a-429f-b96c-dc9e44f88ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:38.394049 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd72909-e56a-429f-b96c-dc9e44f88ef8 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:38.403601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1324/2635] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:38.404919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b88c3-0d7b-4aa1-aede-f9c3d4820966 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.405204 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b88c3-0d7b-4aa1-aede-f9c3d4820966 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.405478 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b88c3-0d7b-4aa1-aede-f9c3d4820966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.421171 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ba9f2-cd73-4eb9-a17d-86ee163277bd admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:38.423460 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-b73b88c3-0d7b-4aa1-aede-f9c3d4820966 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:38.424671 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b73b88c3-0d7b-4aa1-aede-f9c3d4820966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:38.425806 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822fb7a-960b-453d-ad9e-2b33f50d953c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:38.426470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822fb7a-960b-453d-ad9e-2b33f50d953c admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.426759 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822fb7a-960b-453d-ad9e-2b33f50d953c admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.427033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822fb7a-960b-453d-ad9e-2b33f50d953c admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.428389 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822fb7a-960b-453d-ad9e-2b33f50d953c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:38.430029 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822fb7a-960b-453d-ad9e-2b33f50d953c admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:38.433516 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1325/2636] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:38.437586 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b88c3-0d7b-4aa1-aede-f9c3d4820966 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:38.439016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b73b88c3-0d7b-4aa1-aede-f9c3d4820966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:38.440938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1312/2637] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:38.442368 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb82a16-ce64-48af-a26e-4e451b910b48 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.442651 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb82a16-ce64-48af-a26e-4e451b910b48 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.442926 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb82a16-ce64-48af-a26e-4e451b910b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.451251 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b88c3-0d7b-4aa1-aede-f9c3d4820966 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:38.455985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbfcd7-0d41-4181-913a-e6de12d5630c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:38.456739 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbfcd7-0d41-4181-913a-e6de12d5630c admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.457075 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbfcd7-0d41-4181-913a-e6de12d5630c admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.457356 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbfcd7-0d41-4181-913a-e6de12d5630c admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.458116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fbfcd7-0d41-4181-913a-e6de12d5630c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:38.459765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fbfcd7-0d41-4181-913a-e6de12d5630c admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:38.460249 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-8cb82a16-ce64-48af-a26e-4e451b910b48 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:38.461451 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-8cb82a16-ce64-48af-a26e-4e451b910b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:38.469319 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1313/2638] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:38.473106 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1326/2639] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:38.473383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb82a16-ce64-48af-a26e-4e451b910b48 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:38.474945 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbfcd7-0d41-4181-913a-e6de12d5630c admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:38.483112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb82a16-ce64-48af-a26e-4e451b910b48 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:38.484735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbfcd7-0d41-4181-913a-e6de12d5630c admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:38.487622 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a3646-eff2-4fb3-939d-1bdbc19b57de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:38.488467 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a3646-eff2-4fb3-939d-1bdbc19b57de admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.488849 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a3646-eff2-4fb3-939d-1bdbc19b57de admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.489121 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a3646-eff2-4fb3-939d-1bdbc19b57de admin admin] PATH_INFO: `/v3/projects/459474be3c384d288f782c11e1d6653e/users/1e8e124cfcdb4cbcbe402cefb416d593/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.489592 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b266d-732c-4c71-899e-e4c8b427b530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:38.491116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b266d-732c-4c71-899e-e4c8b427b530 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.491402 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b266d-732c-4c71-899e-e4c8b427b530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.491621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a3646-eff2-4fb3-939d-1bdbc19b57de admin admin] RBAC: Authorizing `identity:create_grant(project_id=459474be3c384d288f782c11e1d6653e, user_id=1e8e124cfcdb4cbcbe402cefb416d593, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:38.491738 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b266d-732c-4c71-899e-e4c8b427b530 admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.492391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b266d-732c-4c71-899e-e4c8b427b530 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:40:38.492730 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b266d-732c-4c71-899e-e4c8b427b530 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:38.494281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a3646-eff2-4fb3-939d-1bdbc19b57de admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:38.494416 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b266d-732c-4c71-899e-e4c8b427b530 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:38.504320 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1314/2640] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:38 2022] PUT /identity/v3/projects/459474be3c384d288f782c11e1d6653e/users/1e8e124cfcdb4cbcbe402cefb416d593/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:38.505330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a3646-eff2-4fb3-939d-1bdbc19b57de admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:38.509603 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1327/2641] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:40:38.510504 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b266d-732c-4c71-899e-e4c8b427b530 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:38.519844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b266d-732c-4c71-899e-e4c8b427b530 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:38.570614 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a3646-eff2-4fb3-939d-1bdbc19b57de admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:38.575408 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0456290-ba03-4591-b385-9ee1c621dae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:38.576806 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0456290-ba03-4591-b385-9ee1c621dae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.577263 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0456290-ba03-4591-b385-9ee1c621dae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.577398 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759bf0b-226c-44f0-8a82-e95c8b5223ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:38.577719 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0456290-ba03-4591-b385-9ee1c621dae8 admin admin] PATH_INFO: `/v3/projects/09a5dca1ce44456b9dd4e50bc24aa245/users/e81cd48af0de4aadb76c7aa4b043960c/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.578055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759bf0b-226c-44f0-8a82-e95c8b5223ee admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.578335 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759bf0b-226c-44f0-8a82-e95c8b5223ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.578610 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759bf0b-226c-44f0-8a82-e95c8b5223ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.579299 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759bf0b-226c-44f0-8a82-e95c8b5223ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:38.581346 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759bf0b-226c-44f0-8a82-e95c8b5223ee admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:38.593312 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0456290-ba03-4591-b385-9ee1c621dae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09a5dca1ce44456b9dd4e50bc24aa245, user_id=e81cd48af0de4aadb76c7aa4b043960c, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:38.596031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0456290-ba03-4591-b385-9ee1c621dae8 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:38.614323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1328/2642] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:38 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:38.614323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9eae9a-1a5e-4572-afef-b0a3065ff716 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.614323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9eae9a-1a5e-4572-afef-b0a3065ff716 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.614323 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9eae9a-1a5e-4572-afef-b0a3065ff716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.616669 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1315/2643] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:38 2022] PUT /identity/v3/projects/09a5dca1ce44456b9dd4e50bc24aa245/users/e81cd48af0de4aadb76c7aa4b043960c/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:38.617745 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0456290-ba03-4591-b385-9ee1c621dae8 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:38.643846 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-8b9eae9a-1a5e-4572-afef-b0a3065ff716 None None] MFA Rules not processed for user `1e8e124cfcdb4cbcbe402cefb416d593`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:38.645112 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-8b9eae9a-1a5e-4572-afef-b0a3065ff716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:38.684938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0456290-ba03-4591-b385-9ee1c621dae8 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:38.716962 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1329/2644] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:38.720848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3328c67-fffa-40d2-8f00-5a889c67998d None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.720848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3328c67-fffa-40d2-8f00-5a889c67998d None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.720848 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3328c67-fffa-40d2-8f00-5a889c67998d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.745739 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-d3328c67-fffa-40d2-8f00-5a889c67998d None None] MFA Rules not processed for user `e81cd48af0de4aadb76c7aa4b043960c`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:38.746943 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d3328c67-fffa-40d2-8f00-5a889c67998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:38.748460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec013691-d05a-43af-a804-9a9e2cdcb347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:38.749167 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec013691-d05a-43af-a804-9a9e2cdcb347 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.749450 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec013691-d05a-43af-a804-9a9e2cdcb347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.749725 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec013691-d05a-43af-a804-9a9e2cdcb347 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.750410 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec013691-d05a-43af-a804-9a9e2cdcb347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:38.752323 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec013691-d05a-43af-a804-9a9e2cdcb347 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:38.775234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1316/2645] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:38 2022] POST /identity/v3/users => generated 282 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:38.775234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec013691-d05a-43af-a804-9a9e2cdcb347 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:38.775234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-ec013691-d05a-43af-a804-9a9e2cdcb347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:38.817178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1330/2646] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:38.817178 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3328c67-fffa-40d2-8f00-5a889c67998d None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:38.832201 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3328c67-fffa-40d2-8f00-5a889c67998d None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:38.838029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd9bb6-1497-4836-bdba-6ba31b285e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:38.838798 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd9bb6-1497-4836-bdba-6ba31b285e3c admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.839173 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd9bb6-1497-4836-bdba-6ba31b285e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.839564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd9bb6-1497-4836-bdba-6ba31b285e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.840402 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd9bb6-1497-4836-bdba-6ba31b285e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:38.842253 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd9bb6-1497-4836-bdba-6ba31b285e3c admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:38.846943 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec013691-d05a-43af-a804-9a9e2cdcb347 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:38.852187 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efea5ac-80ae-4ab1-8ae5-f6e478fe9041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:38.852880 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efea5ac-80ae-4ab1-8ae5-f6e478fe9041 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.853162 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efea5ac-80ae-4ab1-8ae5-f6e478fe9041 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.853432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efea5ac-80ae-4ab1-8ae5-f6e478fe9041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.854838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1331/2647] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:38.855708 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd9bb6-1497-4836-bdba-6ba31b285e3c admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:38.866904 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efea5ac-80ae-4ab1-8ae5-f6e478fe9041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:38.867555 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd9bb6-1497-4836-bdba-6ba31b285e3c admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:38.868502 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efea5ac-80ae-4ab1-8ae5-f6e478fe9041 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:38.873116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc85f6b-8bcd-42a5-947f-70a8f2e3054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:38.873845 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc85f6b-8bcd-42a5-947f-70a8f2e3054d admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.874204 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc85f6b-8bcd-42a5-947f-70a8f2e3054d admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.874548 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc85f6b-8bcd-42a5-947f-70a8f2e3054d admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.875315 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc85f6b-8bcd-42a5-947f-70a8f2e3054d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:38.877347 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc85f6b-8bcd-42a5-947f-70a8f2e3054d admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:38.878341 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1317/2648] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:38.884579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efea5ac-80ae-4ab1-8ae5-f6e478fe9041 service cinder] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:38.896625 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efea5ac-80ae-4ab1-8ae5-f6e478fe9041 service cinder] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:38.908096 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d501df-a29e-4b68-813e-5106bcb8f14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:38.909036 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d501df-a29e-4b68-813e-5106bcb8f14c admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.909828 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1332/2649] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:38 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:38.910505 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d501df-a29e-4b68-813e-5106bcb8f14c admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.911057 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d501df-a29e-4b68-813e-5106bcb8f14c admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:38.912723 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d501df-a29e-4b68-813e-5106bcb8f14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:38.913935 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc85f6b-8bcd-42a5-947f-70a8f2e3054d admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:38.915012 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d501df-a29e-4b68-813e-5106bcb8f14c admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:38.936701 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1318/2650] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:38.941367 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d501df-a29e-4b68-813e-5106bcb8f14c admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:38.953304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d501df-a29e-4b68-813e-5106bcb8f14c admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:38.992158 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc85f6b-8bcd-42a5-947f-70a8f2e3054d admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:38.997565 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de893f5-caa0-40ba-aa4d-3d88bc72336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:38.998636 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de893f5-caa0-40ba-aa4d-3d88bc72336e admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:38.998930 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de893f5-caa0-40ba-aa4d-3d88bc72336e admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:38.999211 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de893f5-caa0-40ba-aa4d-3d88bc72336e admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:39.000265 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de893f5-caa0-40ba-aa4d-3d88bc72336e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:39.002677 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de893f5-caa0-40ba-aa4d-3d88bc72336e admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:39.028593 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1333/2651] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:38 2022] POST /identity/v3/users => generated 306 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:39.030146 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de893f5-caa0-40ba-aa4d-3d88bc72336e admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:39.031472 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd08d7-bc56-4176-a652-87d0042a0b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:39.032493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd08d7-bc56-4176-a652-87d0042a0b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:39.032936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd08d7-bc56-4176-a652-87d0042a0b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:39.033299 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd08d7-bc56-4176-a652-87d0042a0b02 admin admin] PATH_INFO: `/v3/projects/814af779f240483087b7c317d2d825ff/users/924aafecf27f40269a98cd43a92c8b4b/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:39.050028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd08d7-bc56-4176-a652-87d0042a0b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=814af779f240483087b7c317d2d825ff, user_id=924aafecf27f40269a98cd43a92c8b4b, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:39.053944 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd08d7-bc56-4176-a652-87d0042a0b02 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:39.067947 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1319/2652] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:38 2022] PUT /identity/v3/projects/814af779f240483087b7c317d2d825ff/users/924aafecf27f40269a98cd43a92c8b4b/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:39.072767 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd08d7-bc56-4176-a652-87d0042a0b02 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:39.106093 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de893f5-caa0-40ba-aa4d-3d88bc72336e admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:39.143433 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd08d7-bc56-4176-a652-87d0042a0b02 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:39.149576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911aab3-0bb8-4a10-bfc7-fd7d34254e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:39.150293 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911aab3-0bb8-4a10-bfc7-fd7d34254e88 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:39.150573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911aab3-0bb8-4a10-bfc7-fd7d34254e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:39.150968 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911aab3-0bb8-4a10-bfc7-fd7d34254e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:39.151925 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911aab3-0bb8-4a10-bfc7-fd7d34254e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:39.156104 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620dd2d-e0e9-4e3d-a5d5-5b79191f8b46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:39.156614 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911aab3-0bb8-4a10-bfc7-fd7d34254e88 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:39.156817 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620dd2d-e0e9-4e3d-a5d5-5b79191f8b46 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:39.157066 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620dd2d-e0e9-4e3d-a5d5-5b79191f8b46 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:39.157340 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620dd2d-e0e9-4e3d-a5d5-5b79191f8b46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:39.159320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-4620dd2d-e0e9-4e3d-a5d5-5b79191f8b46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:39.167918 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1320/2653] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:39.169240 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783ce46-a049-4e03-bb77-7fd6bfaca6c0 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:39.169529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783ce46-a049-4e03-bb77-7fd6bfaca6c0 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:39.169807 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783ce46-a049-4e03-bb77-7fd6bfaca6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:39.196908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-8783ce46-a049-4e03-bb77-7fd6bfaca6c0 None None] MFA Rules not processed for user `924aafecf27f40269a98cd43a92c8b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:39.198111 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-8783ce46-a049-4e03-bb77-7fd6bfaca6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:39.227870 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620dd2d-e0e9-4e3d-a5d5-5b79191f8b46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:39.229719 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620dd2d-e0e9-4e3d-a5d5-5b79191f8b46 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:39.241330 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1334/2654] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:39.242039 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620dd2d-e0e9-4e3d-a5d5-5b79191f8b46 service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:39.254675 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620dd2d-e0e9-4e3d-a5d5-5b79191f8b46 service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:39.261330 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fea95-6d74-471e-a64a-f92fc43da3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:39.262350 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fea95-6d74-471e-a64a-f92fc43da3a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:39.262631 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fea95-6d74-471e-a64a-f92fc43da3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:39.262903 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fea95-6d74-471e-a64a-f92fc43da3a3 admin admin] PATH_INFO: `/v3/projects/f5d3a29ef6c04399b2d4f1916f61cd34/users/24819788e21141369c2bb1ef9db57123/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:39.276960 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1321/2655] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:39 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:39.284637 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783ce46-a049-4e03-bb77-7fd6bfaca6c0 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:39.289205 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fea95-6d74-471e-a64a-f92fc43da3a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5d3a29ef6c04399b2d4f1916f61cd34, user_id=24819788e21141369c2bb1ef9db57123, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:39.293458 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fea95-6d74-471e-a64a-f92fc43da3a3 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:39.298052 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783ce46-a049-4e03-bb77-7fd6bfaca6c0 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:39.306682 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3271fb0-f869-4fd3-85db-b045579de43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:39.307556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3271fb0-f869-4fd3-85db-b045579de43a admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:39.307982 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3271fb0-f869-4fd3-85db-b045579de43a admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:39.308373 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3271fb0-f869-4fd3-85db-b045579de43a admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:39.309484 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3271fb0-f869-4fd3-85db-b045579de43a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:39.311993 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3271fb0-f869-4fd3-85db-b045579de43a admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:39.316972 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1335/2656] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:39 2022] PUT /identity/v3/projects/f5d3a29ef6c04399b2d4f1916f61cd34/users/24819788e21141369c2bb1ef9db57123/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:39.329223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fea95-6d74-471e-a64a-f92fc43da3a3 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:39.348305 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1322/2657] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:39 2022] POST /identity/v3/projects => generated 363 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:39.353265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3271fb0-f869-4fd3-85db-b045579de43a admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:39.436227 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fea95-6d74-471e-a64a-f92fc43da3a3 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:39.436784 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3271fb0-f869-4fd3-85db-b045579de43a admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:39.442442 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6442120-431a-4a70-967f-c09fa67ec06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:39.442627 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad33ce1-273c-41b2-ad6f-58678fffd47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:39.443208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad33ce1-273c-41b2-ad6f-58678fffd47a admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:39.443329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6442120-431a-4a70-967f-c09fa67ec06c admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:39.443504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad33ce1-273c-41b2-ad6f-58678fffd47a admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:39.443661 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6442120-431a-4a70-967f-c09fa67ec06c admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:39.443779 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad33ce1-273c-41b2-ad6f-58678fffd47a admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:39.444060 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6442120-431a-4a70-967f-c09fa67ec06c admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:39.444710 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad33ce1-273c-41b2-ad6f-58678fffd47a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:39.445001 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6442120-431a-4a70-967f-c09fa67ec06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:39.446867 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6442120-431a-4a70-967f-c09fa67ec06c admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:39.447492 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad33ce1-273c-41b2-ad6f-58678fffd47a admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:39.459677 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1336/2658] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:40:39.464272 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6442120-431a-4a70-967f-c09fa67ec06c admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:39.470277 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1323/2659] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:39 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:39.474969 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad33ce1-273c-41b2-ad6f-58678fffd47a admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:39.482254 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6442120-431a-4a70-967f-c09fa67ec06c admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:39.485958 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad33ce1-273c-41b2-ad6f-58678fffd47a admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:39.487654 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a3317-6838-4b0d-87c8-dba40159f340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:39.488682 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a3317-6838-4b0d-87c8-dba40159f340 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:39.489185 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a3317-6838-4b0d-87c8-dba40159f340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:39.489424 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a3317-6838-4b0d-87c8-dba40159f340 admin admin] PATH_INFO: `/v3/projects/f5d3a29ef6c04399b2d4f1916f61cd34/users/24819788e21141369c2bb1ef9db57123/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:39.491174 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643272c-bfd2-4915-af3e-c4c7ba6c4ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:39.491775 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643272c-bfd2-4915-af3e-c4c7ba6c4ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:39.492165 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a3317-6838-4b0d-87c8-dba40159f340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5d3a29ef6c04399b2d4f1916f61cd34, user_id=24819788e21141369c2bb1ef9db57123, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:39.492328 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643272c-bfd2-4915-af3e-c4c7ba6c4ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:39.492458 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643272c-bfd2-4915-af3e-c4c7ba6c4ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:39.493191 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643272c-bfd2-4915-af3e-c4c7ba6c4ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:39.494941 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643272c-bfd2-4915-af3e-c4c7ba6c4ab3 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:39.495179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a3317-6838-4b0d-87c8-dba40159f340 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:39.504825 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1324/2660] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:40:39.509324 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643272c-bfd2-4915-af3e-c4c7ba6c4ab3 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:39.509459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1337/2661] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:39 2022] PUT /identity/v3/projects/f5d3a29ef6c04399b2d4f1916f61cd34/users/24819788e21141369c2bb1ef9db57123/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:39.519352 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643272c-bfd2-4915-af3e-c4c7ba6c4ab3 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:39.520041 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584f1ac-a6fe-4aed-8978-89bf5a4bd0de None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:39.520393 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584f1ac-a6fe-4aed-8978-89bf5a4bd0de None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:39.520646 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584f1ac-a6fe-4aed-8978-89bf5a4bd0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:39.551826 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-5584f1ac-a6fe-4aed-8978-89bf5a4bd0de None None] MFA Rules not processed for user `24819788e21141369c2bb1ef9db57123`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:39.553282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-5584f1ac-a6fe-4aed-8978-89bf5a4bd0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:39.597942 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a8e74-10cc-45f7-a3c7-a6adc48087da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:39.597942 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a8e74-10cc-45f7-a3c7-a6adc48087da admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:39.598144 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a8e74-10cc-45f7-a3c7-a6adc48087da admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:39.598379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a8e74-10cc-45f7-a3c7-a6adc48087da admin admin] PATH_INFO: `/v3/projects/2f2c15d24ccb4320b59c6c4f17ef0126/users/89d3c1958eb9411a9368dc5d2e47b52a/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:39.616825 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a8e74-10cc-45f7-a3c7-a6adc48087da admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f2c15d24ccb4320b59c6c4f17ef0126, user_id=89d3c1958eb9411a9368dc5d2e47b52a, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:39.620510 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a8e74-10cc-45f7-a3c7-a6adc48087da admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:39.642136 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1325/2662] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:39 2022] PUT /identity/v3/projects/2f2c15d24ccb4320b59c6c4f17ef0126/users/89d3c1958eb9411a9368dc5d2e47b52a/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:39.651229 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1338/2663] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:39 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:39.651411 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a8e74-10cc-45f7-a3c7-a6adc48087da admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:39.659363 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584f1ac-a6fe-4aed-8978-89bf5a4bd0de None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:39.730630 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584f1ac-a6fe-4aed-8978-89bf5a4bd0de None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:39.739936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a8e74-10cc-45f7-a3c7-a6adc48087da admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:39.744701 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafdeed-31c8-4136-bb08-f2fab54929b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:39.745363 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafdeed-31c8-4136-bb08-f2fab54929b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:39.745646 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafdeed-31c8-4136-bb08-f2fab54929b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:39.745924 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafdeed-31c8-4136-bb08-f2fab54929b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:39.746650 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafdeed-31c8-4136-bb08-f2fab54929b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:39.748280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafdeed-31c8-4136-bb08-f2fab54929b4 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:39.761945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1326/2664] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:39.762925 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafdeed-31c8-4136-bb08-f2fab54929b4 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:39.773558 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafdeed-31c8-4136-bb08-f2fab54929b4 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:39.778328 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42532ad-0893-494d-9eb0-b8ff025cbd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:39.779201 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42532ad-0893-494d-9eb0-b8ff025cbd4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:39.779537 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42532ad-0893-494d-9eb0-b8ff025cbd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:39.779817 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42532ad-0893-494d-9eb0-b8ff025cbd4e admin admin] PATH_INFO: `/v3/projects/2f2c15d24ccb4320b59c6c4f17ef0126/users/89d3c1958eb9411a9368dc5d2e47b52a/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:39.781890 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42532ad-0893-494d-9eb0-b8ff025cbd4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f2c15d24ccb4320b59c6c4f17ef0126, user_id=89d3c1958eb9411a9368dc5d2e47b52a, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:39.784498 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42532ad-0893-494d-9eb0-b8ff025cbd4e admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:39.784724 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cac29d-00ed-458d-bd77-effc7174fbe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:39.785582 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cac29d-00ed-458d-bd77-effc7174fbe7 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:39.786054 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cac29d-00ed-458d-bd77-effc7174fbe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:39.786517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cac29d-00ed-458d-bd77-effc7174fbe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:39.795205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1327/2665] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:39 2022] PUT /identity/v3/projects/2f2c15d24ccb4320b59c6c4f17ef0126/users/89d3c1958eb9411a9368dc5d2e47b52a/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:39.805474 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849e648-1547-459c-a847-7204637fd214 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:39.805769 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849e648-1547-459c-a847-7204637fd214 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:39.806053 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849e648-1547-459c-a847-7204637fd214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:39.837281 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-b849e648-1547-459c-a847-7204637fd214 None None] MFA Rules not processed for user `89d3c1958eb9411a9368dc5d2e47b52a`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:39.839909 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-b849e648-1547-459c-a847-7204637fd214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:39.854050 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cac29d-00ed-458d-bd77-effc7174fbe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:39.855614 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cac29d-00ed-458d-bd77-effc7174fbe7 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:39.865873 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1339/2666] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:39 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:40:39.912689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1328/2667] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:39 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:39.924850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cac29d-00ed-458d-bd77-effc7174fbe7 service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:39.936971 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cac29d-00ed-458d-bd77-effc7174fbe7 service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:39.945260 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849e648-1547-459c-a847-7204637fd214 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:39.947354 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-b849e648-1547-459c-a847-7204637fd214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:39.987976 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec01baf-a726-445c-8f95-6c016d737fcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:39.988561 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec01baf-a726-445c-8f95-6c016d737fcd service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:39.988849 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec01baf-a726-445c-8f95-6c016d737fcd service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:39.989124 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec01baf-a726-445c-8f95-6c016d737fcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:39.999033 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec01baf-a726-445c-8f95-6c016d737fcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:40.000475 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec01baf-a726-445c-8f95-6c016d737fcd service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:40.010853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1340/2668] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:39 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:40.014735 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849e648-1547-459c-a847-7204637fd214 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:40.018536 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681a9b6-84f1-463c-a1ee-8f2fd3ec6d78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:40.019200 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681a9b6-84f1-463c-a1ee-8f2fd3ec6d78 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:40.019485 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681a9b6-84f1-463c-a1ee-8f2fd3ec6d78 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:40.019764 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681a9b6-84f1-463c-a1ee-8f2fd3ec6d78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:40.082238 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681a9b6-84f1-463c-a1ee-8f2fd3ec6d78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:40.083950 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681a9b6-84f1-463c-a1ee-8f2fd3ec6d78 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:40.085056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec01baf-a726-445c-8f95-6c016d737fcd service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:40.093356 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1329/2669] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:40:40.093875 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec01baf-a726-445c-8f95-6c016d737fcd service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:40.097623 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab168a-b4b7-430d-b621-1269b4e325cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:40.098251 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab168a-b4b7-430d-b621-1269b4e325cc service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:40.098530 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab168a-b4b7-430d-b621-1269b4e325cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:40.098804 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab168a-b4b7-430d-b621-1269b4e325cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:40.158262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab168a-b4b7-430d-b621-1269b4e325cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:40.159714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab168a-b4b7-430d-b621-1269b4e325cc service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:40.173122 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1341/2670] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:40 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:40:41.956797 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681a9b6-84f1-463c-a1ee-8f2fd3ec6d78 service cinder] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:42.019085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681a9b6-84f1-463c-a1ee-8f2fd3ec6d78 service cinder] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:42.023745 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b327e5-50f5-4e02-93cd-3486a825372c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:42.024809 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b327e5-50f5-4e02-93cd-3486a825372c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:42.025090 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b327e5-50f5-4e02-93cd-3486a825372c admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:42.025361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b327e5-50f5-4e02-93cd-3486a825372c admin admin] PATH_INFO: `/v3/users/526901f3614344c6a299fb4478b451e7` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:42.026595 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b327e5-50f5-4e02-93cd-3486a825372c admin admin] RBAC: Authorizing `identity:delete_user(user_id=526901f3614344c6a299fb4478b451e7)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:42.028586 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b327e5-50f5-4e02-93cd-3486a825372c admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:42.075062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-95b327e5-50f5-4e02-93cd-3486a825372c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '526901f3614344c6a299fb4478b451e7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:42.081534 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-95b327e5-50f5-4e02-93cd-3486a825372c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '526901f3614344c6a299fb4478b451e7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:42.089002 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-95b327e5-50f5-4e02-93cd-3486a825372c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '526901f3614344c6a299fb4478b451e7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:42.090000 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-95b327e5-50f5-4e02-93cd-3486a825372c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '526901f3614344c6a299fb4478b451e7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:42.090615 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-95b327e5-50f5-4e02-93cd-3486a825372c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '526901f3614344c6a299fb4478b451e7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:42.107465 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1330/2671] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:41 2022] DELETE /identity/v3/users/526901f3614344c6a299fb4478b451e7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:42.111970 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900616c-24c1-4c0d-9156-34fb3abdfc80 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:42.112453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900616c-24c1-4c0d-9156-34fb3abdfc80 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:42.112668 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900616c-24c1-4c0d-9156-34fb3abdfc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:42.131351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-9900616c-24c1-4c0d-9156-34fb3abdfc80 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:42.132609 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-9900616c-24c1-4c0d-9156-34fb3abdfc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:42.190394 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1342/2672] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:42.200216 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b327e5-50f5-4e02-93cd-3486a825372c admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:42.201724 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-95b327e5-50f5-4e02-93cd-3486a825372c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:42.259356 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b327e5-50f5-4e02-93cd-3486a825372c admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:42.262999 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d588195-983d-423a-8326-3c79a83721e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:42.263645 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588195-983d-423a-8326-3c79a83721e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:42.263923 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588195-983d-423a-8326-3c79a83721e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:42.264197 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588195-983d-423a-8326-3c79a83721e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:42.274959 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d588195-983d-423a-8326-3c79a83721e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:42.276403 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d588195-983d-423a-8326-3c79a83721e1 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:42.286100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1331/2673] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:42.555056 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900616c-24c1-4c0d-9156-34fb3abdfc80 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:42.558433 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-9900616c-24c1-4c0d-9156-34fb3abdfc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:42.573190 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900616c-24c1-4c0d-9156-34fb3abdfc80 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:42.577900 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71280c-f5c9-4c84-a451-8a1d508d2122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:42.578876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71280c-f5c9-4c84-a451-8a1d508d2122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:42.579169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71280c-f5c9-4c84-a451-8a1d508d2122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:42.579446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71280c-f5c9-4c84-a451-8a1d508d2122 admin admin] PATH_INFO: `/v3/projects/fde907dde45848808adbd733e7acd818` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:42.580729 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71280c-f5c9-4c84-a451-8a1d508d2122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fde907dde45848808adbd733e7acd818)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:42.582698 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71280c-f5c9-4c84-a451-8a1d508d2122 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:42.628018 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-7e71280c-f5c9-4c84-a451-8a1d508d2122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde907dde45848808adbd733e7acd818', 'request_id': 'req-7e71280c-f5c9-4c84-a451-8a1d508d2122'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:42.635148 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-7e71280c-f5c9-4c84-a451-8a1d508d2122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde907dde45848808adbd733e7acd818', 'request_id': 'req-7e71280c-f5c9-4c84-a451-8a1d508d2122'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:42.641343 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-7e71280c-f5c9-4c84-a451-8a1d508d2122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde907dde45848808adbd733e7acd818', 'request_id': 'req-7e71280c-f5c9-4c84-a451-8a1d508d2122'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:42.653013 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-7e71280c-f5c9-4c84-a451-8a1d508d2122 admin admin] The token cache is being invalidate because project fde907dde45848808adbd733e7acd818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:42.653296 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-7e71280c-f5c9-4c84-a451-8a1d508d2122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:42.653899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-7e71280c-f5c9-4c84-a451-8a1d508d2122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:42.655438 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1343/2674] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:42 2022] DELETE /identity/v3/projects/fde907dde45848808adbd733e7acd818 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:42.659518 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d588195-983d-423a-8326-3c79a83721e1 service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:42.670130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d588195-983d-423a-8326-3c79a83721e1 service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:42.727706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e4a34-e85d-48d2-937e-54ea935eb543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:42.728630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e4a34-e85d-48d2-937e-54ea935eb543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:42.728912 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e4a34-e85d-48d2-937e-54ea935eb543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:42.729188 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e4a34-e85d-48d2-937e-54ea935eb543 admin admin] PATH_INFO: `/v3/users/1e8e124cfcdb4cbcbe402cefb416d593` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:42.730399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e4a34-e85d-48d2-937e-54ea935eb543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e8e124cfcdb4cbcbe402cefb416d593)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:42.732363 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e4a34-e85d-48d2-937e-54ea935eb543 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:42.784288 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a81e4a34-e85d-48d2-937e-54ea935eb543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e8e124cfcdb4cbcbe402cefb416d593'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:42.791897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a81e4a34-e85d-48d2-937e-54ea935eb543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e8e124cfcdb4cbcbe402cefb416d593'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:42.799716 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a81e4a34-e85d-48d2-937e-54ea935eb543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e8e124cfcdb4cbcbe402cefb416d593'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:42.800404 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a81e4a34-e85d-48d2-937e-54ea935eb543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e8e124cfcdb4cbcbe402cefb416d593'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:42.801064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a81e4a34-e85d-48d2-937e-54ea935eb543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e8e124cfcdb4cbcbe402cefb416d593'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:42.824462 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1332/2675] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:42 2022] DELETE /identity/v3/users/1e8e124cfcdb4cbcbe402cefb416d593 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:42.917775 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71280c-f5c9-4c84-a451-8a1d508d2122 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:42.919967 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-7e71280c-f5c9-4c84-a451-8a1d508d2122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:42.939877 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71280c-f5c9-4c84-a451-8a1d508d2122 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:43.017956 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4045a-7794-49d4-819c-6915aaf90ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:43.020079 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4045a-7794-49d4-819c-6915aaf90ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:43.020372 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4045a-7794-49d4-819c-6915aaf90ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:43.020698 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4045a-7794-49d4-819c-6915aaf90ceb admin admin] PATH_INFO: `/v3/users/924aafecf27f40269a98cd43a92c8b4b` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:43.021967 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4045a-7794-49d4-819c-6915aaf90ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=924aafecf27f40269a98cd43a92c8b4b)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:43.023939 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4045a-7794-49d4-819c-6915aaf90ceb admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:43.074732 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-89b4045a-7794-49d4-819c-6915aaf90ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924aafecf27f40269a98cd43a92c8b4b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:43.081690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-89b4045a-7794-49d4-819c-6915aaf90ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924aafecf27f40269a98cd43a92c8b4b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:43.082362 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-89b4045a-7794-49d4-819c-6915aaf90ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924aafecf27f40269a98cd43a92c8b4b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:43.090586 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-89b4045a-7794-49d4-819c-6915aaf90ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924aafecf27f40269a98cd43a92c8b4b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:43.091380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-89b4045a-7794-49d4-819c-6915aaf90ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924aafecf27f40269a98cd43a92c8b4b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:43.110161 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1344/2676] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:42 2022] DELETE /identity/v3/users/924aafecf27f40269a98cd43a92c8b4b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:43.114640 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0c656-dea1-41be-aa89-e572325ce558 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:43.115164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0c656-dea1-41be-aa89-e572325ce558 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:43.115260 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0c656-dea1-41be-aa89-e572325ce558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:43.133579 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-e0a0c656-dea1-41be-aa89-e572325ce558 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:43.135344 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e0a0c656-dea1-41be-aa89-e572325ce558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:43.148649 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4045a-7794-49d4-819c-6915aaf90ceb admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:43.150428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-89b4045a-7794-49d4-819c-6915aaf90ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:43.200644 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1333/2677] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:43.212483 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0c656-dea1-41be-aa89-e572325ce558 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:43.214230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-e0a0c656-dea1-41be-aa89-e572325ce558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:43.231517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4045a-7794-49d4-819c-6915aaf90ceb admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:43.242446 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cdc1f-e3ea-4037-af1e-a1f87cf9a36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:43.244471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cdc1f-e3ea-4037-af1e-a1f87cf9a36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:43.244471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cdc1f-e3ea-4037-af1e-a1f87cf9a36e admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:43.244471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cdc1f-e3ea-4037-af1e-a1f87cf9a36e admin admin] PATH_INFO: `/v3/projects/459474be3c384d288f782c11e1d6653e` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:43.245671 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cdc1f-e3ea-4037-af1e-a1f87cf9a36e admin admin] RBAC: Authorizing `identity:delete_project(project_id=459474be3c384d288f782c11e1d6653e)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:43.247745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cdc1f-e3ea-4037-af1e-a1f87cf9a36e admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:43.276406 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0c656-dea1-41be-aa89-e572325ce558 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:43.280915 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a01dd-23eb-4239-ade5-90cc2149b14e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:43.281561 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a01dd-23eb-4239-ade5-90cc2149b14e service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:43.281841 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a01dd-23eb-4239-ade5-90cc2149b14e service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:43.282112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a01dd-23eb-4239-ade5-90cc2149b14e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:43.291403 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a01dd-23eb-4239-ade5-90cc2149b14e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:43.293154 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a01dd-23eb-4239-ade5-90cc2149b14e service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:43.299957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6e5cdc1f-e3ea-4037-af1e-a1f87cf9a36e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '459474be3c384d288f782c11e1d6653e', 'request_id': 'req-6e5cdc1f-e3ea-4037-af1e-a1f87cf9a36e'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:43.306527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1334/2678] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:43.307311 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6e5cdc1f-e3ea-4037-af1e-a1f87cf9a36e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '459474be3c384d288f782c11e1d6653e', 'request_id': 'req-6e5cdc1f-e3ea-4037-af1e-a1f87cf9a36e'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:43.313047 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6e5cdc1f-e3ea-4037-af1e-a1f87cf9a36e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '459474be3c384d288f782c11e1d6653e', 'request_id': 'req-6e5cdc1f-e3ea-4037-af1e-a1f87cf9a36e'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:43.326051 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6e5cdc1f-e3ea-4037-af1e-a1f87cf9a36e admin admin] The token cache is being invalidate because project 459474be3c384d288f782c11e1d6653e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:43.326336 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6e5cdc1f-e3ea-4037-af1e-a1f87cf9a36e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:43.326965 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6e5cdc1f-e3ea-4037-af1e-a1f87cf9a36e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:43.328750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1345/2679] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:43 2022] DELETE /identity/v3/projects/459474be3c384d288f782c11e1d6653e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:43.333530 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac80e7-57c9-438d-a86c-338884c741b1 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:43.333858 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac80e7-57c9-438d-a86c-338884c741b1 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:43.334132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac80e7-57c9-438d-a86c-338884c741b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:43.352731 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-dfac80e7-57c9-438d-a86c-338884c741b1 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:43.353961 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-dfac80e7-57c9-438d-a86c-338884c741b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:43.418128 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1335/2680] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:43.429439 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d1b1-b0a5-4e8b-917d-51a1b00e6743 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:43.429961 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d1b1-b0a5-4e8b-917d-51a1b00e6743 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:43.430240 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d1b1-b0a5-4e8b-917d-51a1b00e6743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:43.451482 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-24c4d1b1-b0a5-4e8b-917d-51a1b00e6743 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:43.453267 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-24c4d1b1-b0a5-4e8b-917d-51a1b00e6743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:43.469676 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1346/2681] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:43.470220 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac80e7-57c9-438d-a86c-338884c741b1 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:43.480868 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac80e7-57c9-438d-a86c-338884c741b1 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:43.487596 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eddda2-b35b-40f1-811f-53cf4d33a70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:43.488437 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eddda2-b35b-40f1-811f-53cf4d33a70f admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:43.488821 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eddda2-b35b-40f1-811f-53cf4d33a70f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:43.489159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eddda2-b35b-40f1-811f-53cf4d33a70f admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:43.490626 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eddda2-b35b-40f1-811f-53cf4d33a70f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:40:43.491000 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eddda2-b35b-40f1-811f-53cf4d33a70f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:43.492915 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eddda2-b35b-40f1-811f-53cf4d33a70f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:43.504812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1336/2682] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:40:43.509389 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4d1b1-b0a5-4e8b-917d-51a1b00e6743 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:43.518488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4d1b1-b0a5-4e8b-917d-51a1b00e6743 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:43.523189 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eaef80-9527-4f47-9e13-3043717587da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:43.523868 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eaef80-9527-4f47-9e13-3043717587da admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:43.524171 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eaef80-9527-4f47-9e13-3043717587da admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:43.524443 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eaef80-9527-4f47-9e13-3043717587da admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:43.525294 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eaef80-9527-4f47-9e13-3043717587da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:43.527055 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eaef80-9527-4f47-9e13-3043717587da admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:43.558112 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1347/2683] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:43 2022] POST /identity/v3/projects => generated 409 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:43.559244 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eddda2-b35b-40f1-811f-53cf4d33a70f admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:43.570940 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eddda2-b35b-40f1-811f-53cf4d33a70f admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:43.607294 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eaef80-9527-4f47-9e13-3043717587da admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:43.609391 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-25eaef80-9527-4f47-9e13-3043717587da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:43.646616 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387e2b2-504e-4dd0-873b-554dca5ce0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:43.647196 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387e2b2-504e-4dd0-873b-554dca5ce0cf admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:43.647483 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387e2b2-504e-4dd0-873b-554dca5ce0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:43.647760 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387e2b2-504e-4dd0-873b-554dca5ce0cf admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:43.648468 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387e2b2-504e-4dd0-873b-554dca5ce0cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:43.650541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387e2b2-504e-4dd0-873b-554dca5ce0cf admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:43.672005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1337/2684] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:43 2022] POST /identity/v3/users => generated 305 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:43.676389 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387e2b2-504e-4dd0-873b-554dca5ce0cf admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:43.682064 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eaef80-9527-4f47-9e13-3043717587da admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:43.686799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a78e4b-3fae-4d98-bb41-9c2f2c80e317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:43.686964 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387e2b2-504e-4dd0-873b-554dca5ce0cf admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:43.687774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a78e4b-3fae-4d98-bb41-9c2f2c80e317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:43.688046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a78e4b-3fae-4d98-bb41-9c2f2c80e317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:43.688310 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a78e4b-3fae-4d98-bb41-9c2f2c80e317 admin admin] PATH_INFO: `/v3/projects/814af779f240483087b7c317d2d825ff` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:43.689536 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a78e4b-3fae-4d98-bb41-9c2f2c80e317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=814af779f240483087b7c317d2d825ff)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:43.691525 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a78e4b-3fae-4d98-bb41-9c2f2c80e317 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:43.691686 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b9cf8-b8aa-4397-9778-f9528eab001b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:43.692505 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b9cf8-b8aa-4397-9778-f9528eab001b admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:43.692826 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b9cf8-b8aa-4397-9778-f9528eab001b admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:43.695031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b9cf8-b8aa-4397-9778-f9528eab001b admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:43.695798 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b9cf8-b8aa-4397-9778-f9528eab001b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:43.698304 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b9cf8-b8aa-4397-9778-f9528eab001b admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:43.711257 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1338/2685] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:40:43.712506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b9cf8-b8aa-4397-9778-f9528eab001b admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:43.722828 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b9cf8-b8aa-4397-9778-f9528eab001b admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:43.728865 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e8280-5dd5-4e8e-b739-588bc2bea164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:43.729532 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e8280-5dd5-4e8e-b739-588bc2bea164 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:43.729829 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e8280-5dd5-4e8e-b739-588bc2bea164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:43.730163 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e8280-5dd5-4e8e-b739-588bc2bea164 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:43.731007 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e8280-5dd5-4e8e-b739-588bc2bea164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:43.732725 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e8280-5dd5-4e8e-b739-588bc2bea164 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:43.741501 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-53a78e4b-3fae-4d98-bb41-9c2f2c80e317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '814af779f240483087b7c317d2d825ff', 'request_id': 'req-53a78e4b-3fae-4d98-bb41-9c2f2c80e317'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:43.744925 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1339/2686] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:43.747727 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-53a78e4b-3fae-4d98-bb41-9c2f2c80e317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '814af779f240483087b7c317d2d825ff', 'request_id': 'req-53a78e4b-3fae-4d98-bb41-9c2f2c80e317'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:43.749009 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e8280-5dd5-4e8e-b739-588bc2bea164 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:43.753492 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-53a78e4b-3fae-4d98-bb41-9c2f2c80e317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '814af779f240483087b7c317d2d825ff', 'request_id': 'req-53a78e4b-3fae-4d98-bb41-9c2f2c80e317'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:43.758926 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e8280-5dd5-4e8e-b739-588bc2bea164 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:43.766596 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-53a78e4b-3fae-4d98-bb41-9c2f2c80e317 admin admin] The token cache is being invalidate because project 814af779f240483087b7c317d2d825ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:43.766884 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-53a78e4b-3fae-4d98-bb41-9c2f2c80e317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:43.767532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-53a78e4b-3fae-4d98-bb41-9c2f2c80e317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:43.769399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1348/2687] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:43 2022] DELETE /identity/v3/projects/814af779f240483087b7c317d2d825ff => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:43.773397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a78e4b-3fae-4d98-bb41-9c2f2c80e317 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:43.774691 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-53a78e4b-3fae-4d98-bb41-9c2f2c80e317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:43.815122 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56847207-e2a3-4f5c-abbd-3d52fd35646f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:43.816015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56847207-e2a3-4f5c-abbd-3d52fd35646f admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:43.816297 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56847207-e2a3-4f5c-abbd-3d52fd35646f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:43.816596 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56847207-e2a3-4f5c-abbd-3d52fd35646f admin admin] PATH_INFO: `/v3/projects/6b83aed91da74983b1349757d298e1c2/users/661a85b876cb4991aeaed9050e9aea6f/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:43.830649 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56847207-e2a3-4f5c-abbd-3d52fd35646f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b83aed91da74983b1349757d298e1c2, user_id=661a85b876cb4991aeaed9050e9aea6f, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:43.833366 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56847207-e2a3-4f5c-abbd-3d52fd35646f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:43.841552 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a78e4b-3fae-4d98-bb41-9c2f2c80e317 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:43.847036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf023a6-c3b1-4249-bca2-bcf3e8a7119e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:43.847799 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf023a6-c3b1-4249-bca2-bcf3e8a7119e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:43.848037 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf023a6-c3b1-4249-bca2-bcf3e8a7119e admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:43.848317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf023a6-c3b1-4249-bca2-bcf3e8a7119e admin admin] PATH_INFO: `/v3/users/89d3c1958eb9411a9368dc5d2e47b52a` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:43.850134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf023a6-c3b1-4249-bca2-bcf3e8a7119e admin admin] RBAC: Authorizing `identity:delete_user(user_id=89d3c1958eb9411a9368dc5d2e47b52a)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:43.850613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1340/2688] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:43 2022] PUT /identity/v3/projects/6b83aed91da74983b1349757d298e1c2/users/661a85b876cb4991aeaed9050e9aea6f/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:43.852350 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf023a6-c3b1-4249-bca2-bcf3e8a7119e admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:43.860827 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206deade-96e0-4678-bb65-c0df1694a7cb None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:43.861112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206deade-96e0-4678-bb65-c0df1694a7cb None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:43.861388 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206deade-96e0-4678-bb65-c0df1694a7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:43.888750 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-206deade-96e0-4678-bb65-c0df1694a7cb None None] MFA Rules not processed for user `661a85b876cb4991aeaed9050e9aea6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:43.890416 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-206deade-96e0-4678-bb65-c0df1694a7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:43.900454 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dcf023a6-c3b1-4249-bca2-bcf3e8a7119e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89d3c1958eb9411a9368dc5d2e47b52a'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:43.907709 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dcf023a6-c3b1-4249-bca2-bcf3e8a7119e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89d3c1958eb9411a9368dc5d2e47b52a'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:43.908441 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dcf023a6-c3b1-4249-bca2-bcf3e8a7119e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89d3c1958eb9411a9368dc5d2e47b52a'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:43.918406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dcf023a6-c3b1-4249-bca2-bcf3e8a7119e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89d3c1958eb9411a9368dc5d2e47b52a'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:43.919510 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-dcf023a6-c3b1-4249-bca2-bcf3e8a7119e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89d3c1958eb9411a9368dc5d2e47b52a'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:43.938348 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1349/2689] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:43 2022] DELETE /identity/v3/users/89d3c1958eb9411a9368dc5d2e47b52a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:43.976445 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1341/2690] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:43 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:43.981587 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf023a6-c3b1-4249-bca2-bcf3e8a7119e admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:43.983009 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-dcf023a6-c3b1-4249-bca2-bcf3e8a7119e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:44.058417 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf023a6-c3b1-4249-bca2-bcf3e8a7119e admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:44.064322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ab4aa-15b4-42d7-9c01-37ec4178b323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:44.065470 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ab4aa-15b4-42d7-9c01-37ec4178b323 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:44.065763 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ab4aa-15b4-42d7-9c01-37ec4178b323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:44.066046 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ab4aa-15b4-42d7-9c01-37ec4178b323 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:44.068801 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ab4aa-15b4-42d7-9c01-37ec4178b323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:44.071694 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ab4aa-15b4-42d7-9c01-37ec4178b323 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:44.116132 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1350/2691] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:43 2022] POST /identity/v3/projects => generated 409 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:44.120141 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206deade-96e0-4678-bb65-c0df1694a7cb None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:44.204139 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206deade-96e0-4678-bb65-c0df1694a7cb None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:44.212054 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ab4aa-15b4-42d7-9c01-37ec4178b323 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:44.213833 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d90ab4aa-15b4-42d7-9c01-37ec4178b323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:44.277527 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281067a-63c6-48f8-803b-47278bdd28f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:44.278641 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281067a-63c6-48f8-803b-47278bdd28f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:44.278780 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281067a-63c6-48f8-803b-47278bdd28f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:44.279067 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281067a-63c6-48f8-803b-47278bdd28f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:44.279792 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281067a-63c6-48f8-803b-47278bdd28f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:44.282361 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281067a-63c6-48f8-803b-47278bdd28f1 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:44.289563 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ab4aa-15b4-42d7-9c01-37ec4178b323 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:44.294532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d02e65-3019-4fac-bd4a-a20ddb456d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:44.295581 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d02e65-3019-4fac-bd4a-a20ddb456d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:44.295881 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d02e65-3019-4fac-bd4a-a20ddb456d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:44.296160 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d02e65-3019-4fac-bd4a-a20ddb456d7d admin admin] PATH_INFO: `/v3/users/e81cd48af0de4aadb76c7aa4b043960c` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:44.297619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d02e65-3019-4fac-bd4a-a20ddb456d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e81cd48af0de4aadb76c7aa4b043960c)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:44.299712 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d02e65-3019-4fac-bd4a-a20ddb456d7d admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:44.305068 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1342/2692] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:44 2022] POST /identity/v3/users => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:44.305976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281067a-63c6-48f8-803b-47278bdd28f1 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:44.307565 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-4281067a-63c6-48f8-803b-47278bdd28f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:44.322103 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281067a-63c6-48f8-803b-47278bdd28f1 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:44.327934 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f696a-7bfa-4048-bc8c-6f8f63eddda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:44.328981 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f696a-7bfa-4048-bc8c-6f8f63eddda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:44.329268 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f696a-7bfa-4048-bc8c-6f8f63eddda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:44.329586 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f696a-7bfa-4048-bc8c-6f8f63eddda2 admin admin] PATH_INFO: `/v3/projects/2f2c15d24ccb4320b59c6c4f17ef0126` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:44.330840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f696a-7bfa-4048-bc8c-6f8f63eddda2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f2c15d24ccb4320b59c6c4f17ef0126)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:44.333128 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f696a-7bfa-4048-bc8c-6f8f63eddda2 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:44.353304 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-04d02e65-3019-4fac-bd4a-a20ddb456d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e81cd48af0de4aadb76c7aa4b043960c'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:44.360754 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-04d02e65-3019-4fac-bd4a-a20ddb456d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e81cd48af0de4aadb76c7aa4b043960c'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:44.361492 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-04d02e65-3019-4fac-bd4a-a20ddb456d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e81cd48af0de4aadb76c7aa4b043960c'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:44.369028 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-04d02e65-3019-4fac-bd4a-a20ddb456d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e81cd48af0de4aadb76c7aa4b043960c'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:44.369711 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-04d02e65-3019-4fac-bd4a-a20ddb456d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e81cd48af0de4aadb76c7aa4b043960c'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:44.382585 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-680f696a-7bfa-4048-bc8c-6f8f63eddda2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f2c15d24ccb4320b59c6c4f17ef0126', 'request_id': 'req-680f696a-7bfa-4048-bc8c-6f8f63eddda2'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:44.387118 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1351/2693] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:44 2022] DELETE /identity/v3/users/e81cd48af0de4aadb76c7aa4b043960c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:44.389421 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-680f696a-7bfa-4048-bc8c-6f8f63eddda2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f2c15d24ccb4320b59c6c4f17ef0126', 'request_id': 'req-680f696a-7bfa-4048-bc8c-6f8f63eddda2'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:44.390962 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d02e65-3019-4fac-bd4a-a20ddb456d7d admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:44.394244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-04d02e65-3019-4fac-bd4a-a20ddb456d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:44.395890 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-680f696a-7bfa-4048-bc8c-6f8f63eddda2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f2c15d24ccb4320b59c6c4f17ef0126', 'request_id': 'req-680f696a-7bfa-4048-bc8c-6f8f63eddda2'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:44.409927 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-680f696a-7bfa-4048-bc8c-6f8f63eddda2 admin admin] The token cache is being invalidate because project 2f2c15d24ccb4320b59c6c4f17ef0126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:44.410238 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-680f696a-7bfa-4048-bc8c-6f8f63eddda2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:44.410964 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-680f696a-7bfa-4048-bc8c-6f8f63eddda2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:44.413071 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1343/2694] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:44 2022] DELETE /identity/v3/projects/2f2c15d24ccb4320b59c6c4f17ef0126 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:44.414647 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b5b13-1def-4ec5-a649-e2717d858db3 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:44.414938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b5b13-1def-4ec5-a649-e2717d858db3 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:44.415218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b5b13-1def-4ec5-a649-e2717d858db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:44.432149 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-3e5b5b13-1def-4ec5-a649-e2717d858db3 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:44.433486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-3e5b5b13-1def-4ec5-a649-e2717d858db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:44.467897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d02e65-3019-4fac-bd4a-a20ddb456d7d admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:44.472678 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b5c86-5519-435f-8f2c-1fff5e0ab63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:44.473375 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b5c86-5519-435f-8f2c-1fff5e0ab63e admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:44.473662 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b5c86-5519-435f-8f2c-1fff5e0ab63e admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:44.473938 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b5c86-5519-435f-8f2c-1fff5e0ab63e admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:44.475435 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b5c86-5519-435f-8f2c-1fff5e0ab63e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:44.476850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b5c86-5519-435f-8f2c-1fff5e0ab63e admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:44.491337 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1352/2695] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:44.491337 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151f967-f34e-4572-9bc0-9c2e9cf69450 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:44.491337 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151f967-f34e-4572-9bc0-9c2e9cf69450 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:44.491337 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151f967-f34e-4572-9bc0-9c2e9cf69450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:44.498623 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1344/2696] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:44.499493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b5b13-1def-4ec5-a649-e2717d858db3 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:44.501043 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-3e5b5b13-1def-4ec5-a649-e2717d858db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:44.509345 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-5151f967-f34e-4572-9bc0-9c2e9cf69450 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:44.510655 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-5151f967-f34e-4572-9bc0-9c2e9cf69450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:44.513108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b5b13-1def-4ec5-a649-e2717d858db3 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:44.517981 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5264e9-505b-41b9-9060-a9a44ea1c446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:44.518882 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5264e9-505b-41b9-9060-a9a44ea1c446 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:44.519168 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5264e9-505b-41b9-9060-a9a44ea1c446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:44.519446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5264e9-505b-41b9-9060-a9a44ea1c446 admin admin] PATH_INFO: `/v3/projects/f3281f2f9f3f4b7da04ffeaecb4fd4d3/users/6b622d0aa5d14a6abe305020ecf60509/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:44.519644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1353/2697] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:44.521501 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151f967-f34e-4572-9bc0-9c2e9cf69450 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:44.527074 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-5151f967-f34e-4572-9bc0-9c2e9cf69450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:44.534437 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5264e9-505b-41b9-9060-a9a44ea1c446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3281f2f9f3f4b7da04ffeaecb4fd4d3, user_id=6b622d0aa5d14a6abe305020ecf60509, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:44.537693 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5264e9-505b-41b9-9060-a9a44ea1c446 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:44.551499 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1345/2698] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:44 2022] PUT /identity/v3/projects/f3281f2f9f3f4b7da04ffeaecb4fd4d3/users/6b622d0aa5d14a6abe305020ecf60509/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:44.555524 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aba64-6157-4b02-8d02-28cd93567f96 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:44.555524 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aba64-6157-4b02-8d02-28cd93567f96 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:44.555524 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aba64-6157-4b02-8d02-28cd93567f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:44.571709 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-a46aba64-6157-4b02-8d02-28cd93567f96 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:44.572938 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-a46aba64-6157-4b02-8d02-28cd93567f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:44.585278 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151f967-f34e-4572-9bc0-9c2e9cf69450 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:44.633626 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7149a-815d-433d-956c-db71dd9c7ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:44.633768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1346/2699] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:44.634286 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7149a-815d-433d-956c-db71dd9c7ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:44.634472 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aba64-6157-4b02-8d02-28cd93567f96 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:44.634601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7149a-815d-433d-956c-db71dd9c7ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:44.634840 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7149a-815d-433d-956c-db71dd9c7ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:44.647670 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aba64-6157-4b02-8d02-28cd93567f96 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:44.650952 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7149a-815d-433d-956c-db71dd9c7ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:44.652364 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4cea9-bfa1-4729-9c6a-f7ed55faea4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:44.652619 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7149a-815d-433d-956c-db71dd9c7ef8 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:44.653058 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4cea9-bfa1-4729-9c6a-f7ed55faea4c admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:44.653350 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4cea9-bfa1-4729-9c6a-f7ed55faea4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:44.653604 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4cea9-bfa1-4729-9c6a-f7ed55faea4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:44.654329 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4cea9-bfa1-4729-9c6a-f7ed55faea4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:44.655950 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4cea9-bfa1-4729-9c6a-f7ed55faea4c admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:44.663345 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1354/2700] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:44.663992 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7149a-815d-433d-956c-db71dd9c7ef8 service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:44.669883 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1347/2701] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:44.672227 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4cea9-bfa1-4729-9c6a-f7ed55faea4c admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:44.676985 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7149a-815d-433d-956c-db71dd9c7ef8 service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:44.682989 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4cea9-bfa1-4729-9c6a-f7ed55faea4c admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:44.684216 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e4933-d764-48c9-90ff-5d0001a072c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:44.685133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e4933-d764-48c9-90ff-5d0001a072c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:44.685396 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e4933-d764-48c9-90ff-5d0001a072c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:44.685669 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e4933-d764-48c9-90ff-5d0001a072c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:44.686585 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e4933-d764-48c9-90ff-5d0001a072c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:40:44.686986 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e4933-d764-48c9-90ff-5d0001a072c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:44.688899 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e4933-d764-48c9-90ff-5d0001a072c6 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:44.689399 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12f55b-b31d-4b17-8bac-4493f231f47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:44.690307 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12f55b-b31d-4b17-8bac-4493f231f47c admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:44.690590 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12f55b-b31d-4b17-8bac-4493f231f47c admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:44.690867 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12f55b-b31d-4b17-8bac-4493f231f47c admin admin] PATH_INFO: `/v3/projects/f3281f2f9f3f4b7da04ffeaecb4fd4d3/users/6b622d0aa5d14a6abe305020ecf60509/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:44.693309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12f55b-b31d-4b17-8bac-4493f231f47c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3281f2f9f3f4b7da04ffeaecb4fd4d3, user_id=6b622d0aa5d14a6abe305020ecf60509, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:44.695984 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12f55b-b31d-4b17-8bac-4493f231f47c admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:44.705154 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1355/2702] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:40:44.706361 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e4933-d764-48c9-90ff-5d0001a072c6 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:44.721531 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1348/2703] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:44 2022] PUT /identity/v3/projects/f3281f2f9f3f4b7da04ffeaecb4fd4d3/users/6b622d0aa5d14a6abe305020ecf60509/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:44.721787 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e4933-d764-48c9-90ff-5d0001a072c6 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:44.723950 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4639f2c-5a67-4d0b-804b-33c4cb76a942 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:44.724294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4639f2c-5a67-4d0b-804b-33c4cb76a942 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:44.725317 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4639f2c-5a67-4d0b-804b-33c4cb76a942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:44.757125 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-c4639f2c-5a67-4d0b-804b-33c4cb76a942 None None] MFA Rules not processed for user `6b622d0aa5d14a6abe305020ecf60509`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:44.758341 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c4639f2c-5a67-4d0b-804b-33c4cb76a942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:44.795008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd5d8e-08ee-47fc-b70f-388bd47a63b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:44.796170 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd5d8e-08ee-47fc-b70f-388bd47a63b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:44.796493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd5d8e-08ee-47fc-b70f-388bd47a63b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:44.796800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd5d8e-08ee-47fc-b70f-388bd47a63b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:44.797550 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd5d8e-08ee-47fc-b70f-388bd47a63b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:44.800509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd5d8e-08ee-47fc-b70f-388bd47a63b6 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:44.832821 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1356/2704] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:44 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:44.837762 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd5d8e-08ee-47fc-b70f-388bd47a63b6 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:44.855512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1349/2705] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:44 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:44.868924 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4639f2c-5a67-4d0b-804b-33c4cb76a942 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:44.870439 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c4639f2c-5a67-4d0b-804b-33c4cb76a942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:44.908177 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd5d8e-08ee-47fc-b70f-388bd47a63b6 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:44.913804 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6633d-b956-48da-8ba9-fa734dedc672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:44.915166 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6633d-b956-48da-8ba9-fa734dedc672 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:44.915469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6633d-b956-48da-8ba9-fa734dedc672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:44.915743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6633d-b956-48da-8ba9-fa734dedc672 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:44.916447 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6633d-b956-48da-8ba9-fa734dedc672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:44.919528 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6633d-b956-48da-8ba9-fa734dedc672 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:44.929970 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4639f2c-5a67-4d0b-804b-33c4cb76a942 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:44.947080 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1357/2706] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:44 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:44.948593 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6633d-b956-48da-8ba9-fa734dedc672 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:44.963245 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6633d-b956-48da-8ba9-fa734dedc672 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:44.974485 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6296d0-e969-4a1c-a474-b7ac6c37cff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:44.975125 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6296d0-e969-4a1c-a474-b7ac6c37cff8 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:44.975455 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6296d0-e969-4a1c-a474-b7ac6c37cff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:44.975737 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6296d0-e969-4a1c-a474-b7ac6c37cff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:44.976479 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6296d0-e969-4a1c-a474-b7ac6c37cff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:44.978584 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6296d0-e969-4a1c-a474-b7ac6c37cff8 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:44.993609 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25842a-dc90-4b6b-a9f2-d22249e5d6da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:44.994607 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25842a-dc90-4b6b-a9f2-d22249e5d6da service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:44.995064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25842a-dc90-4b6b-a9f2-d22249e5d6da service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:44.995713 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25842a-dc90-4b6b-a9f2-d22249e5d6da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:44.999602 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1358/2707] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:40:44.999602 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6296d0-e969-4a1c-a474-b7ac6c37cff8 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:45.003205 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-bf6296d0-e969-4a1c-a474-b7ac6c37cff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:45.016592 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6296d0-e969-4a1c-a474-b7ac6c37cff8 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:45.021817 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bb9e3-1ded-4b02-9462-32a284b3499f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:45.022782 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bb9e3-1ded-4b02-9462-32a284b3499f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:45.023062 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bb9e3-1ded-4b02-9462-32a284b3499f admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:45.023340 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bb9e3-1ded-4b02-9462-32a284b3499f admin admin] PATH_INFO: `/v3/projects/09a5dca1ce44456b9dd4e50bc24aa245` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:45.024566 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bb9e3-1ded-4b02-9462-32a284b3499f admin admin] RBAC: Authorizing `identity:delete_project(project_id=09a5dca1ce44456b9dd4e50bc24aa245)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:45.026490 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bb9e3-1ded-4b02-9462-32a284b3499f admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:45.068060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25842a-dc90-4b6b-a9f2-d22249e5d6da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:45.069802 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25842a-dc90-4b6b-a9f2-d22249e5d6da service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:45.076350 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-773bb9e3-1ded-4b02-9462-32a284b3499f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09a5dca1ce44456b9dd4e50bc24aa245', 'request_id': 'req-773bb9e3-1ded-4b02-9462-32a284b3499f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:45.081742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1350/2708] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:44 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:40:45.082657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25842a-dc90-4b6b-a9f2-d22249e5d6da service cinder] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:45.083255 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-773bb9e3-1ded-4b02-9462-32a284b3499f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09a5dca1ce44456b9dd4e50bc24aa245', 'request_id': 'req-773bb9e3-1ded-4b02-9462-32a284b3499f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:45.089282 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-773bb9e3-1ded-4b02-9462-32a284b3499f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09a5dca1ce44456b9dd4e50bc24aa245', 'request_id': 'req-773bb9e3-1ded-4b02-9462-32a284b3499f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:45.093159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25842a-dc90-4b6b-a9f2-d22249e5d6da service cinder] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:45.102400 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-773bb9e3-1ded-4b02-9462-32a284b3499f admin admin] The token cache is being invalidate because project 09a5dca1ce44456b9dd4e50bc24aa245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:45.102700 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-773bb9e3-1ded-4b02-9462-32a284b3499f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:45.103594 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-773bb9e3-1ded-4b02-9462-32a284b3499f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:45.105015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1359/2709] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:44 2022] DELETE /identity/v3/projects/09a5dca1ce44456b9dd4e50bc24aa245 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:45.108892 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bb9e3-1ded-4b02-9462-32a284b3499f admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:45.110217 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-773bb9e3-1ded-4b02-9462-32a284b3499f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:45.154939 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e504d8-c5bd-4130-a774-17eeb059c62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:45.155610 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e504d8-c5bd-4130-a774-17eeb059c62e admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:45.155895 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e504d8-c5bd-4130-a774-17eeb059c62e admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:45.156173 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e504d8-c5bd-4130-a774-17eeb059c62e admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:45.156935 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e504d8-c5bd-4130-a774-17eeb059c62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:45.158640 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e504d8-c5bd-4130-a774-17eeb059c62e admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:45.172586 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1351/2710] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:45.176238 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e504d8-c5bd-4130-a774-17eeb059c62e admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:45.178662 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-67e504d8-c5bd-4130-a774-17eeb059c62e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:45.187836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bb9e3-1ded-4b02-9462-32a284b3499f admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:45.192042 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e504d8-c5bd-4130-a774-17eeb059c62e admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:45.193294 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afc034-30f0-49e8-8c4e-fcdc71a49bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:45.194214 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afc034-30f0-49e8-8c4e-fcdc71a49bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:45.194543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afc034-30f0-49e8-8c4e-fcdc71a49bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:45.194847 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afc034-30f0-49e8-8c4e-fcdc71a49bd0 admin admin] PATH_INFO: `/v3/users/24819788e21141369c2bb1ef9db57123` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:45.196322 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afc034-30f0-49e8-8c4e-fcdc71a49bd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24819788e21141369c2bb1ef9db57123)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:45.197267 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73a3f0-fd2e-4a2b-bf70-09756a5be738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:45.198151 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73a3f0-fd2e-4a2b-bf70-09756a5be738 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:45.198392 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afc034-30f0-49e8-8c4e-fcdc71a49bd0 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:45.198679 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73a3f0-fd2e-4a2b-bf70-09756a5be738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:45.198679 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73a3f0-fd2e-4a2b-bf70-09756a5be738 admin admin] PATH_INFO: `/v3/projects/ff9cf9998d304d7e89a0894d9c31c48b/users/896e029d1b664b5f8051d98c11a5a2db/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:45.217839 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73a3f0-fd2e-4a2b-bf70-09756a5be738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff9cf9998d304d7e89a0894d9c31c48b, user_id=896e029d1b664b5f8051d98c11a5a2db, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:45.220553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73a3f0-fd2e-4a2b-bf70-09756a5be738 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:45.242993 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1352/2711] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:45 2022] PUT /identity/v3/projects/ff9cf9998d304d7e89a0894d9c31c48b/users/896e029d1b664b5f8051d98c11a5a2db/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:45.243936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73a3f0-fd2e-4a2b-bf70-09756a5be738 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:45.245666 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-cb73a3f0-fd2e-4a2b-bf70-09756a5be738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:45.253590 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-75afc034-30f0-49e8-8c4e-fcdc71a49bd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24819788e21141369c2bb1ef9db57123'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:45.260509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-75afc034-30f0-49e8-8c4e-fcdc71a49bd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24819788e21141369c2bb1ef9db57123'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:45.261241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-75afc034-30f0-49e8-8c4e-fcdc71a49bd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24819788e21141369c2bb1ef9db57123'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:45.269664 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-75afc034-30f0-49e8-8c4e-fcdc71a49bd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24819788e21141369c2bb1ef9db57123'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:45.270336 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-75afc034-30f0-49e8-8c4e-fcdc71a49bd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24819788e21141369c2bb1ef9db57123'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:45.287898 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1360/2712] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:45 2022] DELETE /identity/v3/users/24819788e21141369c2bb1ef9db57123 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:45.293839 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276cf9b-4108-4e14-b7c6-a810537f8392 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:45.294137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276cf9b-4108-4e14-b7c6-a810537f8392 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:45.294418 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276cf9b-4108-4e14-b7c6-a810537f8392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:45.308901 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73a3f0-fd2e-4a2b-bf70-09756a5be738 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:45.326361 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-4276cf9b-4108-4e14-b7c6-a810537f8392 None None] MFA Rules not processed for user `896e029d1b664b5f8051d98c11a5a2db`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:45.327504 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-4276cf9b-4108-4e14-b7c6-a810537f8392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:45.366669 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f436294-96d4-4c0b-afe5-e822213544b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:45.367325 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f436294-96d4-4c0b-afe5-e822213544b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:45.368336 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f436294-96d4-4c0b-afe5-e822213544b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:45.368336 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f436294-96d4-4c0b-afe5-e822213544b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:45.370024 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-8f436294-96d4-4c0b-afe5-e822213544b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:45.410566 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1361/2713] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:45.416133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276cf9b-4108-4e14-b7c6-a810537f8392 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:45.418324 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-4276cf9b-4108-4e14-b7c6-a810537f8392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:45.436676 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f436294-96d4-4c0b-afe5-e822213544b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:45.438292 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f436294-96d4-4c0b-afe5-e822213544b2 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:45.453829 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1353/2714] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:45 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:45.495464 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276cf9b-4108-4e14-b7c6-a810537f8392 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:45.502128 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef16d5-c82c-4967-ab7f-8c02e457bf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:45.502794 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef16d5-c82c-4967-ab7f-8c02e457bf7a admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:45.503075 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef16d5-c82c-4967-ab7f-8c02e457bf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:45.503359 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef16d5-c82c-4967-ab7f-8c02e457bf7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:45.504051 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef16d5-c82c-4967-ab7f-8c02e457bf7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:45.506241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef16d5-c82c-4967-ab7f-8c02e457bf7a admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:45.533483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1362/2715] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:45 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:45.538430 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f436294-96d4-4c0b-afe5-e822213544b2 service cinder] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:45.551345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f436294-96d4-4c0b-afe5-e822213544b2 service cinder] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:45.597650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef16d5-c82c-4967-ab7f-8c02e457bf7a admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:45.605350 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-0aef16d5-c82c-4967-ab7f-8c02e457bf7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:45.623886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521d779-8afd-411f-9708-10a84f8ee170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:45.624608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521d779-8afd-411f-9708-10a84f8ee170 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:45.624894 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521d779-8afd-411f-9708-10a84f8ee170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:45.625172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521d779-8afd-411f-9708-10a84f8ee170 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:45.626297 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521d779-8afd-411f-9708-10a84f8ee170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:45.628225 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521d779-8afd-411f-9708-10a84f8ee170 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:45.651766 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1354/2716] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:45 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:45.657722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521d779-8afd-411f-9708-10a84f8ee170 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:45.669601 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521d779-8afd-411f-9708-10a84f8ee170 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:45.674524 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2cb6c-da5d-4054-b184-bc248d6b9d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:45.675188 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2cb6c-da5d-4054-b184-bc248d6b9d3d admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:45.675474 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2cb6c-da5d-4054-b184-bc248d6b9d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:45.675753 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2cb6c-da5d-4054-b184-bc248d6b9d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:45.676482 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2cb6c-da5d-4054-b184-bc248d6b9d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:45.680657 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2cb6c-da5d-4054-b184-bc248d6b9d3d admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:45.685813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef16d5-c82c-4967-ab7f-8c02e457bf7a admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:45.689619 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1355/2717] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:45.694562 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2cb6c-da5d-4054-b184-bc248d6b9d3d admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:45.695513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18a940-8329-42f9-b955-89deed451586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:45.696384 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18a940-8329-42f9-b955-89deed451586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:45.696693 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18a940-8329-42f9-b955-89deed451586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:45.696967 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18a940-8329-42f9-b955-89deed451586 admin admin] PATH_INFO: `/v3/projects/f5d3a29ef6c04399b2d4f1916f61cd34` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:45.698603 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18a940-8329-42f9-b955-89deed451586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5d3a29ef6c04399b2d4f1916f61cd34)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:45.705109 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18a940-8329-42f9-b955-89deed451586 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:45.716865 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2cb6c-da5d-4054-b184-bc248d6b9d3d admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:45.722409 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525b046-ca3e-4a6f-aea7-341c25cd2d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:45.723070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525b046-ca3e-4a6f-aea7-341c25cd2d8a admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:45.723349 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525b046-ca3e-4a6f-aea7-341c25cd2d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:45.723621 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525b046-ca3e-4a6f-aea7-341c25cd2d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:45.724761 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525b046-ca3e-4a6f-aea7-341c25cd2d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:45.727713 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525b046-ca3e-4a6f-aea7-341c25cd2d8a admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:45.746182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1356/2718] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:40:45.750601 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525b046-ca3e-4a6f-aea7-341c25cd2d8a admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:45.765646 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525b046-ca3e-4a6f-aea7-341c25cd2d8a admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:45.767612 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-8a18a940-8329-42f9-b955-89deed451586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5d3a29ef6c04399b2d4f1916f61cd34', 'request_id': 'req-8a18a940-8329-42f9-b955-89deed451586'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:45.775630 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-8a18a940-8329-42f9-b955-89deed451586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5d3a29ef6c04399b2d4f1916f61cd34', 'request_id': 'req-8a18a940-8329-42f9-b955-89deed451586'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:45.782764 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-8a18a940-8329-42f9-b955-89deed451586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5d3a29ef6c04399b2d4f1916f61cd34', 'request_id': 'req-8a18a940-8329-42f9-b955-89deed451586'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:45.797668 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-8a18a940-8329-42f9-b955-89deed451586 admin admin] The token cache is being invalidate because project f5d3a29ef6c04399b2d4f1916f61cd34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:45.797958 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-8a18a940-8329-42f9-b955-89deed451586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:45.800969 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-8a18a940-8329-42f9-b955-89deed451586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:45.800969 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1363/2719] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:45 2022] DELETE /identity/v3/projects/f5d3a29ef6c04399b2d4f1916f61cd34 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:45.805590 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001ed3e-e02d-4ef1-821d-6ecf4d186df9 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:45.806225 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001ed3e-e02d-4ef1-821d-6ecf4d186df9 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:45.806853 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001ed3e-e02d-4ef1-821d-6ecf4d186df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:45.829482 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-8001ed3e-e02d-4ef1-821d-6ecf4d186df9 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:45.830738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f2887-efeb-43d3-b602-3bd216489b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:45.830873 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-8001ed3e-e02d-4ef1-821d-6ecf4d186df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:45.831688 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f2887-efeb-43d3-b602-3bd216489b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:45.831926 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f2887-efeb-43d3-b602-3bd216489b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:45.832203 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f2887-efeb-43d3-b602-3bd216489b27 admin admin] PATH_INFO: `/v3/projects/9703e119d1824ce0b9dded064f0f0575/users/3b3a61c3e88a4b8fabc5adfe44c107fa/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:45.847372 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1364/2720] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:45.850903 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f2887-efeb-43d3-b602-3bd216489b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9703e119d1824ce0b9dded064f0f0575, user_id=3b3a61c3e88a4b8fabc5adfe44c107fa, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:45.855103 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f2887-efeb-43d3-b602-3bd216489b27 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:45.856714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f64d3-3059-487f-916a-31d491a10ed2 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:45.857352 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f64d3-3059-487f-916a-31d491a10ed2 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:45.857684 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f64d3-3059-487f-916a-31d491a10ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:45.871849 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1357/2721] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:45 2022] PUT /identity/v3/projects/9703e119d1824ce0b9dded064f0f0575/users/3b3a61c3e88a4b8fabc5adfe44c107fa/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:45.881158 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-747f64d3-3059-487f-916a-31d491a10ed2 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:45.881463 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-747f64d3-3059-487f-916a-31d491a10ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:45.883453 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897aa2a-0eee-4c73-b2b1-00dbecbe3052 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:45.883768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897aa2a-0eee-4c73-b2b1-00dbecbe3052 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:45.884029 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897aa2a-0eee-4c73-b2b1-00dbecbe3052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:45.913428 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-d897aa2a-0eee-4c73-b2b1-00dbecbe3052 None None] MFA Rules not processed for user `3b3a61c3e88a4b8fabc5adfe44c107fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:45.914738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-d897aa2a-0eee-4c73-b2b1-00dbecbe3052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:45.941958 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1365/2722] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:45.946842 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f64d3-3059-487f-916a-31d491a10ed2 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:45.956343 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f64d3-3059-487f-916a-31d491a10ed2 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:45.962500 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccca628-88fd-406a-b850-4126707630b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:45.963156 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca628-88fd-406a-b850-4126707630b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:45.963454 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca628-88fd-406a-b850-4126707630b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:45.963709 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca628-88fd-406a-b850-4126707630b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:45.964438 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccca628-88fd-406a-b850-4126707630b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:40:45.964778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccca628-88fd-406a-b850-4126707630b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:45.966416 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccca628-88fd-406a-b850-4126707630b1 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:45.978657 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1366/2723] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:40:45.980517 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1358/2724] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:45.983214 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccca628-88fd-406a-b850-4126707630b1 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:45.984669 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897aa2a-0eee-4c73-b2b1-00dbecbe3052 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:45.985952 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-d897aa2a-0eee-4c73-b2b1-00dbecbe3052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:45.993012 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccca628-88fd-406a-b850-4126707630b1 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:45.997563 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709cc79-530f-476f-ae76-cbcae455226b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:45.998193 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709cc79-530f-476f-ae76-cbcae455226b admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:45.998497 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709cc79-530f-476f-ae76-cbcae455226b admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:45.998676 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897aa2a-0eee-4c73-b2b1-00dbecbe3052 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:45.998781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709cc79-530f-476f-ae76-cbcae455226b admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:45.999445 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709cc79-530f-476f-ae76-cbcae455226b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:46.001361 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709cc79-530f-476f-ae76-cbcae455226b admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:46.003279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6162b-2628-4711-9087-4102e273a8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:46.003912 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6162b-2628-4711-9087-4102e273a8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.004199 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6162b-2628-4711-9087-4102e273a8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.004520 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6162b-2628-4711-9087-4102e273a8d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.005227 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6162b-2628-4711-9087-4102e273a8d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:46.007646 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6162b-2628-4711-9087-4102e273a8d9 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:46.030633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1367/2725] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:45 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:46.034723 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709cc79-530f-476f-ae76-cbcae455226b admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:46.035898 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1359/2726] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:45 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:46.039781 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6162b-2628-4711-9087-4102e273a8d9 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:46.097051 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709cc79-530f-476f-ae76-cbcae455226b admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:46.101902 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381f706-ef57-42be-b023-0551d7e9f37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:46.102847 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381f706-ef57-42be-b023-0551d7e9f37e admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.103124 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381f706-ef57-42be-b023-0551d7e9f37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.103402 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381f706-ef57-42be-b023-0551d7e9f37e admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.103545 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6162b-2628-4711-9087-4102e273a8d9 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:46.104083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381f706-ef57-42be-b023-0551d7e9f37e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:46.106049 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381f706-ef57-42be-b023-0551d7e9f37e admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:46.108173 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82ffec-4a7f-4027-b0a7-50e7b7d39e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:46.108868 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82ffec-4a7f-4027-b0a7-50e7b7d39e45 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.109155 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82ffec-4a7f-4027-b0a7-50e7b7d39e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.109430 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82ffec-4a7f-4027-b0a7-50e7b7d39e45 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.110155 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82ffec-4a7f-4027-b0a7-50e7b7d39e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:46.112062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82ffec-4a7f-4027-b0a7-50e7b7d39e45 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:46.127348 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1368/2727] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:46 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:46.132232 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381f706-ef57-42be-b023-0551d7e9f37e admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:46.133896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1360/2728] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:46 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:46.137649 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82ffec-4a7f-4027-b0a7-50e7b7d39e45 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:46.143951 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381f706-ef57-42be-b023-0551d7e9f37e admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:46.149005 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061bfdd-5703-43a5-837f-649cb7e165d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:46.149856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061bfdd-5703-43a5-837f-649cb7e165d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.150141 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061bfdd-5703-43a5-837f-649cb7e165d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.150410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061bfdd-5703-43a5-837f-649cb7e165d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.150610 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82ffec-4a7f-4027-b0a7-50e7b7d39e45 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:46.151136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061bfdd-5703-43a5-837f-649cb7e165d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:46.152768 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061bfdd-5703-43a5-837f-649cb7e165d1 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:46.155391 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94784d69-aa5c-4f20-8748-75f3fb952bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:46.156100 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94784d69-aa5c-4f20-8748-75f3fb952bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.156389 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94784d69-aa5c-4f20-8748-75f3fb952bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.156707 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94784d69-aa5c-4f20-8748-75f3fb952bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.157441 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94784d69-aa5c-4f20-8748-75f3fb952bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:46.159093 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94784d69-aa5c-4f20-8748-75f3fb952bb3 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:46.166137 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1369/2729] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:40:46.167210 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061bfdd-5703-43a5-837f-649cb7e165d1 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:46.170039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1361/2730] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:46.173830 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94784d69-aa5c-4f20-8748-75f3fb952bb3 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:46.181059 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061bfdd-5703-43a5-837f-649cb7e165d1 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:46.184089 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94784d69-aa5c-4f20-8748-75f3fb952bb3 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:46.185775 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfaae6-066c-4178-ac12-714237409b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:46.186434 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfaae6-066c-4178-ac12-714237409b12 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.186717 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfaae6-066c-4178-ac12-714237409b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.187001 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfaae6-066c-4178-ac12-714237409b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.187726 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfaae6-066c-4178-ac12-714237409b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:46.188878 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352e1ff-d3de-40b5-9652-7569f67946e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:46.189362 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfaae6-066c-4178-ac12-714237409b12 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:46.189776 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352e1ff-d3de-40b5-9652-7569f67946e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.190058 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352e1ff-d3de-40b5-9652-7569f67946e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.190333 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352e1ff-d3de-40b5-9652-7569f67946e7 admin admin] PATH_INFO: `/v3/projects/fe623ef4b7b34c6abed606da71b9954c/users/c63bc19c01b4454599ca4f3e9fa287c9/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.200912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1370/2731] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:46.204696 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfaae6-066c-4178-ac12-714237409b12 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:46.207614 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352e1ff-d3de-40b5-9652-7569f67946e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe623ef4b7b34c6abed606da71b9954c, user_id=c63bc19c01b4454599ca4f3e9fa287c9, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:46.215721 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfaae6-066c-4178-ac12-714237409b12 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:46.216087 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352e1ff-d3de-40b5-9652-7569f67946e7 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:46.220906 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b829d1-324f-4574-a2c4-bb671b9bc2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:46.221941 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b829d1-324f-4574-a2c4-bb671b9bc2f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.222291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b829d1-324f-4574-a2c4-bb671b9bc2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.222614 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b829d1-324f-4574-a2c4-bb671b9bc2f1 admin admin] PATH_INFO: `/v3/projects/da7e234e1f854396b301cae40e75f0c5/users/3a765250d0874d0ba9c2f2571d56be16/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.230852 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1362/2732] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:46 2022] PUT /identity/v3/projects/fe623ef4b7b34c6abed606da71b9954c/users/c63bc19c01b4454599ca4f3e9fa287c9/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:46.234445 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352e1ff-d3de-40b5-9652-7569f67946e7 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:46.238157 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b829d1-324f-4574-a2c4-bb671b9bc2f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da7e234e1f854396b301cae40e75f0c5, user_id=3a765250d0874d0ba9c2f2571d56be16, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:46.241758 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b829d1-324f-4574-a2c4-bb671b9bc2f1 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:46.254969 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1371/2733] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:46 2022] PUT /identity/v3/projects/da7e234e1f854396b301cae40e75f0c5/users/3a765250d0874d0ba9c2f2571d56be16/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:46.266405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6469501-4dc1-4f17-97b8-9c3faa3835e9 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.266692 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6469501-4dc1-4f17-97b8-9c3faa3835e9 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.266971 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6469501-4dc1-4f17-97b8-9c3faa3835e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.294317 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-d6469501-4dc1-4f17-97b8-9c3faa3835e9 None None] MFA Rules not processed for user `3a765250d0874d0ba9c2f2571d56be16`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:46.295573 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d6469501-4dc1-4f17-97b8-9c3faa3835e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:46.298545 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352e1ff-d3de-40b5-9652-7569f67946e7 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:46.355202 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7fbdf-22c1-4412-962e-19d2f2fda745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:46.356025 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7fbdf-22c1-4412-962e-19d2f2fda745 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.356309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7fbdf-22c1-4412-962e-19d2f2fda745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.356606 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7fbdf-22c1-4412-962e-19d2f2fda745 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.357341 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7fbdf-22c1-4412-962e-19d2f2fda745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:46.358948 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7fbdf-22c1-4412-962e-19d2f2fda745 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:46.360396 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1372/2734] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:46.365372 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6469501-4dc1-4f17-97b8-9c3faa3835e9 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:46.370144 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1363/2735] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:40:46.373983 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7fbdf-22c1-4412-962e-19d2f2fda745 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:46.375866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6469501-4dc1-4f17-97b8-9c3faa3835e9 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:46.382807 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9d057-cbb5-42b8-8d44-eb99e0dd9cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:46.383460 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9d057-cbb5-42b8-8d44-eb99e0dd9cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.383744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9d057-cbb5-42b8-8d44-eb99e0dd9cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.384023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9d057-cbb5-42b8-8d44-eb99e0dd9cf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.384341 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7fbdf-22c1-4412-962e-19d2f2fda745 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:46.384894 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9d057-cbb5-42b8-8d44-eb99e0dd9cf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:46.386807 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9d057-cbb5-42b8-8d44-eb99e0dd9cf4 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:46.389137 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b9497-6ee4-42a0-bcda-ad142951baff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:46.389993 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b9497-6ee4-42a0-bcda-ad142951baff admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.390271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b9497-6ee4-42a0-bcda-ad142951baff admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.390542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b9497-6ee4-42a0-bcda-ad142951baff admin admin] PATH_INFO: `/v3/projects/fe623ef4b7b34c6abed606da71b9954c/users/c63bc19c01b4454599ca4f3e9fa287c9/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.392511 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b9497-6ee4-42a0-bcda-ad142951baff admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe623ef4b7b34c6abed606da71b9954c, user_id=c63bc19c01b4454599ca4f3e9fa287c9, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:46.395204 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b9497-6ee4-42a0-bcda-ad142951baff admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:46.405625 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1364/2736] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:46 2022] PUT /identity/v3/projects/fe623ef4b7b34c6abed606da71b9954c/users/c63bc19c01b4454599ca4f3e9fa287c9/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:46.418260 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4eda1a-c574-4da7-b3d1-a714ef8d788d None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.418663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4eda1a-c574-4da7-b3d1-a714ef8d788d None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.418950 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4eda1a-c574-4da7-b3d1-a714ef8d788d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.420101 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1373/2737] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:46 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:46.423968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9d057-cbb5-42b8-8d44-eb99e0dd9cf4 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:46.448706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-0c4eda1a-c574-4da7-b3d1-a714ef8d788d None None] MFA Rules not processed for user `c63bc19c01b4454599ca4f3e9fa287c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:46.450009 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-0c4eda1a-c574-4da7-b3d1-a714ef8d788d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:46.496134 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9d057-cbb5-42b8-8d44-eb99e0dd9cf4 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:46.501247 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e39150-1413-49c7-986e-3b30bf9e24e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:46.501912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e39150-1413-49c7-986e-3b30bf9e24e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.502385 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e39150-1413-49c7-986e-3b30bf9e24e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.502658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e39150-1413-49c7-986e-3b30bf9e24e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.503493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e39150-1413-49c7-986e-3b30bf9e24e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:46.505639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e39150-1413-49c7-986e-3b30bf9e24e5 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:46.523067 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1365/2738] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:46.528520 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1374/2739] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:46 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:46.531340 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4eda1a-c574-4da7-b3d1-a714ef8d788d None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:46.535484 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e39150-1413-49c7-986e-3b30bf9e24e5 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:46.538541 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-e5e39150-1413-49c7-986e-3b30bf9e24e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:46.542514 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4eda1a-c574-4da7-b3d1-a714ef8d788d None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:46.547804 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8715ec5-5ef1-445b-afba-681f72366b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:46.548768 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8715ec5-5ef1-445b-afba-681f72366b31 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.549056 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8715ec5-5ef1-445b-afba-681f72366b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.549369 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8715ec5-5ef1-445b-afba-681f72366b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.550273 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8715ec5-5ef1-445b-afba-681f72366b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:46.551868 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8715ec5-5ef1-445b-afba-681f72366b31 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:46.562612 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1366/2740] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:46.566656 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8715ec5-5ef1-445b-afba-681f72366b31 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:46.576554 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8715ec5-5ef1-445b-afba-681f72366b31 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:46.581266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c66724-73fa-477d-844d-4fb51b011df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:46.582140 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c66724-73fa-477d-844d-4fb51b011df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.582417 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c66724-73fa-477d-844d-4fb51b011df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.582687 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c66724-73fa-477d-844d-4fb51b011df5 admin admin] PATH_INFO: `/v3/projects/516ef3163e0f48718cd22a97252dd9fd/users/cdd801bb465049c58b4fd18ca6d4c358/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.596821 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c66724-73fa-477d-844d-4fb51b011df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=516ef3163e0f48718cd22a97252dd9fd, user_id=cdd801bb465049c58b4fd18ca6d4c358, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:46.598198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e39150-1413-49c7-986e-3b30bf9e24e5 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:46.600043 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c66724-73fa-477d-844d-4fb51b011df5 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:46.606106 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46dfd5-2655-4e5f-a7bf-259aa356afb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:46.607057 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46dfd5-2655-4e5f-a7bf-259aa356afb4 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.607347 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46dfd5-2655-4e5f-a7bf-259aa356afb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.607710 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46dfd5-2655-4e5f-a7bf-259aa356afb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.613908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1367/2741] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:46 2022] PUT /identity/v3/projects/516ef3163e0f48718cd22a97252dd9fd/users/cdd801bb465049c58b4fd18ca6d4c358/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:46.617910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46dfd5-2655-4e5f-a7bf-259aa356afb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:46.618486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c66724-73fa-477d-844d-4fb51b011df5 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:46.619351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46dfd5-2655-4e5f-a7bf-259aa356afb4 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:46.629420 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1375/2742] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:46.673578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46dfd5-2655-4e5f-a7bf-259aa356afb4 service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:46.675112 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-1a46dfd5-2655-4e5f-a7bf-259aa356afb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:46.682463 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c66724-73fa-477d-844d-4fb51b011df5 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:46.687069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ad749-4ea0-4793-bf7e-292917d8542f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:46.687243 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46dfd5-2655-4e5f-a7bf-259aa356afb4 service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:46.687724 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ad749-4ea0-4793-bf7e-292917d8542f admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.688003 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ad749-4ea0-4793-bf7e-292917d8542f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.688276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ad749-4ea0-4793-bf7e-292917d8542f admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.689030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ad749-4ea0-4793-bf7e-292917d8542f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:46.690617 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ad749-4ea0-4793-bf7e-292917d8542f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:46.703734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1368/2743] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:40:46.705665 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ad749-4ea0-4793-bf7e-292917d8542f admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:46.716177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ad749-4ea0-4793-bf7e-292917d8542f admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:46.721070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d4dce-0065-4993-b381-5891f79d68db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:46.721936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d4dce-0065-4993-b381-5891f79d68db admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.722215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d4dce-0065-4993-b381-5891f79d68db admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.722485 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d4dce-0065-4993-b381-5891f79d68db admin admin] PATH_INFO: `/v3/projects/516ef3163e0f48718cd22a97252dd9fd/users/cdd801bb465049c58b4fd18ca6d4c358/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.724998 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d4dce-0065-4993-b381-5891f79d68db admin admin] RBAC: Authorizing `identity:create_grant(project_id=516ef3163e0f48718cd22a97252dd9fd, user_id=cdd801bb465049c58b4fd18ca6d4c358, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:46.727903 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d4dce-0065-4993-b381-5891f79d68db admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:46.737488 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab540c-aff6-459e-932e-aa2e9ed9dd88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:46.738114 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab540c-aff6-459e-932e-aa2e9ed9dd88 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.738407 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab540c-aff6-459e-932e-aa2e9ed9dd88 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.738773 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1369/2744] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:46 2022] PUT /identity/v3/projects/516ef3163e0f48718cd22a97252dd9fd/users/cdd801bb465049c58b4fd18ca6d4c358/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:46.738910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab540c-aff6-459e-932e-aa2e9ed9dd88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.741291 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-beab540c-aff6-459e-932e-aa2e9ed9dd88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:46.750634 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b12908-b8aa-4cea-8199-12c94bd6fa91 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.750790 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b12908-b8aa-4cea-8199-12c94bd6fa91 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.751069 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b12908-b8aa-4cea-8199-12c94bd6fa91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.780213 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-c8b12908-b8aa-4cea-8199-12c94bd6fa91 None None] MFA Rules not processed for user `cdd801bb465049c58b4fd18ca6d4c358`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:46.782215 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c8b12908-b8aa-4cea-8199-12c94bd6fa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:46.811194 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab540c-aff6-459e-932e-aa2e9ed9dd88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:46.812682 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab540c-aff6-459e-932e-aa2e9ed9dd88 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:46.822230 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1376/2745] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:40:46.861677 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1370/2746] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:46.882577 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab540c-aff6-459e-932e-aa2e9ed9dd88 service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:46.895596 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab540c-aff6-459e-932e-aa2e9ed9dd88 service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:46.944485 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfdb23-75d5-4a8f-801a-945e5b378e73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:46.945191 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfdb23-75d5-4a8f-801a-945e5b378e73 service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:46.945474 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfdb23-75d5-4a8f-801a-945e5b378e73 service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:46.945750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfdb23-75d5-4a8f-801a-945e5b378e73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:46.955794 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfdb23-75d5-4a8f-801a-945e5b378e73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:46.957386 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfdb23-75d5-4a8f-801a-945e5b378e73 service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:46.971483 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1377/2747] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:47.095849 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b12908-b8aa-4cea-8199-12c94bd6fa91 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:47.106112 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b12908-b8aa-4cea-8199-12c94bd6fa91 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:47.109851 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5159f2-a598-4476-943b-6b269d37fe01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:47.110427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5159f2-a598-4476-943b-6b269d37fe01 service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:47.110711 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5159f2-a598-4476-943b-6b269d37fe01 service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:47.111052 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5159f2-a598-4476-943b-6b269d37fe01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:47.173123 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5159f2-a598-4476-943b-6b269d37fe01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:47.174601 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5159f2-a598-4476-943b-6b269d37fe01 service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:47.184585 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1371/2748] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:47.464179 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfdb23-75d5-4a8f-801a-945e5b378e73 service cinder] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:47.523355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfdb23-75d5-4a8f-801a-945e5b378e73 service cinder] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:47.527914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c6e6a-96ce-4bf5-aeb2-afbe33efd21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:47.528813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c6e6a-96ce-4bf5-aeb2-afbe33efd21f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:47.529088 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c6e6a-96ce-4bf5-aeb2-afbe33efd21f admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:47.529355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c6e6a-96ce-4bf5-aeb2-afbe33efd21f admin admin] PATH_INFO: `/v3/users/3a765250d0874d0ba9c2f2571d56be16` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:47.530518 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c6e6a-96ce-4bf5-aeb2-afbe33efd21f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a765250d0874d0ba9c2f2571d56be16)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:47.532453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c6e6a-96ce-4bf5-aeb2-afbe33efd21f admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:47.576223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-347c6e6a-96ce-4bf5-aeb2-afbe33efd21f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a765250d0874d0ba9c2f2571d56be16'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:47.584298 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-347c6e6a-96ce-4bf5-aeb2-afbe33efd21f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a765250d0874d0ba9c2f2571d56be16'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:47.585002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-347c6e6a-96ce-4bf5-aeb2-afbe33efd21f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a765250d0874d0ba9c2f2571d56be16'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:47.592052 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-347c6e6a-96ce-4bf5-aeb2-afbe33efd21f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a765250d0874d0ba9c2f2571d56be16'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:47.592714 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-347c6e6a-96ce-4bf5-aeb2-afbe33efd21f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a765250d0874d0ba9c2f2571d56be16'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:47.609809 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1378/2749] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:47 2022] DELETE /identity/v3/users/3a765250d0874d0ba9c2f2571d56be16 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:47.614451 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250fe63-810c-4df5-a8b0-06c26820cf14 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:47.614745 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250fe63-810c-4df5-a8b0-06c26820cf14 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:47.615022 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250fe63-810c-4df5-a8b0-06c26820cf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:47.631495 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-7250fe63-810c-4df5-a8b0-06c26820cf14 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:47.632617 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-7250fe63-810c-4df5-a8b0-06c26820cf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:47.688425 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1372/2750] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:47.698030 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c6e6a-96ce-4bf5-aeb2-afbe33efd21f admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:47.699481 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-347c6e6a-96ce-4bf5-aeb2-afbe33efd21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:47.755642 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c6e6a-96ce-4bf5-aeb2-afbe33efd21f admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:47.759374 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5ce8c-48e7-4d2c-ad0c-81a74096606d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:47.760023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5ce8c-48e7-4d2c-ad0c-81a74096606d service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:47.760306 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5ce8c-48e7-4d2c-ad0c-81a74096606d service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:47.760610 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5ce8c-48e7-4d2c-ad0c-81a74096606d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:47.769641 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5ce8c-48e7-4d2c-ad0c-81a74096606d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:47.771603 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5ce8c-48e7-4d2c-ad0c-81a74096606d service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:47.780910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1379/2751] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:48.314488 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250fe63-810c-4df5-a8b0-06c26820cf14 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:48.316006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-7250fe63-810c-4df5-a8b0-06c26820cf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:48.329317 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250fe63-810c-4df5-a8b0-06c26820cf14 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:48.334907 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c515265-bfc5-4c71-98f5-63d05e0fe240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:48.335947 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c515265-bfc5-4c71-98f5-63d05e0fe240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:48.342359 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c515265-bfc5-4c71-98f5-63d05e0fe240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:48.342359 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c515265-bfc5-4c71-98f5-63d05e0fe240 admin admin] PATH_INFO: `/v3/projects/da7e234e1f854396b301cae40e75f0c5` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:48.342359 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c515265-bfc5-4c71-98f5-63d05e0fe240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da7e234e1f854396b301cae40e75f0c5)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:48.342359 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c515265-bfc5-4c71-98f5-63d05e0fe240 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:48.386286 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4c515265-bfc5-4c71-98f5-63d05e0fe240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da7e234e1f854396b301cae40e75f0c5', 'request_id': 'req-4c515265-bfc5-4c71-98f5-63d05e0fe240'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:48.392107 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4c515265-bfc5-4c71-98f5-63d05e0fe240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da7e234e1f854396b301cae40e75f0c5', 'request_id': 'req-4c515265-bfc5-4c71-98f5-63d05e0fe240'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:48.397358 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4c515265-bfc5-4c71-98f5-63d05e0fe240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da7e234e1f854396b301cae40e75f0c5', 'request_id': 'req-4c515265-bfc5-4c71-98f5-63d05e0fe240'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:48.408925 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4c515265-bfc5-4c71-98f5-63d05e0fe240 admin admin] The token cache is being invalidate because project da7e234e1f854396b301cae40e75f0c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:48.409274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4c515265-bfc5-4c71-98f5-63d05e0fe240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:48.410040 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4c515265-bfc5-4c71-98f5-63d05e0fe240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:48.412144 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1373/2752] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:48 2022] DELETE /identity/v3/projects/da7e234e1f854396b301cae40e75f0c5 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:48.416458 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5ce8c-48e7-4d2c-ad0c-81a74096606d service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:48.425893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5ce8c-48e7-4d2c-ad0c-81a74096606d service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:48.482743 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7891083-9a3d-4982-b123-2da3a3e35961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:48.483978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7891083-9a3d-4982-b123-2da3a3e35961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:48.484261 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7891083-9a3d-4982-b123-2da3a3e35961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:48.484546 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7891083-9a3d-4982-b123-2da3a3e35961 admin admin] PATH_INFO: `/v3/users/cdd801bb465049c58b4fd18ca6d4c358` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:48.485759 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7891083-9a3d-4982-b123-2da3a3e35961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd801bb465049c58b4fd18ca6d4c358)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:48.487673 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7891083-9a3d-4982-b123-2da3a3e35961 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:48.533429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-a7891083-9a3d-4982-b123-2da3a3e35961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd801bb465049c58b4fd18ca6d4c358'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:48.539935 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-a7891083-9a3d-4982-b123-2da3a3e35961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd801bb465049c58b4fd18ca6d4c358'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:48.540616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-a7891083-9a3d-4982-b123-2da3a3e35961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd801bb465049c58b4fd18ca6d4c358'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:48.547622 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-a7891083-9a3d-4982-b123-2da3a3e35961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd801bb465049c58b4fd18ca6d4c358'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:48.548226 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-a7891083-9a3d-4982-b123-2da3a3e35961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd801bb465049c58b4fd18ca6d4c358'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:48.565283 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1380/2753] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:48 2022] DELETE /identity/v3/users/cdd801bb465049c58b4fd18ca6d4c358 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:48.824007 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c515265-bfc5-4c71-98f5-63d05e0fe240 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:48.825507 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-4c515265-bfc5-4c71-98f5-63d05e0fe240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:48.840427 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c515265-bfc5-4c71-98f5-63d05e0fe240 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:48.900777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963adb5-4b6f-4e12-a734-166fb06ba898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:48.901637 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963adb5-4b6f-4e12-a734-166fb06ba898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:48.901990 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963adb5-4b6f-4e12-a734-166fb06ba898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:48.902260 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963adb5-4b6f-4e12-a734-166fb06ba898 admin admin] PATH_INFO: `/v3/projects/516ef3163e0f48718cd22a97252dd9fd` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:48.903511 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963adb5-4b6f-4e12-a734-166fb06ba898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=516ef3163e0f48718cd22a97252dd9fd)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:48.905454 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963adb5-4b6f-4e12-a734-166fb06ba898 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:48.957706 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-9963adb5-4b6f-4e12-a734-166fb06ba898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '516ef3163e0f48718cd22a97252dd9fd', 'request_id': 'req-9963adb5-4b6f-4e12-a734-166fb06ba898'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:48.963825 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-9963adb5-4b6f-4e12-a734-166fb06ba898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '516ef3163e0f48718cd22a97252dd9fd', 'request_id': 'req-9963adb5-4b6f-4e12-a734-166fb06ba898'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:48.969514 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-9963adb5-4b6f-4e12-a734-166fb06ba898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '516ef3163e0f48718cd22a97252dd9fd', 'request_id': 'req-9963adb5-4b6f-4e12-a734-166fb06ba898'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:48.982285 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-9963adb5-4b6f-4e12-a734-166fb06ba898 admin admin] The token cache is being invalidate because project 516ef3163e0f48718cd22a97252dd9fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:48.982569 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-9963adb5-4b6f-4e12-a734-166fb06ba898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:48.983187 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-9963adb5-4b6f-4e12-a734-166fb06ba898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:48.984774 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1374/2754] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:48 2022] DELETE /identity/v3/projects/516ef3163e0f48718cd22a97252dd9fd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:48.990426 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a4e1f-9782-4395-a9be-13186e4a9fe9 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:48.990719 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a4e1f-9782-4395-a9be-13186e4a9fe9 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:48.991000 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a4e1f-9782-4395-a9be-13186e4a9fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:49.008586 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-291a4e1f-9782-4395-a9be-13186e4a9fe9 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:49.009789 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-291a4e1f-9782-4395-a9be-13186e4a9fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:49.066204 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1381/2755] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:49.074208 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d89b06-a60a-4b7a-a6cc-427146c46f60 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:49.074430 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d89b06-a60a-4b7a-a6cc-427146c46f60 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:49.074702 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d89b06-a60a-4b7a-a6cc-427146c46f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:49.093508 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-10d89b06-a60a-4b7a-a6cc-427146c46f60 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:49.094693 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-10d89b06-a60a-4b7a-a6cc-427146c46f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:49.103415 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1375/2756] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:49.107633 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a4e1f-9782-4395-a9be-13186e4a9fe9 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:49.117133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a4e1f-9782-4395-a9be-13186e4a9fe9 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:49.121635 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e5cc5-37f9-47c6-95fe-f25543a24bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:49.122278 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e5cc5-37f9-47c6-95fe-f25543a24bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:49.122574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e5cc5-37f9-47c6-95fe-f25543a24bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:49.122830 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e5cc5-37f9-47c6-95fe-f25543a24bd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:49.123652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e5cc5-37f9-47c6-95fe-f25543a24bd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:40:49.123854 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e5cc5-37f9-47c6-95fe-f25543a24bd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:49.125474 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e5cc5-37f9-47c6-95fe-f25543a24bd7 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:49.137010 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1382/2757] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:40:49.141064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d89b06-a60a-4b7a-a6cc-427146c46f60 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:49.150444 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d89b06-a60a-4b7a-a6cc-427146c46f60 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:49.155601 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab12fae-f7ae-4481-9800-a63cb6ef7e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:49.156264 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12fae-f7ae-4481-9800-a63cb6ef7e12 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:49.156569 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12fae-f7ae-4481-9800-a63cb6ef7e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:49.156881 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12fae-f7ae-4481-9800-a63cb6ef7e12 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:49.157569 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab12fae-f7ae-4481-9800-a63cb6ef7e12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:49.159479 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab12fae-f7ae-4481-9800-a63cb6ef7e12 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:49.184338 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1376/2758] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:49 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:49.188320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e5cc5-37f9-47c6-95fe-f25543a24bd7 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:49.198119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e5cc5-37f9-47c6-95fe-f25543a24bd7 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:49.251902 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b493ba6-0d64-4bb8-b52e-ed355b5fe154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:49.252835 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b493ba6-0d64-4bb8-b52e-ed355b5fe154 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:49.253120 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b493ba6-0d64-4bb8-b52e-ed355b5fe154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:49.253399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b493ba6-0d64-4bb8-b52e-ed355b5fe154 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:49.254125 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b493ba6-0d64-4bb8-b52e-ed355b5fe154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:49.256200 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b493ba6-0d64-4bb8-b52e-ed355b5fe154 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:49.276147 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1383/2759] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:49 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:40:49.280190 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab12fae-f7ae-4481-9800-a63cb6ef7e12 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:49.292036 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab12fae-f7ae-4481-9800-a63cb6ef7e12 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:49.298394 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea2b26-f939-413d-a0b0-333ee6e4ee87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:49.299096 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea2b26-f939-413d-a0b0-333ee6e4ee87 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:49.299387 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea2b26-f939-413d-a0b0-333ee6e4ee87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:49.299664 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea2b26-f939-413d-a0b0-333ee6e4ee87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:49.300401 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea2b26-f939-413d-a0b0-333ee6e4ee87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:49.302080 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea2b26-f939-413d-a0b0-333ee6e4ee87 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:49.312646 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1377/2760] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:49.316770 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b493ba6-0d64-4bb8-b52e-ed355b5fe154 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:49.326622 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b493ba6-0d64-4bb8-b52e-ed355b5fe154 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:49.331219 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd95b0c-5f2a-450e-8721-60469fa3fb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:49.331863 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd95b0c-5f2a-450e-8721-60469fa3fb87 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:49.332148 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd95b0c-5f2a-450e-8721-60469fa3fb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:49.332423 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd95b0c-5f2a-450e-8721-60469fa3fb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:49.333177 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd95b0c-5f2a-450e-8721-60469fa3fb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:49.335270 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd95b0c-5f2a-450e-8721-60469fa3fb87 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:49.345671 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1384/2761] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:49.350517 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea2b26-f939-413d-a0b0-333ee6e4ee87 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:49.360668 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea2b26-f939-413d-a0b0-333ee6e4ee87 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:49.365585 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53588d3-9e0f-4e47-8405-a450a91d07be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:49.366459 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53588d3-9e0f-4e47-8405-a450a91d07be admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:49.366737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53588d3-9e0f-4e47-8405-a450a91d07be admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:49.367007 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53588d3-9e0f-4e47-8405-a450a91d07be admin admin] PATH_INFO: `/v3/projects/7cb4da166bd1440ab1aa55cc792f9d60/users/56aaaebcbc934367883f5b689f3133b5/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:49.381386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53588d3-9e0f-4e47-8405-a450a91d07be admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb4da166bd1440ab1aa55cc792f9d60, user_id=56aaaebcbc934367883f5b689f3133b5, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:49.384058 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53588d3-9e0f-4e47-8405-a450a91d07be admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:49.397005 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1378/2762] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:49 2022] PUT /identity/v3/projects/7cb4da166bd1440ab1aa55cc792f9d60/users/56aaaebcbc934367883f5b689f3133b5/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:49.408290 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f31cd6-99d9-4026-beb0-942af8f6ab44 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:49.408639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f31cd6-99d9-4026-beb0-942af8f6ab44 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:49.408964 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f31cd6-99d9-4026-beb0-942af8f6ab44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:49.436072 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-90f31cd6-99d9-4026-beb0-942af8f6ab44 None None] MFA Rules not processed for user `56aaaebcbc934367883f5b689f3133b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:49.437305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-90f31cd6-99d9-4026-beb0-942af8f6ab44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:49.502159 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1385/2763] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:49.513599 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53588d3-9e0f-4e47-8405-a450a91d07be admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:49.515259 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-a53588d3-9e0f-4e47-8405-a450a91d07be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:49.570083 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53588d3-9e0f-4e47-8405-a450a91d07be admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:49.573738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9ca33-fe61-4640-85b1-8453150f0aeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:49.574365 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9ca33-fe61-4640-85b1-8453150f0aeb service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:49.574680 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9ca33-fe61-4640-85b1-8453150f0aeb service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:49.574978 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9ca33-fe61-4640-85b1-8453150f0aeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:49.583130 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9ca33-fe61-4640-85b1-8453150f0aeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:49.585121 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9ca33-fe61-4640-85b1-8453150f0aeb service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:49.593562 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1379/2764] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:40:51.902452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f31cd6-99d9-4026-beb0-942af8f6ab44 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:51.904014 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-90f31cd6-99d9-4026-beb0-942af8f6ab44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:51.968515 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f31cd6-99d9-4026-beb0-942af8f6ab44 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:51.973532 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2842c5-8a1f-4e9b-8dc8-5fe9e5393acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:51.974912 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2842c5-8a1f-4e9b-8dc8-5fe9e5393acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:51.975207 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2842c5-8a1f-4e9b-8dc8-5fe9e5393acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:51.975521 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2842c5-8a1f-4e9b-8dc8-5fe9e5393acc admin admin] PATH_INFO: `/v3/users/896e029d1b664b5f8051d98c11a5a2db` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:51.976835 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2842c5-8a1f-4e9b-8dc8-5fe9e5393acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=896e029d1b664b5f8051d98c11a5a2db)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:51.979083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2842c5-8a1f-4e9b-8dc8-5fe9e5393acc admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:52.026674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6c2842c5-8a1f-4e9b-8dc8-5fe9e5393acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896e029d1b664b5f8051d98c11a5a2db'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.033592 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6c2842c5-8a1f-4e9b-8dc8-5fe9e5393acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896e029d1b664b5f8051d98c11a5a2db'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.034429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6c2842c5-8a1f-4e9b-8dc8-5fe9e5393acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896e029d1b664b5f8051d98c11a5a2db'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.043062 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6c2842c5-8a1f-4e9b-8dc8-5fe9e5393acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896e029d1b664b5f8051d98c11a5a2db'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.044019 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-6c2842c5-8a1f-4e9b-8dc8-5fe9e5393acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896e029d1b664b5f8051d98c11a5a2db'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.061933 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1386/2765] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:51 2022] DELETE /identity/v3/users/896e029d1b664b5f8051d98c11a5a2db => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:52.066957 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1013-b3e0-4c6f-9e52-59b6250fc8ee None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:52.067429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1013-b3e0-4c6f-9e52-59b6250fc8ee None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:52.067572 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1013-b3e0-4c6f-9e52-59b6250fc8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:52.085443 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-6dff1013-b3e0-4c6f-9e52-59b6250fc8ee None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:52.086665 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-6dff1013-b3e0-4c6f-9e52-59b6250fc8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:52.105447 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2842c5-8a1f-4e9b-8dc8-5fe9e5393acc admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:52.106918 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-6c2842c5-8a1f-4e9b-8dc8-5fe9e5393acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:52.147417 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1380/2766] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:52.157379 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff1013-b3e0-4c6f-9e52-59b6250fc8ee None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:52.158896 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-6dff1013-b3e0-4c6f-9e52-59b6250fc8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:52.171514 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2842c5-8a1f-4e9b-8dc8-5fe9e5393acc admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:52.176249 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071d126-8303-4a7d-a341-f4b95708a9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:52.177181 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071d126-8303-4a7d-a341-f4b95708a9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:52.177463 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071d126-8303-4a7d-a341-f4b95708a9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:52.177742 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071d126-8303-4a7d-a341-f4b95708a9b2 admin admin] PATH_INFO: `/v3/users/56aaaebcbc934367883f5b689f3133b5` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:52.178954 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071d126-8303-4a7d-a341-f4b95708a9b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56aaaebcbc934367883f5b689f3133b5)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:52.180911 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071d126-8303-4a7d-a341-f4b95708a9b2 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:52.218050 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff1013-b3e0-4c6f-9e52-59b6250fc8ee None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:52.221632 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a348cda-408c-4233-aa51-ab0b7a4307d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:52.222274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a348cda-408c-4233-aa51-ab0b7a4307d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:52.222556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a348cda-408c-4233-aa51-ab0b7a4307d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:52.222831 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a348cda-408c-4233-aa51-ab0b7a4307d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:52.228792 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-1071d126-8303-4a7d-a341-f4b95708a9b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56aaaebcbc934367883f5b689f3133b5'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.233035 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a348cda-408c-4233-aa51-ab0b7a4307d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:52.234484 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a348cda-408c-4233-aa51-ab0b7a4307d9 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:52.235748 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-1071d126-8303-4a7d-a341-f4b95708a9b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56aaaebcbc934367883f5b689f3133b5'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.236466 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-1071d126-8303-4a7d-a341-f4b95708a9b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56aaaebcbc934367883f5b689f3133b5'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.245651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-1071d126-8303-4a7d-a341-f4b95708a9b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56aaaebcbc934367883f5b689f3133b5'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.246321 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1381/2767] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:40:52.246650 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-1071d126-8303-4a7d-a341-f4b95708a9b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56aaaebcbc934367883f5b689f3133b5'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.266933 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1387/2768] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:52 2022] DELETE /identity/v3/users/56aaaebcbc934367883f5b689f3133b5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:52.272234 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83fe7b-f18b-4ffd-a53a-ea81df938962 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:52.272899 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83fe7b-f18b-4ffd-a53a-ea81df938962 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:52.273444 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83fe7b-f18b-4ffd-a53a-ea81df938962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:52.292175 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-df83fe7b-f18b-4ffd-a53a-ea81df938962 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:52.293494 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-df83fe7b-f18b-4ffd-a53a-ea81df938962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:52.365381 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1382/2769] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:52.375274 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071d126-8303-4a7d-a341-f4b95708a9b2 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:52.376841 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-1071d126-8303-4a7d-a341-f4b95708a9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:52.439867 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071d126-8303-4a7d-a341-f4b95708a9b2 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:52.444444 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc25b62-3628-45b8-8e03-ef192ddcee33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:52.445126 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc25b62-3628-45b8-8e03-ef192ddcee33 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:52.445405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc25b62-3628-45b8-8e03-ef192ddcee33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:52.445679 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc25b62-3628-45b8-8e03-ef192ddcee33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:52.455025 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc25b62-3628-45b8-8e03-ef192ddcee33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:52.456453 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc25b62-3628-45b8-8e03-ef192ddcee33 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:52.467029 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1388/2770] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:40:52.571591 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83fe7b-f18b-4ffd-a53a-ea81df938962 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:52.573017 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-df83fe7b-f18b-4ffd-a53a-ea81df938962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:52.604689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83fe7b-f18b-4ffd-a53a-ea81df938962 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:52.612846 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edd5fa-3bc9-4ec2-915f-2a9902274ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:52.613990 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edd5fa-3bc9-4ec2-915f-2a9902274ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:52.614280 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edd5fa-3bc9-4ec2-915f-2a9902274ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:52.614578 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edd5fa-3bc9-4ec2-915f-2a9902274ba4 admin admin] PATH_INFO: `/v3/projects/ff9cf9998d304d7e89a0894d9c31c48b` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:52.616244 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0edd5fa-3bc9-4ec2-915f-2a9902274ba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff9cf9998d304d7e89a0894d9c31c48b)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:52.618412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0edd5fa-3bc9-4ec2-915f-2a9902274ba4 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:52.675781 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d0edd5fa-3bc9-4ec2-915f-2a9902274ba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff9cf9998d304d7e89a0894d9c31c48b', 'request_id': 'req-d0edd5fa-3bc9-4ec2-915f-2a9902274ba4'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.682969 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d0edd5fa-3bc9-4ec2-915f-2a9902274ba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff9cf9998d304d7e89a0894d9c31c48b', 'request_id': 'req-d0edd5fa-3bc9-4ec2-915f-2a9902274ba4'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.688498 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d0edd5fa-3bc9-4ec2-915f-2a9902274ba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff9cf9998d304d7e89a0894d9c31c48b', 'request_id': 'req-d0edd5fa-3bc9-4ec2-915f-2a9902274ba4'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.706183 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d0edd5fa-3bc9-4ec2-915f-2a9902274ba4 admin admin] The token cache is being invalidate because project ff9cf9998d304d7e89a0894d9c31c48b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:52.706595 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d0edd5fa-3bc9-4ec2-915f-2a9902274ba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.707353 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-d0edd5fa-3bc9-4ec2-915f-2a9902274ba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.712827 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1383/2771] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:52 2022] DELETE /identity/v3/projects/ff9cf9998d304d7e89a0894d9c31c48b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:52.713936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc25b62-3628-45b8-8e03-ef192ddcee33 service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:52.723806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc25b62-3628-45b8-8e03-ef192ddcee33 service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:52.780316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4a0ed-4f99-4082-b6da-9eca9409f71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:52.781320 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4a0ed-4f99-4082-b6da-9eca9409f71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:52.781599 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4a0ed-4f99-4082-b6da-9eca9409f71a admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:52.782013 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4a0ed-4f99-4082-b6da-9eca9409f71a admin admin] PATH_INFO: `/v3/users/3b3a61c3e88a4b8fabc5adfe44c107fa` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:52.783244 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4a0ed-4f99-4082-b6da-9eca9409f71a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b3a61c3e88a4b8fabc5adfe44c107fa)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:52.785321 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4a0ed-4f99-4082-b6da-9eca9409f71a admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:52.804669 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edd5fa-3bc9-4ec2-915f-2a9902274ba4 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:52.806233 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-d0edd5fa-3bc9-4ec2-915f-2a9902274ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:52.828512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edd5fa-3bc9-4ec2-915f-2a9902274ba4 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:52.835863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d8e5c-9ef3-479b-a9b4-47497ff1fb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:52.836129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b3c4a0ed-4f99-4082-b6da-9eca9409f71a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b3a61c3e88a4b8fabc5adfe44c107fa'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.836936 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d8e5c-9ef3-479b-a9b4-47497ff1fb3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:52.837224 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d8e5c-9ef3-479b-a9b4-47497ff1fb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:52.837496 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d8e5c-9ef3-479b-a9b4-47497ff1fb3e admin admin] PATH_INFO: `/v3/projects/7cb4da166bd1440ab1aa55cc792f9d60` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:52.844933 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d8e5c-9ef3-479b-a9b4-47497ff1fb3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cb4da166bd1440ab1aa55cc792f9d60)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:52.845116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b3c4a0ed-4f99-4082-b6da-9eca9409f71a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b3a61c3e88a4b8fabc5adfe44c107fa'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.846032 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b3c4a0ed-4f99-4082-b6da-9eca9409f71a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b3a61c3e88a4b8fabc5adfe44c107fa'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.847428 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d8e5c-9ef3-479b-a9b4-47497ff1fb3e admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:52.855715 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b3c4a0ed-4f99-4082-b6da-9eca9409f71a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b3a61c3e88a4b8fabc5adfe44c107fa'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.857278 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b3c4a0ed-4f99-4082-b6da-9eca9409f71a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b3a61c3e88a4b8fabc5adfe44c107fa'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.875839 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1389/2772] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:52 2022] DELETE /identity/v3/users/3b3a61c3e88a4b8fabc5adfe44c107fa => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:52.899340 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-854d8e5c-9ef3-479b-a9b4-47497ff1fb3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cb4da166bd1440ab1aa55cc792f9d60', 'request_id': 'req-854d8e5c-9ef3-479b-a9b4-47497ff1fb3e'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.905490 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-854d8e5c-9ef3-479b-a9b4-47497ff1fb3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cb4da166bd1440ab1aa55cc792f9d60', 'request_id': 'req-854d8e5c-9ef3-479b-a9b4-47497ff1fb3e'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.911308 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-854d8e5c-9ef3-479b-a9b4-47497ff1fb3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cb4da166bd1440ab1aa55cc792f9d60', 'request_id': 'req-854d8e5c-9ef3-479b-a9b4-47497ff1fb3e'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.923470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-854d8e5c-9ef3-479b-a9b4-47497ff1fb3e admin admin] The token cache is being invalidate because project 7cb4da166bd1440ab1aa55cc792f9d60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:52.923777 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-854d8e5c-9ef3-479b-a9b4-47497ff1fb3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.924425 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-854d8e5c-9ef3-479b-a9b4-47497ff1fb3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:52.926311 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1384/2773] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:52 2022] DELETE /identity/v3/projects/7cb4da166bd1440ab1aa55cc792f9d60 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:53.194629 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4a0ed-4f99-4082-b6da-9eca9409f71a admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:53.196260 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b3c4a0ed-4f99-4082-b6da-9eca9409f71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:53.261169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4a0ed-4f99-4082-b6da-9eca9409f71a admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:53.315765 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ecfdb-4907-4441-934e-1a6d8602ac09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:53.316688 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ecfdb-4907-4441-934e-1a6d8602ac09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:53.316978 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ecfdb-4907-4441-934e-1a6d8602ac09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:53.317266 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ecfdb-4907-4441-934e-1a6d8602ac09 admin admin] PATH_INFO: `/v3/projects/9703e119d1824ce0b9dded064f0f0575` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:53.318458 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ecfdb-4907-4441-934e-1a6d8602ac09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9703e119d1824ce0b9dded064f0f0575)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:53.320461 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ecfdb-4907-4441-934e-1a6d8602ac09 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:53.367005 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-476ecfdb-4907-4441-934e-1a6d8602ac09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9703e119d1824ce0b9dded064f0f0575', 'request_id': 'req-476ecfdb-4907-4441-934e-1a6d8602ac09'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:53.373342 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-476ecfdb-4907-4441-934e-1a6d8602ac09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9703e119d1824ce0b9dded064f0f0575', 'request_id': 'req-476ecfdb-4907-4441-934e-1a6d8602ac09'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:53.378922 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-476ecfdb-4907-4441-934e-1a6d8602ac09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9703e119d1824ce0b9dded064f0f0575', 'request_id': 'req-476ecfdb-4907-4441-934e-1a6d8602ac09'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:53.390472 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-476ecfdb-4907-4441-934e-1a6d8602ac09 admin admin] The token cache is being invalidate because project 9703e119d1824ce0b9dded064f0f0575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:53.390793 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-476ecfdb-4907-4441-934e-1a6d8602ac09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:53.391468 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-476ecfdb-4907-4441-934e-1a6d8602ac09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:53.393184 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1390/2774] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:53 2022] DELETE /identity/v3/projects/9703e119d1824ce0b9dded064f0f0575 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:53.397204 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d8e5c-9ef3-479b-a9b4-47497ff1fb3e admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:53.399031 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-854d8e5c-9ef3-479b-a9b4-47497ff1fb3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:53.413501 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d8e5c-9ef3-479b-a9b4-47497ff1fb3e admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:53.468455 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b258f92-15b8-4561-871a-3deb687c6f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:53.469380 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b258f92-15b8-4561-871a-3deb687c6f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:53.469656 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b258f92-15b8-4561-871a-3deb687c6f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:53.469924 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b258f92-15b8-4561-871a-3deb687c6f34 admin admin] PATH_INFO: `/v3/users/c63bc19c01b4454599ca4f3e9fa287c9` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:53.471097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b258f92-15b8-4561-871a-3deb687c6f34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c63bc19c01b4454599ca4f3e9fa287c9)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:53.473039 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b258f92-15b8-4561-871a-3deb687c6f34 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:53.517736 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-0b258f92-15b8-4561-871a-3deb687c6f34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c63bc19c01b4454599ca4f3e9fa287c9'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:53.524132 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-0b258f92-15b8-4561-871a-3deb687c6f34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c63bc19c01b4454599ca4f3e9fa287c9'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:53.530930 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-0b258f92-15b8-4561-871a-3deb687c6f34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c63bc19c01b4454599ca4f3e9fa287c9'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:53.531535 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-0b258f92-15b8-4561-871a-3deb687c6f34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c63bc19c01b4454599ca4f3e9fa287c9'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:53.532129 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-0b258f92-15b8-4561-871a-3deb687c6f34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c63bc19c01b4454599ca4f3e9fa287c9'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:53.548819 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1385/2775] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:53 2022] DELETE /identity/v3/users/c63bc19c01b4454599ca4f3e9fa287c9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:53.814050 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ecfdb-4907-4441-934e-1a6d8602ac09 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:53.815652 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-476ecfdb-4907-4441-934e-1a6d8602ac09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:53.831140 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ecfdb-4907-4441-934e-1a6d8602ac09 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:53.899569 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b258f92-15b8-4561-871a-3deb687c6f34 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:53.901028 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-0b258f92-15b8-4561-871a-3deb687c6f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:53.901527 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35777d90-3a64-48b0-9174-e798acec87bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:53.902967 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35777d90-3a64-48b0-9174-e798acec87bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:53.903248 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35777d90-3a64-48b0-9174-e798acec87bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:53.903520 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35777d90-3a64-48b0-9174-e798acec87bb admin admin] PATH_INFO: `/v3/projects/fe623ef4b7b34c6abed606da71b9954c` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:53.904749 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35777d90-3a64-48b0-9174-e798acec87bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe623ef4b7b34c6abed606da71b9954c)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:53.907156 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35777d90-3a64-48b0-9174-e798acec87bb admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:53.913375 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b258f92-15b8-4561-871a-3deb687c6f34 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:53.917903 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40083649-5ff3-416f-ad7b-d3273ae90550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:53.918756 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40083649-5ff3-416f-ad7b-d3273ae90550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:53.919033 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40083649-5ff3-416f-ad7b-d3273ae90550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:53.919303 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40083649-5ff3-416f-ad7b-d3273ae90550 admin admin] PATH_INFO: `/v3/users/661a85b876cb4991aeaed9050e9aea6f` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:53.920493 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40083649-5ff3-416f-ad7b-d3273ae90550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=661a85b876cb4991aeaed9050e9aea6f)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:53.922426 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40083649-5ff3-416f-ad7b-d3273ae90550 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:53.959172 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-35777d90-3a64-48b0-9174-e798acec87bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe623ef4b7b34c6abed606da71b9954c', 'request_id': 'req-35777d90-3a64-48b0-9174-e798acec87bb'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:53.965370 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-35777d90-3a64-48b0-9174-e798acec87bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe623ef4b7b34c6abed606da71b9954c', 'request_id': 'req-35777d90-3a64-48b0-9174-e798acec87bb'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:53.969808 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-40083649-5ff3-416f-ad7b-d3273ae90550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '661a85b876cb4991aeaed9050e9aea6f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:53.970709 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-35777d90-3a64-48b0-9174-e798acec87bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe623ef4b7b34c6abed606da71b9954c', 'request_id': 'req-35777d90-3a64-48b0-9174-e798acec87bb'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:53.977750 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-40083649-5ff3-416f-ad7b-d3273ae90550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '661a85b876cb4991aeaed9050e9aea6f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:53.984129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-35777d90-3a64-48b0-9174-e798acec87bb admin admin] The token cache is being invalidate because project fe623ef4b7b34c6abed606da71b9954c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:53.984417 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-35777d90-3a64-48b0-9174-e798acec87bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:53.985146 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-35777d90-3a64-48b0-9174-e798acec87bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:53.985279 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-40083649-5ff3-416f-ad7b-d3273ae90550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '661a85b876cb4991aeaed9050e9aea6f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:53.986176 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-40083649-5ff3-416f-ad7b-d3273ae90550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '661a85b876cb4991aeaed9050e9aea6f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:53.987018 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1391/2776] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:53 2022] DELETE /identity/v3/projects/fe623ef4b7b34c6abed606da71b9954c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:53.987150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-40083649-5ff3-416f-ad7b-d3273ae90550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '661a85b876cb4991aeaed9050e9aea6f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:53.993266 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba1ebe-71d8-4e9a-b2af-bc20cc43f65a None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:53.993553 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba1ebe-71d8-4e9a-b2af-bc20cc43f65a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:53.993854 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba1ebe-71d8-4e9a-b2af-bc20cc43f65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:54.005751 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1386/2777] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:53 2022] DELETE /identity/v3/users/661a85b876cb4991aeaed9050e9aea6f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:54.010047 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723da405-cb26-4778-945e-091a21eebbc6 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:54.010337 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723da405-cb26-4778-945e-091a21eebbc6 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:54.010615 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723da405-cb26-4778-945e-091a21eebbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:54.012123 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-74ba1ebe-71d8-4e9a-b2af-bc20cc43f65a None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:54.013377 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-74ba1ebe-71d8-4e9a-b2af-bc20cc43f65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:54.027521 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-723da405-cb26-4778-945e-091a21eebbc6 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:54.028865 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-723da405-cb26-4778-945e-091a21eebbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:54.077459 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1392/2778] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:54.086197 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c9c8e-9026-4c9c-933c-dcb4cb5be554 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:54.086547 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c9c8e-9026-4c9c-933c-dcb4cb5be554 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:54.086997 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c9c8e-9026-4c9c-933c-dcb4cb5be554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:54.087203 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1387/2779] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:54.096750 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723da405-cb26-4778-945e-091a21eebbc6 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:54.098128 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-723da405-cb26-4778-945e-091a21eebbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:54.106628 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-165c9c8e-9026-4c9c-933c-dcb4cb5be554 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:54.109187 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-165c9c8e-9026-4c9c-933c-dcb4cb5be554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:54.118129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1393/2780] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:40:54.122332 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c9c8e-9026-4c9c-933c-dcb4cb5be554 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:54.131744 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c9c8e-9026-4c9c-933c-dcb4cb5be554 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:54.136898 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cc5c9-8259-4add-bab5-c21a7fde6738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:54.137552 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cc5c9-8259-4add-bab5-c21a7fde6738 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:54.137834 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cc5c9-8259-4add-bab5-c21a7fde6738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:54.138112 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cc5c9-8259-4add-bab5-c21a7fde6738 admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:54.138844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cc5c9-8259-4add-bab5-c21a7fde6738 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:40:54.139152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cc5c9-8259-4add-bab5-c21a7fde6738 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:54.141018 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cc5c9-8259-4add-bab5-c21a7fde6738 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:54.156358 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1394/2781] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 06 23:40:54.157368 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cc5c9-8259-4add-bab5-c21a7fde6738 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:54.159165 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723da405-cb26-4778-945e-091a21eebbc6 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:54.163339 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bcdf2-69a7-43c6-9f06-61ad1eefdfe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:54.163977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bcdf2-69a7-43c6-9f06-61ad1eefdfe3 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:54.164263 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bcdf2-69a7-43c6-9f06-61ad1eefdfe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:54.164553 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bcdf2-69a7-43c6-9f06-61ad1eefdfe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:54.167116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cc5c9-8259-4add-bab5-c21a7fde6738 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:54.171697 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987d0d2-d093-4981-8654-5fa40b0e29d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:54.172311 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987d0d2-d093-4981-8654-5fa40b0e29d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:54.172631 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987d0d2-d093-4981-8654-5fa40b0e29d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:54.172904 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987d0d2-d093-4981-8654-5fa40b0e29d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:54.173587 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987d0d2-d093-4981-8654-5fa40b0e29d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:54.173712 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9bcdf2-69a7-43c6-9f06-61ad1eefdfe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:54.175050 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9bcdf2-69a7-43c6-9f06-61ad1eefdfe3 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:54.175458 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987d0d2-d093-4981-8654-5fa40b0e29d9 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:54.184890 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1388/2782] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:40:54.204568 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1395/2783] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:40:54 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:54.208272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bcdf2-69a7-43c6-9f06-61ad1eefdfe3 service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:54.217865 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bcdf2-69a7-43c6-9f06-61ad1eefdfe3 service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:54.278115 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b069d5-c93a-46b7-9143-ec9aef722ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:54.278798 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b069d5-c93a-46b7-9143-ec9aef722ffd admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:54.279085 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b069d5-c93a-46b7-9143-ec9aef722ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:54.279436 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b069d5-c93a-46b7-9143-ec9aef722ffd admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:54.280330 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b069d5-c93a-46b7-9143-ec9aef722ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:54.282454 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b069d5-c93a-46b7-9143-ec9aef722ffd admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:54.302709 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1389/2784] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:40:54 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:40:54.307142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987d0d2-d093-4981-8654-5fa40b0e29d9 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:54.322325 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987d0d2-d093-4981-8654-5fa40b0e29d9 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:54.330545 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e8bc2-271a-4636-af89-88dae38c333f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:54.331617 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e8bc2-271a-4636-af89-88dae38c333f admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:54.332712 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e8bc2-271a-4636-af89-88dae38c333f admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:54.332712 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e8bc2-271a-4636-af89-88dae38c333f admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:54.333300 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e8bc2-271a-4636-af89-88dae38c333f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:54.336190 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e8bc2-271a-4636-af89-88dae38c333f admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:54.348404 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1396/2785] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:54.352615 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b069d5-c93a-46b7-9143-ec9aef722ffd admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:54.362667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b069d5-c93a-46b7-9143-ec9aef722ffd admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:54.367362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c01cd5-2c52-47d3-8916-478d2bbdaa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:54.368006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c01cd5-2c52-47d3-8916-478d2bbdaa8c admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:54.368285 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c01cd5-2c52-47d3-8916-478d2bbdaa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:54.368582 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c01cd5-2c52-47d3-8916-478d2bbdaa8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:54.369313 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c01cd5-2c52-47d3-8916-478d2bbdaa8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:54.370906 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c01cd5-2c52-47d3-8916-478d2bbdaa8c admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:54.384176 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1390/2786] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:40:54.385745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e8bc2-271a-4636-af89-88dae38c333f admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:54.397707 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e8bc2-271a-4636-af89-88dae38c333f admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:54.402436 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9567e31-a103-4591-ac1e-538af49a21b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:54.403380 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9567e31-a103-4591-ac1e-538af49a21b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:54.403660 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9567e31-a103-4591-ac1e-538af49a21b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:54.403936 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9567e31-a103-4591-ac1e-538af49a21b4 admin admin] PATH_INFO: `/v3/projects/05d5998f1a2b486bbd9b3eb43dd365ff/users/a3c1aa5029c948639b8d6302eef4652f/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:54.419943 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9567e31-a103-4591-ac1e-538af49a21b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d5998f1a2b486bbd9b3eb43dd365ff, user_id=a3c1aa5029c948639b8d6302eef4652f, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:54.422906 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9567e31-a103-4591-ac1e-538af49a21b4 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:54.436778 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1397/2787] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:40:54 2022] PUT /identity/v3/projects/05d5998f1a2b486bbd9b3eb43dd365ff/users/a3c1aa5029c948639b8d6302eef4652f/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:54.447911 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b82d9a-559a-47ac-8a4c-bfe3f1d880b6 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:54.448414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b82d9a-559a-47ac-8a4c-bfe3f1d880b6 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:54.448561 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b82d9a-559a-47ac-8a4c-bfe3f1d880b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:54.461722 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9567e31-a103-4591-ac1e-538af49a21b4 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:54.463574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d9567e31-a103-4591-ac1e-538af49a21b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:54.479464 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-50b82d9a-559a-47ac-8a4c-bfe3f1d880b6 None None] MFA Rules not processed for user `a3c1aa5029c948639b8d6302eef4652f`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:40:54.480385 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-50b82d9a-559a-47ac-8a4c-bfe3f1d880b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:54.532871 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9567e31-a103-4591-ac1e-538af49a21b4 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:54.538183 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1b186-5061-4985-b861-ac82f123ea38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:54.539090 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b186-5061-4985-b861-ac82f123ea38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:54.539370 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b186-5061-4985-b861-ac82f123ea38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:54.539639 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b186-5061-4985-b861-ac82f123ea38 admin admin] PATH_INFO: `/v3/projects/6b83aed91da74983b1349757d298e1c2` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:54.540873 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1b186-5061-4985-b861-ac82f123ea38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b83aed91da74983b1349757d298e1c2)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:54.542784 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1b186-5061-4985-b861-ac82f123ea38 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:54.547578 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1391/2788] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:40:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:40:54.558747 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b82d9a-559a-47ac-8a4c-bfe3f1d880b6 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:54.560241 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-50b82d9a-559a-47ac-8a4c-bfe3f1d880b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:54.589908 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-a7a1b186-5061-4985-b861-ac82f123ea38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b83aed91da74983b1349757d298e1c2', 'request_id': 'req-a7a1b186-5061-4985-b861-ac82f123ea38'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:54.595911 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-a7a1b186-5061-4985-b861-ac82f123ea38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b83aed91da74983b1349757d298e1c2', 'request_id': 'req-a7a1b186-5061-4985-b861-ac82f123ea38'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:54.601241 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-a7a1b186-5061-4985-b861-ac82f123ea38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b83aed91da74983b1349757d298e1c2', 'request_id': 'req-a7a1b186-5061-4985-b861-ac82f123ea38'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:54.613735 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-a7a1b186-5061-4985-b861-ac82f123ea38 admin admin] The token cache is being invalidate because project 6b83aed91da74983b1349757d298e1c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:54.614022 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-a7a1b186-5061-4985-b861-ac82f123ea38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:54.615271 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-a7a1b186-5061-4985-b861-ac82f123ea38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:54.616932 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1398/2789] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:54 2022] DELETE /identity/v3/projects/6b83aed91da74983b1349757d298e1c2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:40:54.620725 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1b186-5061-4985-b861-ac82f123ea38 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:54.622021 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-a7a1b186-5061-4985-b861-ac82f123ea38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:54.623152 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b82d9a-559a-47ac-8a4c-bfe3f1d880b6 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:54.671169 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b6e68-032b-4c30-b170-38e5f31555ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a63ecc7210574058aad75a3114b57202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:54.671737 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b6e68-032b-4c30-b170-38e5f31555ba service glance] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:54.672070 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b6e68-032b-4c30-b170-38e5f31555ba service glance] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:54.672340 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b6e68-032b-4c30-b170-38e5f31555ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:54.674147 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-581b6e68-032b-4c30-b170-38e5f31555ba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:40:54.689293 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1b186-5061-4985-b861-ac82f123ea38 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:54.694705 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c0753-5f37-4b93-9ebe-b67b5b3bc08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:54.695566 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c0753-5f37-4b93-9ebe-b67b5b3bc08a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:54.695847 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c0753-5f37-4b93-9ebe-b67b5b3bc08a admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:54.696125 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c0753-5f37-4b93-9ebe-b67b5b3bc08a admin admin] PATH_INFO: `/v3/users/6b622d0aa5d14a6abe305020ecf60509` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:54.697343 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c0753-5f37-4b93-9ebe-b67b5b3bc08a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b622d0aa5d14a6abe305020ecf60509)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:54.699254 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c0753-5f37-4b93-9ebe-b67b5b3bc08a admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:54.734225 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b6e68-032b-4c30-b170-38e5f31555ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:54.735482 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b6e68-032b-4c30-b170-38e5f31555ba service glance] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:54.747126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1392/2790] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:40:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:40:54.755573 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ac7c0753-5f37-4b93-9ebe-b67b5b3bc08a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b622d0aa5d14a6abe305020ecf60509'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:54.762493 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ac7c0753-5f37-4b93-9ebe-b67b5b3bc08a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b622d0aa5d14a6abe305020ecf60509'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:54.763212 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ac7c0753-5f37-4b93-9ebe-b67b5b3bc08a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b622d0aa5d14a6abe305020ecf60509'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:54.770663 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ac7c0753-5f37-4b93-9ebe-b67b5b3bc08a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b622d0aa5d14a6abe305020ecf60509'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:54.771302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-ac7c0753-5f37-4b93-9ebe-b67b5b3bc08a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b622d0aa5d14a6abe305020ecf60509'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:54.793405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1399/2791] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:40:54 2022] DELETE /identity/v3/users/6b622d0aa5d14a6abe305020ecf60509 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:40:55.068521 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b6e68-032b-4c30-b170-38e5f31555ba service glance] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:40:55.091814 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b6e68-032b-4c30-b170-38e5f31555ba service glance] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:40:55.159562 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ba8a0-77c6-4dcf-ab97-b146ccc9e81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:40:55.160959 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ba8a0-77c6-4dcf-ab97-b146ccc9e81b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:40:55.161382 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ba8a0-77c6-4dcf-ab97-b146ccc9e81b admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:40:55.161907 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ba8a0-77c6-4dcf-ab97-b146ccc9e81b admin admin] PATH_INFO: `/v3/projects/f3281f2f9f3f4b7da04ffeaecb4fd4d3` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:40:55.164196 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ba8a0-77c6-4dcf-ab97-b146ccc9e81b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3281f2f9f3f4b7da04ffeaecb4fd4d3)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:40:55.167957 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ba8a0-77c6-4dcf-ab97-b146ccc9e81b admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:40:55.225851 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4f6ba8a0-77c6-4dcf-ab97-b146ccc9e81b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3281f2f9f3f4b7da04ffeaecb4fd4d3', 'request_id': 'req-4f6ba8a0-77c6-4dcf-ab97-b146ccc9e81b'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:55.233269 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4f6ba8a0-77c6-4dcf-ab97-b146ccc9e81b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3281f2f9f3f4b7da04ffeaecb4fd4d3', 'request_id': 'req-4f6ba8a0-77c6-4dcf-ab97-b146ccc9e81b'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:55.242308 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4f6ba8a0-77c6-4dcf-ab97-b146ccc9e81b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3281f2f9f3f4b7da04ffeaecb4fd4d3', 'request_id': 'req-4f6ba8a0-77c6-4dcf-ab97-b146ccc9e81b'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:55.255862 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4f6ba8a0-77c6-4dcf-ab97-b146ccc9e81b admin admin] The token cache is being invalidate because project f3281f2f9f3f4b7da04ffeaecb4fd4d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:40:55.256219 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4f6ba8a0-77c6-4dcf-ab97-b146ccc9e81b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:55.257182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-4f6ba8a0-77c6-4dcf-ab97-b146ccc9e81b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:40:55.264567 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1393/2792] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:40:55 2022] DELETE /identity/v3/projects/f3281f2f9f3f4b7da04ffeaecb4fd4d3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:41:19.663301 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c0753-5f37-4b93-9ebe-b67b5b3bc08a admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:19.664792 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-ac7c0753-5f37-4b93-9ebe-b67b5b3bc08a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:19.677575 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c0753-5f37-4b93-9ebe-b67b5b3bc08a admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:19.732609 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5e5df-d3cb-478b-ad2f-d5c4f8a8534d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:19.733471 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5e5df-d3cb-478b-ad2f-d5c4f8a8534d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:19.733753 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5e5df-d3cb-478b-ad2f-d5c4f8a8534d admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:19.734027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5e5df-d3cb-478b-ad2f-d5c4f8a8534d admin admin] PATH_INFO: `/v3/users/a3c1aa5029c948639b8d6302eef4652f` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:19.735195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5e5df-d3cb-478b-ad2f-d5c4f8a8534d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c1aa5029c948639b8d6302eef4652f)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:19.737152 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5e5df-d3cb-478b-ad2f-d5c4f8a8534d admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:19.780405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-62d5e5df-d3cb-478b-ad2f-d5c4f8a8534d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c1aa5029c948639b8d6302eef4652f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:19.786959 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-62d5e5df-d3cb-478b-ad2f-d5c4f8a8534d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c1aa5029c948639b8d6302eef4652f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:19.787681 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-62d5e5df-d3cb-478b-ad2f-d5c4f8a8534d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c1aa5029c948639b8d6302eef4652f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:19.794674 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-62d5e5df-d3cb-478b-ad2f-d5c4f8a8534d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c1aa5029c948639b8d6302eef4652f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:19.795285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-62d5e5df-d3cb-478b-ad2f-d5c4f8a8534d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c1aa5029c948639b8d6302eef4652f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:19.812513 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1400/2793] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:41:19 2022] DELETE /identity/v3/users/a3c1aa5029c948639b8d6302eef4652f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:41:19.817150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa1ba7-0af6-4ba1-8fe9-ddda6d4ba8dc None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:19.817658 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa1ba7-0af6-4ba1-8fe9-ddda6d4ba8dc None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:19.817763 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa1ba7-0af6-4ba1-8fe9-ddda6d4ba8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:19.835292 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-cdaa1ba7-0af6-4ba1-8fe9-ddda6d4ba8dc None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:41:19.836494 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-cdaa1ba7-0af6-4ba1-8fe9-ddda6d4ba8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:19.891679 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1394/2794] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:41:19.901406 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5e5df-d3cb-478b-ad2f-d5c4f8a8534d admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:19.902795 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-62d5e5df-d3cb-478b-ad2f-d5c4f8a8534d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:19.961460 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5e5df-d3cb-478b-ad2f-d5c4f8a8534d admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:19.965161 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531c286-2d8d-4c2b-9a25-3976164a68fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:19.965808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531c286-2d8d-4c2b-9a25-3976164a68fb service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:19.966081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531c286-2d8d-4c2b-9a25-3976164a68fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:19.966351 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531c286-2d8d-4c2b-9a25-3976164a68fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:19.975360 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531c286-2d8d-4c2b-9a25-3976164a68fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:19.976810 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531c286-2d8d-4c2b-9a25-3976164a68fb service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:19.986154 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1401/2795] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:41:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:41:20.248626 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa1ba7-0af6-4ba1-8fe9-ddda6d4ba8dc None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:20.250115 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-cdaa1ba7-0af6-4ba1-8fe9-ddda6d4ba8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:20.262094 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa1ba7-0af6-4ba1-8fe9-ddda6d4ba8dc None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:20.266954 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2ed60-cdc7-462c-b05d-28576bc3b81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:20.267891 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2ed60-cdc7-462c-b05d-28576bc3b81c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:20.268175 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2ed60-cdc7-462c-b05d-28576bc3b81c admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:20.268446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2ed60-cdc7-462c-b05d-28576bc3b81c admin admin] PATH_INFO: `/v3/projects/05d5998f1a2b486bbd9b3eb43dd365ff` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:20.269977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2ed60-cdc7-462c-b05d-28576bc3b81c admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d5998f1a2b486bbd9b3eb43dd365ff)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:20.272181 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2ed60-cdc7-462c-b05d-28576bc3b81c admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:20.324864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-31e2ed60-cdc7-462c-b05d-28576bc3b81c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d5998f1a2b486bbd9b3eb43dd365ff', 'request_id': 'req-31e2ed60-cdc7-462c-b05d-28576bc3b81c'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:20.334456 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-31e2ed60-cdc7-462c-b05d-28576bc3b81c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d5998f1a2b486bbd9b3eb43dd365ff', 'request_id': 'req-31e2ed60-cdc7-462c-b05d-28576bc3b81c'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:20.340298 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-31e2ed60-cdc7-462c-b05d-28576bc3b81c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d5998f1a2b486bbd9b3eb43dd365ff', 'request_id': 'req-31e2ed60-cdc7-462c-b05d-28576bc3b81c'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:20.353959 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-31e2ed60-cdc7-462c-b05d-28576bc3b81c admin admin] The token cache is being invalidate because project 05d5998f1a2b486bbd9b3eb43dd365ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:41:20.354256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-31e2ed60-cdc7-462c-b05d-28576bc3b81c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:20.354883 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-31e2ed60-cdc7-462c-b05d-28576bc3b81c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:20.356445 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1395/2796] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:41:20 2022] DELETE /identity/v3/projects/05d5998f1a2b486bbd9b3eb43dd365ff => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:41:20.361290 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db6f4a-6d9d-4e80-a1ee-66bbfc6dc819 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:20.361574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db6f4a-6d9d-4e80-a1ee-66bbfc6dc819 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:20.361850 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db6f4a-6d9d-4e80-a1ee-66bbfc6dc819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:20.379730 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-c6db6f4a-6d9d-4e80-a1ee-66bbfc6dc819 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:41:20.380944 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c6db6f4a-6d9d-4e80-a1ee-66bbfc6dc819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:20.438851 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1402/2797] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:41:20.446335 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7ec78-d627-4c7c-909d-81f3381ff49b None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:20.446609 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7ec78-d627-4c7c-909d-81f3381ff49b None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:20.446887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7ec78-d627-4c7c-909d-81f3381ff49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:20.464717 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-abf7ec78-d627-4c7c-909d-81f3381ff49b None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:41:20.465921 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-abf7ec78-d627-4c7c-909d-81f3381ff49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:20.473755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1396/2798] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:41:20.478410 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db6f4a-6d9d-4e80-a1ee-66bbfc6dc819 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:20.487651 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db6f4a-6d9d-4e80-a1ee-66bbfc6dc819 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:20.493184 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9608108-2a86-4b6e-8fcd-d9cc62cbdafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:20.493818 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9608108-2a86-4b6e-8fcd-d9cc62cbdafe admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:20.494094 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9608108-2a86-4b6e-8fcd-d9cc62cbdafe admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:20.494365 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9608108-2a86-4b6e-8fcd-d9cc62cbdafe admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:20.495081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9608108-2a86-4b6e-8fcd-d9cc62cbdafe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:41:20.495385 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9608108-2a86-4b6e-8fcd-d9cc62cbdafe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:20.497015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9608108-2a86-4b6e-8fcd-d9cc62cbdafe admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:20.508101 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1403/2799] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:41:20.512411 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7ec78-d627-4c7c-909d-81f3381ff49b None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:20.521448 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7ec78-d627-4c7c-909d-81f3381ff49b None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:20.526638 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a959bde-d211-4246-babd-1e80f69294b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:20.527273 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a959bde-d211-4246-babd-1e80f69294b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:20.527557 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a959bde-d211-4246-babd-1e80f69294b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:20.527836 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a959bde-d211-4246-babd-1e80f69294b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:20.528521 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a959bde-d211-4246-babd-1e80f69294b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:20.530461 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a959bde-d211-4246-babd-1e80f69294b7 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:20.556199 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1397/2800] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:41:20 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:41:20.560305 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9608108-2a86-4b6e-8fcd-d9cc62cbdafe admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:20.569999 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9608108-2a86-4b6e-8fcd-d9cc62cbdafe admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:20.625232 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb119d9-3419-449c-9e09-54f66be67a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:20.625893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb119d9-3419-449c-9e09-54f66be67a99 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:20.626169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb119d9-3419-449c-9e09-54f66be67a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:20.626441 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb119d9-3419-449c-9e09-54f66be67a99 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:20.627129 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb119d9-3419-449c-9e09-54f66be67a99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:20.629058 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb119d9-3419-449c-9e09-54f66be67a99 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:20.647521 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1404/2801] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:41:20 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:41:20.652189 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a959bde-d211-4246-babd-1e80f69294b7 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:20.662286 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a959bde-d211-4246-babd-1e80f69294b7 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:20.667480 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633739a-5aa9-4240-8e98-0fe03f52c279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:20.668133 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633739a-5aa9-4240-8e98-0fe03f52c279 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:20.668417 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633739a-5aa9-4240-8e98-0fe03f52c279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:20.668724 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633739a-5aa9-4240-8e98-0fe03f52c279 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:20.669458 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633739a-5aa9-4240-8e98-0fe03f52c279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:20.671058 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633739a-5aa9-4240-8e98-0fe03f52c279 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:20.682242 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1398/2802] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:41:20.686362 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb119d9-3419-449c-9e09-54f66be67a99 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:20.696673 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb119d9-3419-449c-9e09-54f66be67a99 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:20.702171 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86267f99-e873-4006-b3e5-4cf10f114d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:20.702812 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86267f99-e873-4006-b3e5-4cf10f114d3e admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:20.703091 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86267f99-e873-4006-b3e5-4cf10f114d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:20.703363 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86267f99-e873-4006-b3e5-4cf10f114d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:20.704083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86267f99-e873-4006-b3e5-4cf10f114d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:20.705699 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86267f99-e873-4006-b3e5-4cf10f114d3e admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:20.715982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1405/2803] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:41:20.720166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633739a-5aa9-4240-8e98-0fe03f52c279 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:20.731025 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633739a-5aa9-4240-8e98-0fe03f52c279 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:20.735639 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d32acb-299a-47b2-bb23-68f03028ef4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:20.736500 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d32acb-299a-47b2-bb23-68f03028ef4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:20.736812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d32acb-299a-47b2-bb23-68f03028ef4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:20.737090 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d32acb-299a-47b2-bb23-68f03028ef4e admin admin] PATH_INFO: `/v3/projects/a5f6ebe87b5245229810f67a32edac75/users/4a4ac98518794a709868daaea2f8d26b/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:20.751416 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d32acb-299a-47b2-bb23-68f03028ef4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f6ebe87b5245229810f67a32edac75, user_id=4a4ac98518794a709868daaea2f8d26b, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:20.754113 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d32acb-299a-47b2-bb23-68f03028ef4e admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:20.766495 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1399/2804] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:41:20 2022] PUT /identity/v3/projects/a5f6ebe87b5245229810f67a32edac75/users/4a4ac98518794a709868daaea2f8d26b/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:41:20.777315 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019f8ca-cb0b-4e73-9142-ae162bf22401 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:20.777603 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019f8ca-cb0b-4e73-9142-ae162bf22401 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:20.777882 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019f8ca-cb0b-4e73-9142-ae162bf22401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:20.803999 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-8019f8ca-cb0b-4e73-9142-ae162bf22401 None None] MFA Rules not processed for user `4a4ac98518794a709868daaea2f8d26b`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:41:20.805265 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-8019f8ca-cb0b-4e73-9142-ae162bf22401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:20.867424 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1406/2805] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:41:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:41:20.877999 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d32acb-299a-47b2-bb23-68f03028ef4e admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:20.879695 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-83d32acb-299a-47b2-bb23-68f03028ef4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:20.934385 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d32acb-299a-47b2-bb23-68f03028ef4e admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:20.938021 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d7db5-1978-4606-bf3c-45e1bc59a7be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:20.938656 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d7db5-1978-4606-bf3c-45e1bc59a7be service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:20.938940 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d7db5-1978-4606-bf3c-45e1bc59a7be service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:20.939216 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d7db5-1978-4606-bf3c-45e1bc59a7be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:20.947943 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d7db5-1978-4606-bf3c-45e1bc59a7be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:20.949338 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d7db5-1978-4606-bf3c-45e1bc59a7be service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:20.957921 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1400/2806] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:41:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:41:23.991723 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019f8ca-cb0b-4e73-9142-ae162bf22401 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:23.993776 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-8019f8ca-cb0b-4e73-9142-ae162bf22401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:24.014182 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019f8ca-cb0b-4e73-9142-ae162bf22401 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:24.018121 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324186e-3dbe-484f-9b8d-2a6f4e774c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:24.018862 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324186e-3dbe-484f-9b8d-2a6f4e774c3d service cinder] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:24.019236 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324186e-3dbe-484f-9b8d-2a6f4e774c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:24.019602 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324186e-3dbe-484f-9b8d-2a6f4e774c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:24.021606 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-0324186e-3dbe-484f-9b8d-2a6f4e774c3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:24.095133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324186e-3dbe-484f-9b8d-2a6f4e774c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:24.097265 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324186e-3dbe-484f-9b8d-2a6f4e774c3d service cinder] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:24.107676 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1407/2807] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:41:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:41:34.799408 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d7db5-1978-4606-bf3c-45e1bc59a7be service cinder] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:34.866142 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d7db5-1978-4606-bf3c-45e1bc59a7be service cinder] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:34.871146 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9eaab-7c1c-4eb0-a155-04524f2a6eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:34.871994 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9eaab-7c1c-4eb0-a155-04524f2a6eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:34.872274 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9eaab-7c1c-4eb0-a155-04524f2a6eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:34.872574 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9eaab-7c1c-4eb0-a155-04524f2a6eaf admin admin] PATH_INFO: `/v3/users/4a4ac98518794a709868daaea2f8d26b` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:34.874178 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9eaab-7c1c-4eb0-a155-04524f2a6eaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a4ac98518794a709868daaea2f8d26b)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:34.876092 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9eaab-7c1c-4eb0-a155-04524f2a6eaf admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:34.921667 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-91b9eaab-7c1c-4eb0-a155-04524f2a6eaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a4ac98518794a709868daaea2f8d26b'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:34.928006 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-91b9eaab-7c1c-4eb0-a155-04524f2a6eaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a4ac98518794a709868daaea2f8d26b'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:34.935504 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-91b9eaab-7c1c-4eb0-a155-04524f2a6eaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a4ac98518794a709868daaea2f8d26b'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:34.936108 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-91b9eaab-7c1c-4eb0-a155-04524f2a6eaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a4ac98518794a709868daaea2f8d26b'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:34.936743 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-91b9eaab-7c1c-4eb0-a155-04524f2a6eaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a4ac98518794a709868daaea2f8d26b'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:34.953619 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1401/2808] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:41:34 2022] DELETE /identity/v3/users/4a4ac98518794a709868daaea2f8d26b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:41:34.958169 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01360848-86d6-4dd1-88f9-8fdbec032364 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:34.958658 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01360848-86d6-4dd1-88f9-8fdbec032364 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:34.958769 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01360848-86d6-4dd1-88f9-8fdbec032364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:34.975863 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-01360848-86d6-4dd1-88f9-8fdbec032364 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:41:34.977098 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-01360848-86d6-4dd1-88f9-8fdbec032364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:35.034874 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1408/2809] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:41:35.044820 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9eaab-7c1c-4eb0-a155-04524f2a6eaf admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:35.046253 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-91b9eaab-7c1c-4eb0-a155-04524f2a6eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:35.106035 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9eaab-7c1c-4eb0-a155-04524f2a6eaf admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:35.117611 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f579-f653-455f-9bc6-7d1769e5e393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:35.118571 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f579-f653-455f-9bc6-7d1769e5e393 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:35.119040 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f579-f653-455f-9bc6-7d1769e5e393 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:35.119348 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f579-f653-455f-9bc6-7d1769e5e393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:35.131396 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053f579-f653-455f-9bc6-7d1769e5e393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:35.133116 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053f579-f653-455f-9bc6-7d1769e5e393 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:35.144248 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1402/2810] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:41:35.158916 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792860b5-e5cb-4ccb-9487-e18adeb22632 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:35.159228 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792860b5-e5cb-4ccb-9487-e18adeb22632 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:35.159616 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792860b5-e5cb-4ccb-9487-e18adeb22632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:35.178460 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-792860b5-e5cb-4ccb-9487-e18adeb22632 None None] MFA Rules not processed for user `a9fd4d50424a41d59ee31d65ec362058`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:41:35.180325 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-792860b5-e5cb-4ccb-9487-e18adeb22632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:35.241017 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1409/2811] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:41:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:41:35.570698 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f579-f653-455f-9bc6-7d1769e5e393 service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:35.572196 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-d053f579-f653-455f-9bc6-7d1769e5e393 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:35.586508 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f579-f653-455f-9bc6-7d1769e5e393 service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:35.592506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdc760-fcce-48ce-8634-505e81ad319a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:35.593460 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdc760-fcce-48ce-8634-505e81ad319a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:35.593742 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdc760-fcce-48ce-8634-505e81ad319a admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:35.594015 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdc760-fcce-48ce-8634-505e81ad319a admin admin] PATH_INFO: `/v3/projects/a5f6ebe87b5245229810f67a32edac75` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:35.595244 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdc760-fcce-48ce-8634-505e81ad319a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5f6ebe87b5245229810f67a32edac75)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:35.597248 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdc760-fcce-48ce-8634-505e81ad319a admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:35.645730 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6fbdc760-fcce-48ce-8634-505e81ad319a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5f6ebe87b5245229810f67a32edac75', 'request_id': 'req-6fbdc760-fcce-48ce-8634-505e81ad319a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:35.652425 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6fbdc760-fcce-48ce-8634-505e81ad319a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5f6ebe87b5245229810f67a32edac75', 'request_id': 'req-6fbdc760-fcce-48ce-8634-505e81ad319a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:35.657748 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6fbdc760-fcce-48ce-8634-505e81ad319a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5f6ebe87b5245229810f67a32edac75', 'request_id': 'req-6fbdc760-fcce-48ce-8634-505e81ad319a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:35.671225 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6fbdc760-fcce-48ce-8634-505e81ad319a admin admin] The token cache is being invalidate because project a5f6ebe87b5245229810f67a32edac75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:41:35.671512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6fbdc760-fcce-48ce-8634-505e81ad319a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:35.672126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-6fbdc760-fcce-48ce-8634-505e81ad319a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:35.673738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1403/2812] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:41:35 2022] DELETE /identity/v3/projects/a5f6ebe87b5245229810f67a32edac75 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:41:35.678691 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771226a-3cbb-4628-af22-d86eb118e5aa None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:35.678984 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771226a-3cbb-4628-af22-d86eb118e5aa None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:35.679346 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771226a-3cbb-4628-af22-d86eb118e5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:35.697311 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-1771226a-3cbb-4628-af22-d86eb118e5aa None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:41:35.698515 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-1771226a-3cbb-4628-af22-d86eb118e5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:35.764625 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1410/2813] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:41:35.773828 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c3b75-c8d7-41cd-9f40-2ed0d40fcc5f None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:35.774114 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c3b75-c8d7-41cd-9f40-2ed0d40fcc5f None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:35.774393 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c3b75-c8d7-41cd-9f40-2ed0d40fcc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:35.792678 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-ea8c3b75-c8d7-41cd-9f40-2ed0d40fcc5f None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:41:35.793876 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-ea8c3b75-c8d7-41cd-9f40-2ed0d40fcc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:35.801925 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1404/2814] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:41:35.806125 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771226a-3cbb-4628-af22-d86eb118e5aa None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:35.816269 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771226a-3cbb-4628-af22-d86eb118e5aa None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:35.820836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06960b86-6ec5-47d9-af60-9e39d2fde597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:35.821564 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06960b86-6ec5-47d9-af60-9e39d2fde597 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:35.821907 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06960b86-6ec5-47d9-af60-9e39d2fde597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:35.822242 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06960b86-6ec5-47d9-af60-9e39d2fde597 admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:35.823026 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06960b86-6ec5-47d9-af60-9e39d2fde597 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:41:35.823397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06960b86-6ec5-47d9-af60-9e39d2fde597 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:35.825023 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06960b86-6ec5-47d9-af60-9e39d2fde597 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:35.842737 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1411/2815] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:41:35.844051 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c3b75-c8d7-41cd-9f40-2ed0d40fcc5f None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:35.856475 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c3b75-c8d7-41cd-9f40-2ed0d40fcc5f None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:35.861332 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4759de-f0cd-4e70-bddf-8be383d30294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:35.861986 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4759de-f0cd-4e70-bddf-8be383d30294 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:35.862267 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4759de-f0cd-4e70-bddf-8be383d30294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:35.862542 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4759de-f0cd-4e70-bddf-8be383d30294 admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:35.863230 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4759de-f0cd-4e70-bddf-8be383d30294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:35.865186 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4759de-f0cd-4e70-bddf-8be383d30294 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:35.892609 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1405/2816] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:41:35 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:41:35.895608 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06960b86-6ec5-47d9-af60-9e39d2fde597 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:35.906255 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06960b86-6ec5-47d9-af60-9e39d2fde597 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:35.965838 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ee929-ac45-4a87-a83b-6389fa687599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:35.966512 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ee929-ac45-4a87-a83b-6389fa687599 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:35.966795 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ee929-ac45-4a87-a83b-6389fa687599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:35.967108 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ee929-ac45-4a87-a83b-6389fa687599 admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:35.967865 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ee929-ac45-4a87-a83b-6389fa687599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:35.969707 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ee929-ac45-4a87-a83b-6389fa687599 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:35.990187 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1412/2817] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:41:35 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:41:35.994608 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4759de-f0cd-4e70-bddf-8be383d30294 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:36.005189 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4759de-f0cd-4e70-bddf-8be383d30294 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:36.010450 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54dd9f-4f63-4eea-865b-20bea48ed599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:36.011192 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54dd9f-4f63-4eea-865b-20bea48ed599 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:36.011573 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54dd9f-4f63-4eea-865b-20bea48ed599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:36.011913 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54dd9f-4f63-4eea-865b-20bea48ed599 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:36.012738 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54dd9f-4f63-4eea-865b-20bea48ed599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:36.014392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54dd9f-4f63-4eea-865b-20bea48ed599 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:36.028864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1406/2818] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:41:36.030069 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ee929-ac45-4a87-a83b-6389fa687599 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:36.040133 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ee929-ac45-4a87-a83b-6389fa687599 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:36.044876 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fbcd5-66fc-4f61-8e6c-9585ec80a640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:36.045528 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fbcd5-66fc-4f61-8e6c-9585ec80a640 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:36.045808 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fbcd5-66fc-4f61-8e6c-9585ec80a640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:36.046088 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fbcd5-66fc-4f61-8e6c-9585ec80a640 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:36.046813 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fbcd5-66fc-4f61-8e6c-9585ec80a640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:36.048648 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fbcd5-66fc-4f61-8e6c-9585ec80a640 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:36.062302 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1413/2819] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:41:36.063586 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54dd9f-4f63-4eea-865b-20bea48ed599 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:36.073989 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54dd9f-4f63-4eea-865b-20bea48ed599 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:36.078803 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8b0e1-2d0c-4be5-82c2-6083ca4dab73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:36.079681 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8b0e1-2d0c-4be5-82c2-6083ca4dab73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:36.079958 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8b0e1-2d0c-4be5-82c2-6083ca4dab73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:36.080229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8b0e1-2d0c-4be5-82c2-6083ca4dab73 admin admin] PATH_INFO: `/v3/projects/a070d338994544e69e6c211e7674f1a6/users/b9fee7956a764e8da1b2cad5cddcd74f/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:36.096301 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8b0e1-2d0c-4be5-82c2-6083ca4dab73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a070d338994544e69e6c211e7674f1a6, user_id=b9fee7956a764e8da1b2cad5cddcd74f, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:36.098984 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8b0e1-2d0c-4be5-82c2-6083ca4dab73 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:36.111172 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1407/2820] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:41:36 2022] PUT /identity/v3/projects/a070d338994544e69e6c211e7674f1a6/users/b9fee7956a764e8da1b2cad5cddcd74f/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:41:36.121397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0f7fa-ffca-4145-a750-93568241f646 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:36.121691 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0f7fa-ffca-4145-a750-93568241f646 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:36.122016 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0f7fa-ffca-4145-a750-93568241f646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:36.147895 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-93c0f7fa-ffca-4145-a750-93568241f646 None None] MFA Rules not processed for user `b9fee7956a764e8da1b2cad5cddcd74f`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:41:36.149715 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-93c0f7fa-ffca-4145-a750-93568241f646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:36.210454 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1414/2821] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:41:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:41:36.221798 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8b0e1-2d0c-4be5-82c2-6083ca4dab73 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:36.223489 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-34b8b0e1-2d0c-4be5-82c2-6083ca4dab73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:36.279177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8b0e1-2d0c-4be5-82c2-6083ca4dab73 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:36.282785 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a28ca-33a1-4995-85fc-75bc066413ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:36.283419 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a28ca-33a1-4995-85fc-75bc066413ff service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:36.283702 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a28ca-33a1-4995-85fc-75bc066413ff service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:36.283981 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a28ca-33a1-4995-85fc-75bc066413ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:36.292308 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a28ca-33a1-4995-85fc-75bc066413ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:36.293780 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a28ca-33a1-4995-85fc-75bc066413ff service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:36.302293 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1408/2822] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:41:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:41:39.480314 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0f7fa-ffca-4145-a750-93568241f646 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:39.481711 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-93c0f7fa-ffca-4145-a750-93568241f646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:39.548970 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0f7fa-ffca-4145-a750-93568241f646 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:39.553731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1916d2-497a-41fe-80d4-a8cc6d9f0d8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1f7704fb5644688b8764bb1ce15734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:39.556870 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1916d2-497a-41fe-80d4-a8cc6d9f0d8a service placement] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:39.557151 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1916d2-497a-41fe-80d4-a8cc6d9f0d8a service placement] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:39.557420 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1916d2-497a-41fe-80d4-a8cc6d9f0d8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:39.559196 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-3b1916d2-497a-41fe-80d4-a8cc6d9f0d8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:39.571445 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1916d2-497a-41fe-80d4-a8cc6d9f0d8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:39.573064 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1916d2-497a-41fe-80d4-a8cc6d9f0d8a service placement] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:39.583536 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1415/2823] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:41:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:41:40.678432 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c1453-e11b-4387-a097-024a1e0aeeec None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:40.678991 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c1453-e11b-4387-a097-024a1e0aeeec None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:40.679206 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c1453-e11b-4387-a097-024a1e0aeeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:40.697803 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-fb0c1453-e11b-4387-a097-024a1e0aeeec None None] MFA Rules not processed for user `4404cebe9b304ede809878dfb26d5e66`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:41:40.699157 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-fb0c1453-e11b-4387-a097-024a1e0aeeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:40.778317 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1409/2824] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:41:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:41:58.891734 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1916d2-497a-41fe-80d4-a8cc6d9f0d8a service placement] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:58.952690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1916d2-497a-41fe-80d4-a8cc6d9f0d8a service placement] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:58.957314 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e44265-3074-4995-bc1b-ddd5b17fd7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:58.958184 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e44265-3074-4995-bc1b-ddd5b17fd7a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:58.958468 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e44265-3074-4995-bc1b-ddd5b17fd7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:58.958745 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e44265-3074-4995-bc1b-ddd5b17fd7a3 admin admin] PATH_INFO: `/v3/users/b9fee7956a764e8da1b2cad5cddcd74f` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:58.959942 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e44265-3074-4995-bc1b-ddd5b17fd7a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9fee7956a764e8da1b2cad5cddcd74f)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:58.962543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e44265-3074-4995-bc1b-ddd5b17fd7a3 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:59.007408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-51e44265-3074-4995-bc1b-ddd5b17fd7a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9fee7956a764e8da1b2cad5cddcd74f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:59.014579 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-51e44265-3074-4995-bc1b-ddd5b17fd7a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9fee7956a764e8da1b2cad5cddcd74f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:59.015667 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-51e44265-3074-4995-bc1b-ddd5b17fd7a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9fee7956a764e8da1b2cad5cddcd74f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:59.024947 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-51e44265-3074-4995-bc1b-ddd5b17fd7a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9fee7956a764e8da1b2cad5cddcd74f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:59.025865 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-51e44265-3074-4995-bc1b-ddd5b17fd7a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9fee7956a764e8da1b2cad5cddcd74f'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:59.044170 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1416/2825] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:41:58 2022] DELETE /identity/v3/users/b9fee7956a764e8da1b2cad5cddcd74f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:41:59.048552 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b9239-2c1e-497d-9b34-c56c22e39b2c None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:59.049082 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b9239-2c1e-497d-9b34-c56c22e39b2c None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:59.049302 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b9239-2c1e-497d-9b34-c56c22e39b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:59.066140 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-a30b9239-2c1e-497d-9b34-c56c22e39b2c None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:41:59.067324 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-a30b9239-2c1e-497d-9b34-c56c22e39b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:59.134265 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1410/2826] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:41:59.143870 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e44265-3074-4995-bc1b-ddd5b17fd7a3 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:59.145285 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-51e44265-3074-4995-bc1b-ddd5b17fd7a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:59.200974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e44265-3074-4995-bc1b-ddd5b17fd7a3 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:59.204618 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bde65-5ef8-44c4-a0dc-2bfc5686bf57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:59.205262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bde65-5ef8-44c4-a0dc-2bfc5686bf57 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:59.205543 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bde65-5ef8-44c4-a0dc-2bfc5686bf57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:59.205818 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bde65-5ef8-44c4-a0dc-2bfc5686bf57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:59.215181 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9bde65-5ef8-44c4-a0dc-2bfc5686bf57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:59.216644 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9bde65-5ef8-44c4-a0dc-2bfc5686bf57 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:59.226002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1417/2827] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:41:59.553584 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b9239-2c1e-497d-9b34-c56c22e39b2c None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:59.555675 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-a30b9239-2c1e-497d-9b34-c56c22e39b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:59.567626 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b9239-2c1e-497d-9b34-c56c22e39b2c None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:59.573120 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4431e-df8a-4bd5-984f-ed60dbc64345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:59.573978 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4431e-df8a-4bd5-984f-ed60dbc64345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:59.574255 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4431e-df8a-4bd5-984f-ed60dbc64345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:59.574782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4431e-df8a-4bd5-984f-ed60dbc64345 admin admin] PATH_INFO: `/v3/projects/a070d338994544e69e6c211e7674f1a6` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:59.575997 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4431e-df8a-4bd5-984f-ed60dbc64345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a070d338994544e69e6c211e7674f1a6)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:59.579271 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4431e-df8a-4bd5-984f-ed60dbc64345 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:59.627188 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-79b4431e-df8a-4bd5-984f-ed60dbc64345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a070d338994544e69e6c211e7674f1a6', 'request_id': 'req-79b4431e-df8a-4bd5-984f-ed60dbc64345'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:59.633632 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-79b4431e-df8a-4bd5-984f-ed60dbc64345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a070d338994544e69e6c211e7674f1a6', 'request_id': 'req-79b4431e-df8a-4bd5-984f-ed60dbc64345'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:59.638937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-79b4431e-df8a-4bd5-984f-ed60dbc64345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a070d338994544e69e6c211e7674f1a6', 'request_id': 'req-79b4431e-df8a-4bd5-984f-ed60dbc64345'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:59.650803 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-79b4431e-df8a-4bd5-984f-ed60dbc64345 admin admin] The token cache is being invalidate because project a070d338994544e69e6c211e7674f1a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:41:59.651087 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-79b4431e-df8a-4bd5-984f-ed60dbc64345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:59.651684 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-79b4431e-df8a-4bd5-984f-ed60dbc64345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:41:59.653243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1411/2828] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:41:59 2022] DELETE /identity/v3/projects/a070d338994544e69e6c211e7674f1a6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:41:59.658097 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039cf82-3a60-4c32-81ac-4ca084c89acb None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:59.658387 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039cf82-3a60-4c32-81ac-4ca084c89acb None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:59.658665 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039cf82-3a60-4c32-81ac-4ca084c89acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:59.676081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-b039cf82-3a60-4c32-81ac-4ca084c89acb None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:41:59.677298 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b039cf82-3a60-4c32-81ac-4ca084c89acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:59.733800 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1418/2829] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:41:59.743290 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cf472-f34d-40b3-a0ec-55cb4facdab1 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:59.743586 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cf472-f34d-40b3-a0ec-55cb4facdab1 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:59.743864 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cf472-f34d-40b3-a0ec-55cb4facdab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:59.762652 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-926cf472-f34d-40b3-a0ec-55cb4facdab1 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:41:59.763855 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-926cf472-f34d-40b3-a0ec-55cb4facdab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:41:59.772166 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1412/2830] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:41:59.776231 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039cf82-3a60-4c32-81ac-4ca084c89acb None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:59.791981 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039cf82-3a60-4c32-81ac-4ca084c89acb None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:59.798369 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6a823-b84f-4e22-a5ed-3b7981eae0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:59.799036 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6a823-b84f-4e22-a5ed-3b7981eae0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:59.799329 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6a823-b84f-4e22-a5ed-3b7981eae0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:59.799600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6a823-b84f-4e22-a5ed-3b7981eae0e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:59.800328 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6a823-b84f-4e22-a5ed-3b7981eae0e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:41:59.800661 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6a823-b84f-4e22-a5ed-3b7981eae0e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:59.802248 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6a823-b84f-4e22-a5ed-3b7981eae0e8 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:59.814337 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1419/2831] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:41:59.818693 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cf472-f34d-40b3-a0ec-55cb4facdab1 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:59.829937 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cf472-f34d-40b3-a0ec-55cb4facdab1 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:59.834871 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cae461-aa6f-4efb-a879-aa9d7b5f906c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:59.835636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cae461-aa6f-4efb-a879-aa9d7b5f906c admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:59.835950 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cae461-aa6f-4efb-a879-aa9d7b5f906c admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:59.836247 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cae461-aa6f-4efb-a879-aa9d7b5f906c admin admin] PATH_INFO: `/v3/projects` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:59.836989 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cae461-aa6f-4efb-a879-aa9d7b5f906c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:59.839429 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cae461-aa6f-4efb-a879-aa9d7b5f906c admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:59.866390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1413/2832] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:41:59 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:41:59.870929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6a823-b84f-4e22-a5ed-3b7981eae0e8 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:59.880663 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6a823-b84f-4e22-a5ed-3b7981eae0e8 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:59.933787 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad9501-6d40-4f01-8fe0-34181015a6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:59.934438 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad9501-6d40-4f01-8fe0-34181015a6ce admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:59.934717 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad9501-6d40-4f01-8fe0-34181015a6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:59.934992 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad9501-6d40-4f01-8fe0-34181015a6ce admin admin] PATH_INFO: `/v3/users` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:59.935688 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad9501-6d40-4f01-8fe0-34181015a6ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:59.937643 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad9501-6d40-4f01-8fe0-34181015a6ce admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:59.956425 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1420/2833] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:41:59 2022] POST /identity/v3/users => generated 299 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:41:59.960576 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cae461-aa6f-4efb-a879-aa9d7b5f906c admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:41:59.970919 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cae461-aa6f-4efb-a879-aa9d7b5f906c admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:41:59.975690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68d1a0-5672-427d-a193-4277a4bce5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:41:59.976340 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68d1a0-5672-427d-a193-4277a4bce5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:41:59.977159 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68d1a0-5672-427d-a193-4277a4bce5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:41:59.977438 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68d1a0-5672-427d-a193-4277a4bce5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:41:59.978412 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68d1a0-5672-427d-a193-4277a4bce5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:41:59.980062 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68d1a0-5672-427d-a193-4277a4bce5a7 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:41:59.990444 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1414/2834] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:41:59.995118 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad9501-6d40-4f01-8fe0-34181015a6ce admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:00.005324 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad9501-6d40-4f01-8fe0-34181015a6ce admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:00.010095 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8d10a-9b3a-4677-883e-7d1efc132375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:00.010752 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8d10a-9b3a-4677-883e-7d1efc132375 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:00.011034 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8d10a-9b3a-4677-883e-7d1efc132375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:00.011310 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8d10a-9b3a-4677-883e-7d1efc132375 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:00.012042 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8d10a-9b3a-4677-883e-7d1efc132375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:00.013680 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8d10a-9b3a-4677-883e-7d1efc132375 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:00.023729 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1421/2835] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 06 23:42:00.027880 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68d1a0-5672-427d-a193-4277a4bce5a7 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:00.037863 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68d1a0-5672-427d-a193-4277a4bce5a7 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:00.042904 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bb702-9836-4e32-b996-c0daf2d5b9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:00.043763 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bb702-9836-4e32-b996-c0daf2d5b9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:00.044041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bb702-9836-4e32-b996-c0daf2d5b9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:00.044341 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bb702-9836-4e32-b996-c0daf2d5b9e4 admin admin] PATH_INFO: `/v3/projects/60b177eeebca43b495c799284d963bd3/users/341d3a47f26f4bdf9d053950f6f1e78f/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:00.058808 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bb702-9836-4e32-b996-c0daf2d5b9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b177eeebca43b495c799284d963bd3, user_id=341d3a47f26f4bdf9d053950f6f1e78f, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:00.061512 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bb702-9836-4e32-b996-c0daf2d5b9e4 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:00.074097 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1415/2836] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:42:00 2022] PUT /identity/v3/projects/60b177eeebca43b495c799284d963bd3/users/341d3a47f26f4bdf9d053950f6f1e78f/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:42:00.084311 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff6141-6dd5-4acb-83b8-297d31d14552 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:00.084667 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff6141-6dd5-4acb-83b8-297d31d14552 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:00.084982 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff6141-6dd5-4acb-83b8-297d31d14552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:00.114223 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-b3ff6141-6dd5-4acb-83b8-297d31d14552 None None] MFA Rules not processed for user `341d3a47f26f4bdf9d053950f6f1e78f`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:42:00.115487 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b3ff6141-6dd5-4acb-83b8-297d31d14552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:42:00.178774 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1422/2837] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:42:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:42:00.190530 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bb702-9836-4e32-b996-c0daf2d5b9e4 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:00.192187 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-4a4bb702-9836-4e32-b996-c0daf2d5b9e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:42:00.247720 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bb702-9836-4e32-b996-c0daf2d5b9e4 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:00.251414 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6dd33-0944-417c-af76-6d2cdcb0f13e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d2df2ca106409995e139652ee995e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:00.252040 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6dd33-0944-417c-af76-6d2cdcb0f13e service cinder] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:00.252317 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6dd33-0944-417c-af76-6d2cdcb0f13e service cinder] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:00.252613 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6dd33-0944-417c-af76-6d2cdcb0f13e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:00.260523 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6dd33-0944-417c-af76-6d2cdcb0f13e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:00.261967 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6dd33-0944-417c-af76-6d2cdcb0f13e service cinder] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:00.270419 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1416/2838] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:42:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:42:00.950769 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff6141-6dd5-4acb-83b8-297d31d14552 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:00.952157 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-b3ff6141-6dd5-4acb-83b8-297d31d14552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:42:01.007053 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff6141-6dd5-4acb-83b8-297d31d14552 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:01.013326 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd14b7c-c982-4364-8cb2-7678951e79aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:01.013967 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd14b7c-c982-4364-8cb2-7678951e79aa service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:01.014245 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd14b7c-c982-4364-8cb2-7678951e79aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:01.014570 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd14b7c-c982-4364-8cb2-7678951e79aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:01.017018 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-8dd14b7c-c982-4364-8cb2-7678951e79aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:42:01.077050 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd14b7c-c982-4364-8cb2-7678951e79aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:01.078475 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd14b7c-c982-4364-8cb2-7678951e79aa service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:01.088590 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1423/2839] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:42:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:42:11.419600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6dd33-0944-417c-af76-6d2cdcb0f13e service cinder] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:11.477420 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6dd33-0944-417c-af76-6d2cdcb0f13e service cinder] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:11.482698 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4263d25-7c1d-469d-aaec-34360b444147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:11.483538 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4263d25-7c1d-469d-aaec-34360b444147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:11.483812 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4263d25-7c1d-469d-aaec-34360b444147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:11.484084 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4263d25-7c1d-469d-aaec-34360b444147 admin admin] PATH_INFO: `/v3/users/341d3a47f26f4bdf9d053950f6f1e78f` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:11.485258 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4263d25-7c1d-469d-aaec-34360b444147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=341d3a47f26f4bdf9d053950f6f1e78f)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:11.487181 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4263d25-7c1d-469d-aaec-34360b444147 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:11.529464 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c4263d25-7c1d-469d-aaec-34360b444147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '341d3a47f26f4bdf9d053950f6f1e78f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:42:11.535945 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c4263d25-7c1d-469d-aaec-34360b444147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '341d3a47f26f4bdf9d053950f6f1e78f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:42:11.543195 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c4263d25-7c1d-469d-aaec-34360b444147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '341d3a47f26f4bdf9d053950f6f1e78f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:42:11.543947 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c4263d25-7c1d-469d-aaec-34360b444147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '341d3a47f26f4bdf9d053950f6f1e78f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:42:11.544680 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c4263d25-7c1d-469d-aaec-34360b444147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '341d3a47f26f4bdf9d053950f6f1e78f'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:42:11.560897 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1417/2840] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:42:11 2022] DELETE /identity/v3/users/341d3a47f26f4bdf9d053950f6f1e78f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:42:11.565397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca26a7-a7ea-46a9-8995-a7d1a1b72e8a None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:11.565891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca26a7-a7ea-46a9-8995-a7d1a1b72e8a None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:11.565998 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca26a7-a7ea-46a9-8995-a7d1a1b72e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:11.582819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-30ca26a7-a7ea-46a9-8995-a7d1a1b72e8a None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:42:11.584002 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-30ca26a7-a7ea-46a9-8995-a7d1a1b72e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:42:11.639976 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1424/2841] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:42:11.649983 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4263d25-7c1d-469d-aaec-34360b444147 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:11.651309 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c4263d25-7c1d-469d-aaec-34360b444147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:42:11.707578 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4263d25-7c1d-469d-aaec-34360b444147 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:11.711297 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07ccaf-e9dd-4ad5-9bba-cbf2a41c046a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:11.712470 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07ccaf-e9dd-4ad5-9bba-cbf2a41c046a service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:11.712787 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07ccaf-e9dd-4ad5-9bba-cbf2a41c046a service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:11.713065 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07ccaf-e9dd-4ad5-9bba-cbf2a41c046a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:11.721887 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07ccaf-e9dd-4ad5-9bba-cbf2a41c046a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:11.723325 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07ccaf-e9dd-4ad5-9bba-cbf2a41c046a service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:11.733445 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1418/2842] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:42:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 06 23:42:11.983096 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca26a7-a7ea-46a9-8995-a7d1a1b72e8a None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:11.984515 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-30ca26a7-a7ea-46a9-8995-a7d1a1b72e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:42:11.997578 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca26a7-a7ea-46a9-8995-a7d1a1b72e8a None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:12.002123 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6506d-5265-4c7a-b8e2-7f03efff1cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:12.002972 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6506d-5265-4c7a-b8e2-7f03efff1cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:12.003250 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6506d-5265-4c7a-b8e2-7f03efff1cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:12.004122 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6506d-5265-4c7a-b8e2-7f03efff1cdc admin admin] PATH_INFO: `/v3/projects/60b177eeebca43b495c799284d963bd3` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:12.005507 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6506d-5265-4c7a-b8e2-7f03efff1cdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=60b177eeebca43b495c799284d963bd3)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:12.007408 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6506d-5265-4c7a-b8e2-7f03efff1cdc admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:12.052844 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-4ce6506d-5265-4c7a-b8e2-7f03efff1cdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60b177eeebca43b495c799284d963bd3', 'request_id': 'req-4ce6506d-5265-4c7a-b8e2-7f03efff1cdc'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:42:12.059965 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-4ce6506d-5265-4c7a-b8e2-7f03efff1cdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60b177eeebca43b495c799284d963bd3', 'request_id': 'req-4ce6506d-5265-4c7a-b8e2-7f03efff1cdc'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:42:12.065414 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-4ce6506d-5265-4c7a-b8e2-7f03efff1cdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60b177eeebca43b495c799284d963bd3', 'request_id': 'req-4ce6506d-5265-4c7a-b8e2-7f03efff1cdc'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:42:12.077316 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-4ce6506d-5265-4c7a-b8e2-7f03efff1cdc admin admin] The token cache is being invalidate because project 60b177eeebca43b495c799284d963bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:42:12.077600 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-4ce6506d-5265-4c7a-b8e2-7f03efff1cdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:42:12.078212 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-4ce6506d-5265-4c7a-b8e2-7f03efff1cdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:42:12.079748 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1425/2843] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:42:11 2022] DELETE /identity/v3/projects/60b177eeebca43b495c799284d963bd3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:42:12.084978 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af98b40-f418-4cd9-b704-ff43b29f27a5 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:12.085263 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af98b40-f418-4cd9-b704-ff43b29f27a5 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:12.085537 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af98b40-f418-4cd9-b704-ff43b29f27a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:12.103477 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-4af98b40-f418-4cd9-b704-ff43b29f27a5 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:42:12.104690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-4af98b40-f418-4cd9-b704-ff43b29f27a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:42:12.160872 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1419/2844] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:42:12.168739 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0616d4a-2a39-49d6-b6bb-8d2114a4091c None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:12.169025 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0616d4a-2a39-49d6-b6bb-8d2114a4091c None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:12.169300 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0616d4a-2a39-49d6-b6bb-8d2114a4091c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:12.187588 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-d0616d4a-2a39-49d6-b6bb-8d2114a4091c None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:42:12.188836 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-d0616d4a-2a39-49d6-b6bb-8d2114a4091c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:42:12.197511 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1426/2845] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:42:12.201655 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af98b40-f418-4cd9-b704-ff43b29f27a5 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:12.211164 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af98b40-f418-4cd9-b704-ff43b29f27a5 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:12.215722 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b3300-968a-45a4-af67-7cd5aa0543fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:12.216362 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b3300-968a-45a4-af67-7cd5aa0543fe admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:12.216683 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b3300-968a-45a4-af67-7cd5aa0543fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:12.216958 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b3300-968a-45a4-af67-7cd5aa0543fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:12.217671 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b3300-968a-45a4-af67-7cd5aa0543fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 06 23:42:12.217977 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b3300-968a-45a4-af67-7cd5aa0543fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:12.219604 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b3300-968a-45a4-af67-7cd5aa0543fe admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:12.230929 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1420/2846] 10.222.0.60 () {58 vars in 1152 bytes} [Fri May 6 23:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 06 23:42:12.235062 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0616d4a-2a39-49d6-b6bb-8d2114a4091c None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:12.244549 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0616d4a-2a39-49d6-b6bb-8d2114a4091c None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:12.249156 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade13b83-60d5-40d7-a6aa-188df0027679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:12.249784 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade13b83-60d5-40d7-a6aa-188df0027679 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:12.250066 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade13b83-60d5-40d7-a6aa-188df0027679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:12.250336 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade13b83-60d5-40d7-a6aa-188df0027679 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:12.251028 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade13b83-60d5-40d7-a6aa-188df0027679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:12.252950 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade13b83-60d5-40d7-a6aa-188df0027679 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:12.280420 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1427/2847] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:42:12 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:42:12.281482 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b3300-968a-45a4-af67-7cd5aa0543fe admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:12.291203 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b3300-968a-45a4-af67-7cd5aa0543fe admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:12.347959 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5a176-035c-4c1f-a7c0-663e4b14ec01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:12.348669 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5a176-035c-4c1f-a7c0-663e4b14ec01 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:12.348951 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5a176-035c-4c1f-a7c0-663e4b14ec01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:12.349218 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5a176-035c-4c1f-a7c0-663e4b14ec01 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:12.349892 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5a176-035c-4c1f-a7c0-663e4b14ec01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:12.351796 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5a176-035c-4c1f-a7c0-663e4b14ec01 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:12.375760 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1421/2848] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:42:12 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 06 23:42:12.380048 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade13b83-60d5-40d7-a6aa-188df0027679 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:12.390919 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade13b83-60d5-40d7-a6aa-188df0027679 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:12.395537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1c384-13ca-4af6-a5eb-fbdcc693f503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:12.396185 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1c384-13ca-4af6-a5eb-fbdcc693f503 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:12.396469 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1c384-13ca-4af6-a5eb-fbdcc693f503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:12.396781 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1c384-13ca-4af6-a5eb-fbdcc693f503 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:12.397537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1c384-13ca-4af6-a5eb-fbdcc693f503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:12.399136 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1c384-13ca-4af6-a5eb-fbdcc693f503 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:12.409274 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1428/2849] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:42:12.413211 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5a176-035c-4c1f-a7c0-663e4b14ec01 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:12.423764 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5a176-035c-4c1f-a7c0-663e4b14ec01 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:12.428461 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104e4d8-7d9a-4749-afb5-8b99f2b02f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:12.429147 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104e4d8-7d9a-4749-afb5-8b99f2b02f62 admin admin] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:12.429431 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104e4d8-7d9a-4749-afb5-8b99f2b02f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:12.429733 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104e4d8-7d9a-4749-afb5-8b99f2b02f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:12.430464 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104e4d8-7d9a-4749-afb5-8b99f2b02f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:12.432586 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104e4d8-7d9a-4749-afb5-8b99f2b02f62 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:12.442198 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1422/2850] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:42:12.447222 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1c384-13ca-4af6-a5eb-fbdcc693f503 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:12.457501 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1c384-13ca-4af6-a5eb-fbdcc693f503 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:12.462106 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a5377-c2e7-4afa-a3da-33b4e71b7b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:12.462969 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a5377-c2e7-4afa-a3da-33b4e71b7b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:12.463246 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a5377-c2e7-4afa-a3da-33b4e71b7b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:12.463517 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a5377-c2e7-4afa-a3da-33b4e71b7b6f admin admin] PATH_INFO: `/v3/projects/35b2ce1dc11d445c806fd9d3bb291860/users/ad71b55c70de4d7f9cb7c20089461573/roles/4bc18e5c60c043ae8d42db9c4e9cd438` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:12.477414 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a5377-c2e7-4afa-a3da-33b4e71b7b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b2ce1dc11d445c806fd9d3bb291860, user_id=ad71b55c70de4d7f9cb7c20089461573, role_id=4bc18e5c60c043ae8d42db9c4e9cd438)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:12.480341 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a5377-c2e7-4afa-a3da-33b4e71b7b6f admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:12.494403 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1429/2851] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:42:12 2022] PUT /identity/v3/projects/35b2ce1dc11d445c806fd9d3bb291860/users/ad71b55c70de4d7f9cb7c20089461573/roles/4bc18e5c60c043ae8d42db9c4e9cd438 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:42:12.499385 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113c1c3-c050-4446-b1a2-0e2c2edff740 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:12.499675 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113c1c3-c050-4446-b1a2-0e2c2edff740 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:12.499956 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113c1c3-c050-4446-b1a2-0e2c2edff740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:12.517785 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-7113c1c3-c050-4446-b1a2-0e2c2edff740 None None] MFA Rules not processed for user `76cc2bb71c0f410d8c0ab888335070a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:42:12.519030 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-7113c1c3-c050-4446-b1a2-0e2c2edff740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:42:12.576026 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1423/2852] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:42:12.585468 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a5377-c2e7-4afa-a3da-33b4e71b7b6f admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:12.587791 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-600a5377-c2e7-4afa-a3da-33b4e71b7b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:42:12.642344 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a5377-c2e7-4afa-a3da-33b4e71b7b6f admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:12.646008 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99f7e5-c1dd-4a45-a029-dbfb1a6cb7ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:12.646637 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99f7e5-c1dd-4a45-a029-dbfb1a6cb7ef service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:12.646914 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99f7e5-c1dd-4a45-a029-dbfb1a6cb7ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:12.647186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99f7e5-c1dd-4a45-a029-dbfb1a6cb7ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:12.656634 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99f7e5-c1dd-4a45-a029-dbfb1a6cb7ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:12.658052 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99f7e5-c1dd-4a45-a029-dbfb1a6cb7ef service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:12.667497 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1430/2853] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:42:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:42:16.332663 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550b0f2-93a0-4a6b-985a-b1dc0e291a6b None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:16.333150 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550b0f2-93a0-4a6b-985a-b1dc0e291a6b None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:16.333266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550b0f2-93a0-4a6b-985a-b1dc0e291a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:16.359765 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-3550b0f2-93a0-4a6b-985a-b1dc0e291a6b None None] MFA Rules not processed for user `ad71b55c70de4d7f9cb7c20089461573`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:42:16.360905 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-3550b0f2-93a0-4a6b-985a-b1dc0e291a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:42:16.428114 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1424/2854] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:42:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:42:16.429405 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99f7e5-c1dd-4a45-a029-dbfb1a6cb7ef service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:16.438996 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99f7e5-c1dd-4a45-a029-dbfb1a6cb7ef service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:16.444019 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9f4d5-72b1-49fb-a25e-2ef9b731cc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:16.444690 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9f4d5-72b1-49fb-a25e-2ef9b731cc61 admin admin] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:16.444969 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9f4d5-72b1-49fb-a25e-2ef9b731cc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:16.445357 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9f4d5-72b1-49fb-a25e-2ef9b731cc61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:16.446069 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9f4d5-72b1-49fb-a25e-2ef9b731cc61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:16.448452 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9f4d5-72b1-49fb-a25e-2ef9b731cc61 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:16.476355 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1431/2855] 10.222.0.60 () {60 vars in 1152 bytes} [Fri May 6 23:42:16 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:42:16.477636 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550b0f2-93a0-4a6b-985a-b1dc0e291a6b None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:16.488596 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550b0f2-93a0-4a6b-985a-b1dc0e291a6b None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:16.550678 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b8bca-b58f-46a8-8f86-298de8c784b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:16.552178 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b8bca-b58f-46a8-8f86-298de8c784b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:16.552850 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b8bca-b58f-46a8-8f86-298de8c784b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:16.553948 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b8bca-b58f-46a8-8f86-298de8c784b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:16.555067 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b8bca-b58f-46a8-8f86-298de8c784b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:16.557695 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b8bca-b58f-46a8-8f86-298de8c784b6 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:16.587940 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1425/2856] 10.222.0.60 () {60 vars in 1143 bytes} [Fri May 6 23:42:16 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 06 23:42:16.591864 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9f4d5-72b1-49fb-a25e-2ef9b731cc61 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:16.602484 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9f4d5-72b1-49fb-a25e-2ef9b731cc61 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:16.609280 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef2e41-5002-43e6-b946-16132762b984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:16.609957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef2e41-5002-43e6-b946-16132762b984 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:16.610233 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef2e41-5002-43e6-b946-16132762b984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:16.610509 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef2e41-5002-43e6-b946-16132762b984 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:16.611242 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef2e41-5002-43e6-b946-16132762b984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:16.612917 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef2e41-5002-43e6-b946-16132762b984 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:16.624206 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1432/2857] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:42:16.628237 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b8bca-b58f-46a8-8f86-298de8c784b6 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:16.639064 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b8bca-b58f-46a8-8f86-298de8c784b6 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:16.643755 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ace83-e54c-48c7-b7bf-4461586aef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:16.644703 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ace83-e54c-48c7-b7bf-4461586aef6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:16.644990 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ace83-e54c-48c7-b7bf-4461586aef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:16.645266 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ace83-e54c-48c7-b7bf-4461586aef6a admin admin] PATH_INFO: `/v3/projects/af48a7fe148043dd8f54b98490963a20/users/6727f94b4dc14fa4966816cd83482a1b/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:16.666390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ace83-e54c-48c7-b7bf-4461586aef6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=af48a7fe148043dd8f54b98490963a20, user_id=6727f94b4dc14fa4966816cd83482a1b, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:16.669018 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ace83-e54c-48c7-b7bf-4461586aef6a admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:16.688210 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1426/2858] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:42:16 2022] PUT /identity/v3/projects/af48a7fe148043dd8f54b98490963a20/users/6727f94b4dc14fa4966816cd83482a1b/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:42:16.695397 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef2e41-5002-43e6-b946-16132762b984 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:16.708300 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef2e41-5002-43e6-b946-16132762b984 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:16.773880 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef9200-c4fd-4249-bb5d-11d4149ed5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:16.774805 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef9200-c4fd-4249-bb5d-11d4149ed5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:16.775623 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef9200-c4fd-4249-bb5d-11d4149ed5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:16.775623 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef9200-c4fd-4249-bb5d-11d4149ed5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:16.776889 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef9200-c4fd-4249-bb5d-11d4149ed5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:16.779458 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef9200-c4fd-4249-bb5d-11d4149ed5a1 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:16.790983 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1433/2859] 10.222.0.60 () {58 vars in 1121 bytes} [Fri May 6 23:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 06 23:42:16.795422 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ace83-e54c-48c7-b7bf-4461586aef6a admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:16.809516 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ace83-e54c-48c7-b7bf-4461586aef6a admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:16.814700 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74f12a-7763-440b-a1ed-c4dff7c06b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:16.815591 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74f12a-7763-440b-a1ed-c4dff7c06b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:16.821954 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74f12a-7763-440b-a1ed-c4dff7c06b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:16.822551 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74f12a-7763-440b-a1ed-c4dff7c06b2f admin admin] PATH_INFO: `/v3/projects/af48a7fe148043dd8f54b98490963a20/users/6727f94b4dc14fa4966816cd83482a1b/roles/408ee9a3a38640a48dbcdb2c377efcd8` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:16.828771 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74f12a-7763-440b-a1ed-c4dff7c06b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=af48a7fe148043dd8f54b98490963a20, user_id=6727f94b4dc14fa4966816cd83482a1b, role_id=408ee9a3a38640a48dbcdb2c377efcd8)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:16.831533 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74f12a-7763-440b-a1ed-c4dff7c06b2f admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:16.842800 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1427/2860] 10.222.0.60 () {60 vars in 1482 bytes} [Fri May 6 23:42:16 2022] PUT /identity/v3/projects/af48a7fe148043dd8f54b98490963a20/users/6727f94b4dc14fa4966816cd83482a1b/roles/408ee9a3a38640a48dbcdb2c377efcd8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:42:21.500659 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cd11c-0849-4514-9901-317d1116042e None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:21.501195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cd11c-0849-4514-9901-317d1116042e None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:21.501195 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cd11c-0849-4514-9901-317d1116042e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:21.531596 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-953cd11c-0849-4514-9901-317d1116042e None None] MFA Rules not processed for user `6727f94b4dc14fa4966816cd83482a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:42:21.534125 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-953cd11c-0849-4514-9901-317d1116042e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:42:21.638968 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1434/2861] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:42:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:42:21.657626 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74f12a-7763-440b-a1ed-c4dff7c06b2f admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:21.664052 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-4a74f12a-7763-440b-a1ed-c4dff7c06b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:42:21.822485 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74f12a-7763-440b-a1ed-c4dff7c06b2f admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:21.838228 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf142975-1845-4ae8-b160-be33aaf98dba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:21.839809 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf142975-1845-4ae8-b160-be33aaf98dba service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:21.840294 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf142975-1845-4ae8-b160-be33aaf98dba service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:21.840926 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf142975-1845-4ae8-b160-be33aaf98dba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:21.923386 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf142975-1845-4ae8-b160-be33aaf98dba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:21.926223 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf142975-1845-4ae8-b160-be33aaf98dba service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:21.937324 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1428/2862] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:42:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:42:23.566750 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1203c20-c0be-437b-88ec-7b68af361313 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:23.567340 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1203c20-c0be-437b-88ec-7b68af361313 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:23.567340 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1203c20-c0be-437b-88ec-7b68af361313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:23.587422 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-c1203c20-c0be-437b-88ec-7b68af361313 None None] MFA Rules not processed for user `ad71b55c70de4d7f9cb7c20089461573`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:42:23.588786 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-c1203c20-c0be-437b-88ec-7b68af361313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:42:23.596955 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1435/2863] 10.222.0.60 () {58 vars in 957 bytes} [Fri May 6 23:42:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:42:47.952580 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf142975-1845-4ae8-b160-be33aaf98dba service nova] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:47.954041 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-bf142975-1845-4ae8-b160-be33aaf98dba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:42:48.016823 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf142975-1845-4ae8-b160-be33aaf98dba service nova] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:48.021302 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60610e3-54f5-4cd6-b9c3-446efa907da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:48.022149 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60610e3-54f5-4cd6-b9c3-446efa907da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:48.022450 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60610e3-54f5-4cd6-b9c3-446efa907da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:48.022723 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60610e3-54f5-4cd6-b9c3-446efa907da0 admin admin] PATH_INFO: `/v3/users/4404cebe9b304ede809878dfb26d5e66` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:48.023886 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60610e3-54f5-4cd6-b9c3-446efa907da0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4404cebe9b304ede809878dfb26d5e66)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:48.025848 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60610e3-54f5-4cd6-b9c3-446efa907da0 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:48.068600 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-f60610e3-54f5-4cd6-b9c3-446efa907da0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4404cebe9b304ede809878dfb26d5e66'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:42:48.075446 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-f60610e3-54f5-4cd6-b9c3-446efa907da0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4404cebe9b304ede809878dfb26d5e66'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:42:48.082450 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-f60610e3-54f5-4cd6-b9c3-446efa907da0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4404cebe9b304ede809878dfb26d5e66'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:42:48.083116 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-f60610e3-54f5-4cd6-b9c3-446efa907da0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4404cebe9b304ede809878dfb26d5e66'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:42:48.083749 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-f60610e3-54f5-4cd6-b9c3-446efa907da0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4404cebe9b304ede809878dfb26d5e66'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:42:48.100188 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1429/2864] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:42:47 2022] DELETE /identity/v3/users/4404cebe9b304ede809878dfb26d5e66 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:42:48.267118 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1203c20-c0be-437b-88ec-7b68af361313 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:48.279700 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1203c20-c0be-437b-88ec-7b68af361313 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:48.337160 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6aa1a-efc6-447f-a4b4-76179ff97f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:48.338028 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6aa1a-efc6-447f-a4b4-76179ff97f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:48.338309 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6aa1a-efc6-447f-a4b4-76179ff97f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:48.338700 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6aa1a-efc6-447f-a4b4-76179ff97f60 admin admin] PATH_INFO: `/v3/projects/fbfdc805dcba4bbb8a0918f41c0d38c7` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:48.339892 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6aa1a-efc6-447f-a4b4-76179ff97f60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbfdc805dcba4bbb8a0918f41c0d38c7)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:48.341839 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6aa1a-efc6-447f-a4b4-76179ff97f60 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:48.387343 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-96c6aa1a-efc6-447f-a4b4-76179ff97f60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbfdc805dcba4bbb8a0918f41c0d38c7', 'request_id': 'req-96c6aa1a-efc6-447f-a4b4-76179ff97f60'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:42:48.393332 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-96c6aa1a-efc6-447f-a4b4-76179ff97f60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbfdc805dcba4bbb8a0918f41c0d38c7', 'request_id': 'req-96c6aa1a-efc6-447f-a4b4-76179ff97f60'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:42:48.398719 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-96c6aa1a-efc6-447f-a4b4-76179ff97f60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbfdc805dcba4bbb8a0918f41c0d38c7', 'request_id': 'req-96c6aa1a-efc6-447f-a4b4-76179ff97f60'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:42:48.410392 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-96c6aa1a-efc6-447f-a4b4-76179ff97f60 admin admin] The token cache is being invalidate because project fbfdc805dcba4bbb8a0918f41c0d38c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:42:48.410679 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-96c6aa1a-efc6-447f-a4b4-76179ff97f60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:42:48.411298 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-96c6aa1a-efc6-447f-a4b4-76179ff97f60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:42:48.412866 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1436/2865] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:42:48 2022] DELETE /identity/v3/projects/fbfdc805dcba4bbb8a0918f41c0d38c7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:42:56.986850 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60610e3-54f5-4cd6-b9c3-446efa907da0 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:42:56.988245 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f60610e3-54f5-4cd6-b9c3-446efa907da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:42:57.043390 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60610e3-54f5-4cd6-b9c3-446efa907da0 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:42:57.088785 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0398d7f-54dc-4505-8fad-4ccdf3b8a3cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:42:57.089420 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0398d7f-54dc-4505-8fad-4ccdf3b8a3cb service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:42:57.089701 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0398d7f-54dc-4505-8fad-4ccdf3b8a3cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:42:57.089972 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0398d7f-54dc-4505-8fad-4ccdf3b8a3cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:42:57.091717 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f0398d7f-54dc-4505-8fad-4ccdf3b8a3cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:42:57.150272 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0398d7f-54dc-4505-8fad-4ccdf3b8a3cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:42:57.151782 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0398d7f-54dc-4505-8fad-4ccdf3b8a3cb service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:42:57.162117 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1430/2866] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:42:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:43:43.543574 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6aa1a-efc6-447f-a4b4-76179ff97f60 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:43:43.545173 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-96c6aa1a-efc6-447f-a4b4-76179ff97f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:43:43.563224 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6aa1a-efc6-447f-a4b4-76179ff97f60 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:43:43.567221 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bc1ce-e798-4406-aa2b-4c40e1061280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:43:43.567885 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bc1ce-e798-4406-aa2b-4c40e1061280 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:43:43.568312 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bc1ce-e798-4406-aa2b-4c40e1061280 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:43:43.568626 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bc1ce-e798-4406-aa2b-4c40e1061280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:43:43.570541 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-f09bc1ce-e798-4406-aa2b-4c40e1061280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:43:43.642171 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09bc1ce-e798-4406-aa2b-4c40e1061280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:43:43.643605 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09bc1ce-e798-4406-aa2b-4c40e1061280 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:43:43.655257 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1437/2867] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:43:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:43:44.831885 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0398d7f-54dc-4505-8fad-4ccdf3b8a3cb service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:43:44.840885 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0398d7f-54dc-4505-8fad-4ccdf3b8a3cb service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:43:44.844840 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8972ea2-c5e9-4c1a-8b21-a47d9d149298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:43:44.845345 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8972ea2-c5e9-4c1a-8b21-a47d9d149298 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:43:44.845630 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8972ea2-c5e9-4c1a-8b21-a47d9d149298 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:43:44.845907 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8972ea2-c5e9-4c1a-8b21-a47d9d149298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:43:44.847662 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f8972ea2-c5e9-4c1a-8b21-a47d9d149298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:43:44.863625 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8972ea2-c5e9-4c1a-8b21-a47d9d149298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:43:44.865126 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8972ea2-c5e9-4c1a-8b21-a47d9d149298 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:43:44.876503 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1431/2868] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:43:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:43:55.938083 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bc1ce-e798-4406-aa2b-4c40e1061280 service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:43:55.939484 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-f09bc1ce-e798-4406-aa2b-4c40e1061280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:43:55.950990 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bc1ce-e798-4406-aa2b-4c40e1061280 service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:43:55.954601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4467a80-e1e5-4c7a-b493-a64375f3c9f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:43:55.955279 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4467a80-e1e5-4c7a-b493-a64375f3c9f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:43:55.955593 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4467a80-e1e5-4c7a-b493-a64375f3c9f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:43:55.955886 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4467a80-e1e5-4c7a-b493-a64375f3c9f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:43:55.957623 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-f4467a80-e1e5-4c7a-b493-a64375f3c9f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:43:56.018606 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4467a80-e1e5-4c7a-b493-a64375f3c9f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:43:56.020119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4467a80-e1e5-4c7a-b493-a64375f3c9f9 service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:43:56.029916 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1438/2869] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:43:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:44:02.314499 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8972ea2-c5e9-4c1a-8b21-a47d9d149298 service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:44:02.315975 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-f8972ea2-c5e9-4c1a-8b21-a47d9d149298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:44:02.330597 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8972ea2-c5e9-4c1a-8b21-a47d9d149298 service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:44:02.335176 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dc9ae-3f77-455e-9d08-60d14c9d8f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:44:02.336243 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dc9ae-3f77-455e-9d08-60d14c9d8f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:44:02.336526 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dc9ae-3f77-455e-9d08-60d14c9d8f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:44:02.336838 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dc9ae-3f77-455e-9d08-60d14c9d8f59 admin admin] PATH_INFO: `/v3/users/a9fd4d50424a41d59ee31d65ec362058` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:44:02.338555 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dc9ae-3f77-455e-9d08-60d14c9d8f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9fd4d50424a41d59ee31d65ec362058)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:44:02.340481 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dc9ae-3f77-455e-9d08-60d14c9d8f59 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:44:02.386392 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c67dc9ae-3f77-455e-9d08-60d14c9d8f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9fd4d50424a41d59ee31d65ec362058'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:44:02.392848 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c67dc9ae-3f77-455e-9d08-60d14c9d8f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9fd4d50424a41d59ee31d65ec362058'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:44:02.399725 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c67dc9ae-3f77-455e-9d08-60d14c9d8f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9fd4d50424a41d59ee31d65ec362058'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:44:02.400336 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c67dc9ae-3f77-455e-9d08-60d14c9d8f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9fd4d50424a41d59ee31d65ec362058'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:44:02.400951 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-c67dc9ae-3f77-455e-9d08-60d14c9d8f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9fd4d50424a41d59ee31d65ec362058'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:44:02.417620 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1432/2870] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:44:02 2022] DELETE /identity/v3/users/a9fd4d50424a41d59ee31d65ec362058 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:44:02.593830 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4467a80-e1e5-4c7a-b493-a64375f3c9f9 service neutron] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:44:02.606607 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4467a80-e1e5-4c7a-b493-a64375f3c9f9 service neutron] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:44:02.667803 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a7965-d6ab-42c3-a26c-a863b049b798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:44:02.668696 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a7965-d6ab-42c3-a26c-a863b049b798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:44:02.668974 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a7965-d6ab-42c3-a26c-a863b049b798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:44:02.669242 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a7965-d6ab-42c3-a26c-a863b049b798 admin admin] PATH_INFO: `/v3/projects/5b65f58d692248d3bf0c03bff716e1fb` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:44:02.670411 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a7965-d6ab-42c3-a26c-a863b049b798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b65f58d692248d3bf0c03bff716e1fb)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:44:02.672336 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a7965-d6ab-42c3-a26c-a863b049b798 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:44:02.715541 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-059a7965-d6ab-42c3-a26c-a863b049b798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b65f58d692248d3bf0c03bff716e1fb', 'request_id': 'req-059a7965-d6ab-42c3-a26c-a863b049b798'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:44:02.721313 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-059a7965-d6ab-42c3-a26c-a863b049b798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b65f58d692248d3bf0c03bff716e1fb', 'request_id': 'req-059a7965-d6ab-42c3-a26c-a863b049b798'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:44:02.726435 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-059a7965-d6ab-42c3-a26c-a863b049b798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b65f58d692248d3bf0c03bff716e1fb', 'request_id': 'req-059a7965-d6ab-42c3-a26c-a863b049b798'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:44:02.738537 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-059a7965-d6ab-42c3-a26c-a863b049b798 admin admin] The token cache is being invalidate because project 5b65f58d692248d3bf0c03bff716e1fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:44:02.738819 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-059a7965-d6ab-42c3-a26c-a863b049b798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:44:02.739423 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-059a7965-d6ab-42c3-a26c-a863b049b798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:44:02.740957 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1439/2871] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:44:02 2022] DELETE /identity/v3/projects/5b65f58d692248d3bf0c03bff716e1fb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:44:02.745541 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dc9ae-3f77-455e-9d08-60d14c9d8f59 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:44:02.746924 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-c67dc9ae-3f77-455e-9d08-60d14c9d8f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:44:02.760205 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dc9ae-3f77-455e-9d08-60d14c9d8f59 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:44:02.836060 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f21ff-6023-4f97-821b-20dc371b3955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:44:02.837009 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f21ff-6023-4f97-821b-20dc371b3955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:44:02.837236 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f21ff-6023-4f97-821b-20dc371b3955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:44:02.837506 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f21ff-6023-4f97-821b-20dc371b3955 admin admin] PATH_INFO: `/v3/users/9d08f3d1fb47418ba9979ab2e6cc205a` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:44:02.838698 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f21ff-6023-4f97-821b-20dc371b3955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d08f3d1fb47418ba9979ab2e6cc205a)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:44:02.840717 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f21ff-6023-4f97-821b-20dc371b3955 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:44:02.885381 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cc0f21ff-6023-4f97-821b-20dc371b3955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d08f3d1fb47418ba9979ab2e6cc205a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:44:02.891837 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cc0f21ff-6023-4f97-821b-20dc371b3955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d08f3d1fb47418ba9979ab2e6cc205a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:44:02.898781 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cc0f21ff-6023-4f97-821b-20dc371b3955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d08f3d1fb47418ba9979ab2e6cc205a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:44:02.899383 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cc0f21ff-6023-4f97-821b-20dc371b3955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d08f3d1fb47418ba9979ab2e6cc205a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:44:02.899976 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-cc0f21ff-6023-4f97-821b-20dc371b3955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d08f3d1fb47418ba9979ab2e6cc205a'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:44:02.916331 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1433/2872] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:44:02 2022] DELETE /identity/v3/users/9d08f3d1fb47418ba9979ab2e6cc205a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:44:03.085155 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a7965-d6ab-42c3-a26c-a863b049b798 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:44:03.086602 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-059a7965-d6ab-42c3-a26c-a863b049b798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:44:03.101638 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a7965-d6ab-42c3-a26c-a863b049b798 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:44:03.167736 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b85880-e89a-4b6f-90e7-70fc0735b4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:44:03.168634 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b85880-e89a-4b6f-90e7-70fc0735b4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:44:03.168918 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b85880-e89a-4b6f-90e7-70fc0735b4df admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:44:03.169193 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b85880-e89a-4b6f-90e7-70fc0735b4df admin admin] PATH_INFO: `/v3/projects/44565a723e3d494b8ce945e42976ab08` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:44:03.170388 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b85880-e89a-4b6f-90e7-70fc0735b4df admin admin] RBAC: Authorizing `identity:delete_project(project_id=44565a723e3d494b8ce945e42976ab08)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:44:03.172310 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b85880-e89a-4b6f-90e7-70fc0735b4df admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:44:03.217367 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b2b85880-e89a-4b6f-90e7-70fc0735b4df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44565a723e3d494b8ce945e42976ab08', 'request_id': 'req-b2b85880-e89a-4b6f-90e7-70fc0735b4df'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:44:03.223353 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b2b85880-e89a-4b6f-90e7-70fc0735b4df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44565a723e3d494b8ce945e42976ab08', 'request_id': 'req-b2b85880-e89a-4b6f-90e7-70fc0735b4df'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:44:03.229186 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b2b85880-e89a-4b6f-90e7-70fc0735b4df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44565a723e3d494b8ce945e42976ab08', 'request_id': 'req-b2b85880-e89a-4b6f-90e7-70fc0735b4df'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:44:03.240731 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b2b85880-e89a-4b6f-90e7-70fc0735b4df admin admin] The token cache is being invalidate because project 44565a723e3d494b8ce945e42976ab08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:44:03.241015 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b2b85880-e89a-4b6f-90e7-70fc0735b4df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:44:03.241617 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-b2b85880-e89a-4b6f-90e7-70fc0735b4df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:44:03.243664 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1440/2873] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:44:03 2022] DELETE /identity/v3/projects/44565a723e3d494b8ce945e42976ab08 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:44:31.642487 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f21ff-6023-4f97-821b-20dc371b3955 admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:44:31.643895 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-cc0f21ff-6023-4f97-821b-20dc371b3955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:44:31.697843 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f21ff-6023-4f97-821b-20dc371b3955 admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:44:31.743177 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dee642-b6af-4613-8080-f5a4df373262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:44:31.743810 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dee642-b6af-4613-8080-f5a4df373262 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:44:31.744092 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dee642-b6af-4613-8080-f5a4df373262 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:44:31.744365 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dee642-b6af-4613-8080-f5a4df373262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:44:31.746127 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-46dee642-b6af-4613-8080-f5a4df373262 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:44:31.755486 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dee642-b6af-4613-8080-f5a4df373262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:44:31.756942 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dee642-b6af-4613-8080-f5a4df373262 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:44:31.765229 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1434/2874] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:44:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:45:10.843629 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a950579-10c2-47c3-9d18-4279093881c5 None None] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:45:10.844213 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a950579-10c2-47c3-9d18-4279093881c5 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:45:10.844213 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a950579-10c2-47c3-9d18-4279093881c5 None None] PATH_INFO: `/` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:45:10.845829 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1441/2875] 10.222.0.60 () {54 vars in 921 bytes} [Fri May 6 23:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:45:10.851714 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683c475-9166-4dab-8776-06f612f18299 None None] REQUEST_METHOD: `POST` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:45:10.852182 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683c475-9166-4dab-8776-06f612f18299 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:45:10.852283 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683c475-9166-4dab-8776-06f612f18299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:45:10.890165 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.auth.core [None req-1683c475-9166-4dab-8776-06f612f18299 None None] MFA Rules not processed for user `046352b8553c4f23b6dda151f6f7ce00`. Rule list: `[]` (Enabled: `True`). {{(pid=79803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:45:10.891400 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-1683c475-9166-4dab-8776-06f612f18299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:45:10.898366 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1435/2876] 10.222.0.60 () {58 vars in 1018 bytes} [Fri May 6 23:45:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 06 23:45:10.910772 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a950579-10c2-47c3-9d18-4279093881c5 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:45:10.912502 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-8a950579-10c2-47c3-9d18-4279093881c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:45:10.926009 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a950579-10c2-47c3-9d18-4279093881c5 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:45:10.929614 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1733fe-d648-4a5c-a697-956e2ad1bc0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:45:10.930248 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1733fe-d648-4a5c-a697-956e2ad1bc0a service neutron] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:45:10.930526 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1733fe-d648-4a5c-a697-956e2ad1bc0a service neutron] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:45:10.930904 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1733fe-d648-4a5c-a697-956e2ad1bc0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:45:10.938116 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1733fe-d648-4a5c-a697-956e2ad1bc0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:45:10.939555 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1733fe-d648-4a5c-a697-956e2ad1bc0a service neutron] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:45:10.947896 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1442/2877] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:45:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:45:11.028079 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192a572-85ef-4097-b267-2bcdec2483b6 None None] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:45:11.028367 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192a572-85ef-4097-b267-2bcdec2483b6 None None] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:45:11.028678 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192a572-85ef-4097-b267-2bcdec2483b6 None None] PATH_INFO: `/` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:45:11.030092 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1436/2878] 10.222.0.60 () {54 vars in 921 bytes} [Fri May 6 23:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 06 23:45:11.035977 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9fd22-a510-4640-a38e-eb05be9b9de5 None None] REQUEST_METHOD: `POST` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:45:11.036264 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9fd22-a510-4640-a38e-eb05be9b9de5 None None] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:45:11.036550 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9fd22-a510-4640-a38e-eb05be9b9de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:45:11.055897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.auth.core [None req-8fe9fd22-a510-4640-a38e-eb05be9b9de5 None None] MFA Rules not processed for user `9b74631c6e1547d991753a65c41bc7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 06 23:45:11.057118 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-8fe9fd22-a510-4640-a38e-eb05be9b9de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:45:11.120009 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1443/2879] 10.222.0.60 () {58 vars in 1018 bytes} [Fri May 6 23:45:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 06 23:45:11.130730 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192a572-85ef-4097-b267-2bcdec2483b6 None None] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:45:11.141401 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192a572-85ef-4097-b267-2bcdec2483b6 None None] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:45:11.144884 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b208dd3-1c08-4d51-b4a2-72a322281425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046352b8553c4f23b6dda151f6f7ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:45:11.145503 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b208dd3-1c08-4d51-b4a2-72a322281425 service neutron] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:45:11.145783 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b208dd3-1c08-4d51-b4a2-72a322281425 service neutron] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:45:11.146055 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b208dd3-1c08-4d51-b4a2-72a322281425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:45:11.155734 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b208dd3-1c08-4d51-b4a2-72a322281425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:45:11.157690 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b208dd3-1c08-4d51-b4a2-72a322281425 service neutron] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:45:11.168121 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1437/2880] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:45:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:45:11.226524 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9fd22-a510-4640-a38e-eb05be9b9de5 None None] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:45:11.227897 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-8fe9fd22-a510-4640-a38e-eb05be9b9de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:45:11.293201 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9fd22-a510-4640-a38e-eb05be9b9de5 None None] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:45:11.298768 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40003922-c6d0-4ab5-80a0-08030190231c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1f7704fb5644688b8764bb1ce15734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:45:11.299429 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40003922-c6d0-4ab5-80a0-08030190231c service placement] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:45:11.299710 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40003922-c6d0-4ab5-80a0-08030190231c service placement] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:45:11.299988 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40003922-c6d0-4ab5-80a0-08030190231c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:45:11.301790 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-40003922-c6d0-4ab5-80a0-08030190231c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:45:11.312892 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40003922-c6d0-4ab5-80a0-08030190231c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:45:11.314462 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40003922-c6d0-4ab5-80a0-08030190231c service placement] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:45:11.324122 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1444/2881] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:45:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:45:13.268577 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b208dd3-1c08-4d51-b4a2-72a322281425 service neutron] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:45:13.270246 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-9b208dd3-1c08-4d51-b4a2-72a322281425 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:45:13.288484 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b208dd3-1c08-4d51-b4a2-72a322281425 service neutron] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:45:13.294602 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a106ff5-4bcd-43be-8810-0e4ccee43888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:45:13.295256 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a106ff5-4bcd-43be-8810-0e4ccee43888 service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:45:13.295540 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a106ff5-4bcd-43be-8810-0e4ccee43888 service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:45:13.295815 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a106ff5-4bcd-43be-8810-0e4ccee43888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:45:13.297780 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-0a106ff5-4bcd-43be-8810-0e4ccee43888 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:45:13.311689 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a106ff5-4bcd-43be-8810-0e4ccee43888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:45:13.313351 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a106ff5-4bcd-43be-8810-0e4ccee43888 service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:45:13.324439 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1438/2882] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:45:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:46:35.391694 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40003922-c6d0-4ab5-80a0-08030190231c service placement] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:46:35.466103 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40003922-c6d0-4ab5-80a0-08030190231c service placement] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:46:35.472518 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81a6b8-9ec1-4870-8f64-a9d012bc2c21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:46:35.473197 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81a6b8-9ec1-4870-8f64-a9d012bc2c21 service nova] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:46:35.473475 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81a6b8-9ec1-4870-8f64-a9d012bc2c21 service nova] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:46:35.473749 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81a6b8-9ec1-4870-8f64-a9d012bc2c21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:46:35.475856 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-bf81a6b8-9ec1-4870-8f64-a9d012bc2c21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:46:35.514081 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81a6b8-9ec1-4870-8f64-a9d012bc2c21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:46:35.515264 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81a6b8-9ec1-4870-8f64-a9d012bc2c21 service nova] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:46:35.527773 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1445/2883] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:46:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:46:37.897478 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a106ff5-4bcd-43be-8810-0e4ccee43888 service nova] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:46:37.899388 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-0a106ff5-4bcd-43be-8810-0e4ccee43888 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:46:37.998121 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a106ff5-4bcd-43be-8810-0e4ccee43888 service nova] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:46:38.004276 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5600e-a0a7-480d-b10a-c6679b0b5804 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b74631c6e1547d991753a65c41bc7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:46:38.004949 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5600e-a0a7-480d-b10a-c6679b0b5804 service nova] REQUEST_METHOD: `GET` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:46:38.005231 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5600e-a0a7-480d-b10a-c6679b0b5804 service nova] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:46:38.005501 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5600e-a0a7-480d-b10a-c6679b0b5804 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:46:38.007236 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-b0c5600e-a0a7-480d-b10a-c6679b0b5804 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:46:38.018916 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5600e-a0a7-480d-b10a-c6679b0b5804 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:46:38.020472 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5600e-a0a7-480d-b10a-c6679b0b5804 service nova] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:46:38.030556 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1439/2884] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:46:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 06 23:46:45.475258 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81a6b8-9ec1-4870-8f64-a9d012bc2c21 service nova] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:46:45.477457 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-bf81a6b8-9ec1-4870-8f64-a9d012bc2c21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:46:45.581895 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81a6b8-9ec1-4870-8f64-a9d012bc2c21 service nova] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:46:45.586730 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2384cb3-aaff-4c8d-b3c9-800e3176a7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:46:45.587601 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2384cb3-aaff-4c8d-b3c9-800e3176a7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:46:45.587890 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2384cb3-aaff-4c8d-b3c9-800e3176a7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:46:45.588167 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2384cb3-aaff-4c8d-b3c9-800e3176a7a8 admin admin] PATH_INFO: `/v3/users/ad71b55c70de4d7f9cb7c20089461573` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:46:45.589392 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2384cb3-aaff-4c8d-b3c9-800e3176a7a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad71b55c70de4d7f9cb7c20089461573)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:46:45.591350 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2384cb3-aaff-4c8d-b3c9-800e3176a7a8 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:46:45.637142 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-e2384cb3-aaff-4c8d-b3c9-800e3176a7a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad71b55c70de4d7f9cb7c20089461573'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:46:45.643723 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-e2384cb3-aaff-4c8d-b3c9-800e3176a7a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad71b55c70de4d7f9cb7c20089461573'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:46:45.644401 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-e2384cb3-aaff-4c8d-b3c9-800e3176a7a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad71b55c70de4d7f9cb7c20089461573'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:46:45.651199 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-e2384cb3-aaff-4c8d-b3c9-800e3176a7a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad71b55c70de4d7f9cb7c20089461573'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:46:45.651893 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-e2384cb3-aaff-4c8d-b3c9-800e3176a7a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad71b55c70de4d7f9cb7c20089461573'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:46:45.668891 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1446/2885] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:46:45 2022] DELETE /identity/v3/users/ad71b55c70de4d7f9cb7c20089461573 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 06 23:46:45.837333 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5600e-a0a7-480d-b10a-c6679b0b5804 service nova] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:46:45.852614 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5600e-a0a7-480d-b10a-c6679b0b5804 service nova] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:46:45.908216 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853bf3e-de10-4925-81ea-c39a42e1074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:46:45.909154 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853bf3e-de10-4925-81ea-c39a42e1074d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:46:45.909931 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853bf3e-de10-4925-81ea-c39a42e1074d admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:46:45.910212 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853bf3e-de10-4925-81ea-c39a42e1074d admin admin] PATH_INFO: `/v3/projects/35b2ce1dc11d445c806fd9d3bb291860` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:46:45.911419 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853bf3e-de10-4925-81ea-c39a42e1074d admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b2ce1dc11d445c806fd9d3bb291860)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:46:45.913371 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853bf3e-de10-4925-81ea-c39a42e1074d admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:46:45.957301 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a853bf3e-de10-4925-81ea-c39a42e1074d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b2ce1dc11d445c806fd9d3bb291860', 'request_id': 'req-a853bf3e-de10-4925-81ea-c39a42e1074d'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:46:45.963114 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a853bf3e-de10-4925-81ea-c39a42e1074d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b2ce1dc11d445c806fd9d3bb291860', 'request_id': 'req-a853bf3e-de10-4925-81ea-c39a42e1074d'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:46:45.968320 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a853bf3e-de10-4925-81ea-c39a42e1074d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b2ce1dc11d445c806fd9d3bb291860', 'request_id': 'req-a853bf3e-de10-4925-81ea-c39a42e1074d'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:46:45.980623 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a853bf3e-de10-4925-81ea-c39a42e1074d admin admin] The token cache is being invalidate because project 35b2ce1dc11d445c806fd9d3bb291860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:46:45.980908 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a853bf3e-de10-4925-81ea-c39a42e1074d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:46:45.981519 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-a853bf3e-de10-4925-81ea-c39a42e1074d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:46:45.983045 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1440/2886] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:46:45 2022] DELETE /identity/v3/projects/35b2ce1dc11d445c806fd9d3bb291860 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:46:45.987027 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2384cb3-aaff-4c8d-b3c9-800e3176a7a8 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:46:45.988402 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-e2384cb3-aaff-4c8d-b3c9-800e3176a7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:46:46.001357 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2384cb3-aaff-4c8d-b3c9-800e3176a7a8 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:46:46.054855 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93655ce-5c4e-4045-87b5-d3da69b03227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:46:46.055706 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93655ce-5c4e-4045-87b5-d3da69b03227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:46:46.055984 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93655ce-5c4e-4045-87b5-d3da69b03227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:46:46.056252 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93655ce-5c4e-4045-87b5-d3da69b03227 admin admin] PATH_INFO: `/v3/users/6727f94b4dc14fa4966816cd83482a1b` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:46:46.057438 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93655ce-5c4e-4045-87b5-d3da69b03227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6727f94b4dc14fa4966816cd83482a1b)` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:46:46.059336 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93655ce-5c4e-4045-87b5-d3da69b03227 admin admin] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:46:46.102854 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-f93655ce-5c4e-4045-87b5-d3da69b03227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6727f94b4dc14fa4966816cd83482a1b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:46:46.109806 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-f93655ce-5c4e-4045-87b5-d3da69b03227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6727f94b4dc14fa4966816cd83482a1b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:46:46.110505 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-f93655ce-5c4e-4045-87b5-d3da69b03227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6727f94b4dc14fa4966816cd83482a1b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:46:46.116791 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-f93655ce-5c4e-4045-87b5-d3da69b03227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6727f94b4dc14fa4966816cd83482a1b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:46:46.117399 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.notifications [None req-f93655ce-5c4e-4045-87b5-d3da69b03227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6727f94b4dc14fa4966816cd83482a1b'} {{(pid=79804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:46:46.134428 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1447/2887] 10.222.0.60 () {58 vars in 1223 bytes} [Fri May 6 23:46:45 2022] DELETE /identity/v3/users/6727f94b4dc14fa4966816cd83482a1b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:46:46.304529 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853bf3e-de10-4925-81ea-c39a42e1074d admin admin] Authenticating user token {{(pid=79803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:46:46.305961 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.fernet_utils [None req-a853bf3e-de10-4925-81ea-c39a42e1074d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:46:46.320499 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853bf3e-de10-4925-81ea-c39a42e1074d admin admin] Validating token access rules against request {{(pid=79803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:46:46.374489 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9302b5-fc0e-4de5-8405-72777a92dfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cc2bb71c0f410d8c0ab888335070a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6afc05c85d9a4c7da004b8027296012b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:46:46.375336 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9302b5-fc0e-4de5-8405-72777a92dfc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:46:46.375615 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9302b5-fc0e-4de5-8405-72777a92dfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:46:46.375885 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9302b5-fc0e-4de5-8405-72777a92dfc7 admin admin] PATH_INFO: `/v3/projects/af48a7fe148043dd8f54b98490963a20` {{(pid=79803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:46:46.377075 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9302b5-fc0e-4de5-8405-72777a92dfc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af48a7fe148043dd8f54b98490963a20)` {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:46:46.379452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9302b5-fc0e-4de5-8405-72777a92dfc7 admin admin] RBAC: Authorization granted {{(pid=79803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:46:46.422614 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-af9302b5-fc0e-4de5-8405-72777a92dfc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af48a7fe148043dd8f54b98490963a20', 'request_id': 'req-af9302b5-fc0e-4de5-8405-72777a92dfc7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:46:46.428564 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-af9302b5-fc0e-4de5-8405-72777a92dfc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af48a7fe148043dd8f54b98490963a20', 'request_id': 'req-af9302b5-fc0e-4de5-8405-72777a92dfc7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:46:46.433692 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-af9302b5-fc0e-4de5-8405-72777a92dfc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af48a7fe148043dd8f54b98490963a20', 'request_id': 'req-af9302b5-fc0e-4de5-8405-72777a92dfc7'} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:46:46.446551 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-af9302b5-fc0e-4de5-8405-72777a92dfc7 admin admin] The token cache is being invalidate because project af48a7fe148043dd8f54b98490963a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 06 23:46:46.446839 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-af9302b5-fc0e-4de5-8405-72777a92dfc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:46:46.447452 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: DEBUG keystone.notifications [None req-af9302b5-fc0e-4de5-8405-72777a92dfc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 06 23:46:46.449077 dv-cinder-840996-1-iscsi devstack@keystone.service[79803]: [pid: 79803|app: 0|req: 1441/2888] 10.222.0.60 () {58 vars in 1232 bytes} [Fri May 6 23:46:46 2022] DELETE /identity/v3/projects/af48a7fe148043dd8f54b98490963a20 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 06 23:47:27.879465 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93655ce-5c4e-4045-87b5-d3da69b03227 admin admin] Authenticating user token {{(pid=79804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 06 23:47:27.880929 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-f93655ce-5c4e-4045-87b5-d3da69b03227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:47:27.968119 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93655ce-5c4e-4045-87b5-d3da69b03227 admin admin] Validating token access rules against request {{(pid=79804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 06 23:47:28.024224 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b32c29-81b3-4d97-9294-1024736cdf4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1f7704fb5644688b8764bb1ce15734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4389eb256aba4b7182e33cb3720b1073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 06 23:47:28.024910 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b32c29-81b3-4d97-9294-1024736cdf4b service placement] REQUEST_METHOD: `GET` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 06 23:47:28.025198 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b32c29-81b3-4d97-9294-1024736cdf4b service placement] SCRIPT_NAME: `/identity` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 06 23:47:28.025475 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b32c29-81b3-4d97-9294-1024736cdf4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 06 23:47:28.027262 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.fernet_utils [None req-f3b32c29-81b3-4d97-9294-1024736cdf4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 06 23:47:28.038264 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b32c29-81b3-4d97-9294-1024736cdf4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 06 23:47:28.039842 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b32c29-81b3-4d97-9294-1024736cdf4b service placement] RBAC: Authorization granted {{(pid=79804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 06 23:47:28.050341 dv-cinder-840996-1-iscsi devstack@keystone.service[79804]: [pid: 79804|app: 0|req: 1448/2889] 10.222.0.60 () {60 vars in 1365 bytes} [Fri May 6 23:47:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)